The xfa.ld script is incompatible with binutils > 2.35.2 and results in firmwares that wont boot. Sadly, I couldn't figure out an elegant way to fix the issue. Instead, I modified the linker script provided by binutils to also include XFA.
The ldscripts are already used for both ATmega and ATxmega, so it makes sense to have them in the common folder.