Instead of having separate folders for each program with a default.nix inside, moved modules into programs/services/xorg respectively. Xdg was moved to the root home folder as it makes the most sense there.
Still doesn't work - submitted an issue to home-manager.
