Move all X keyboard config to ~/.xprofile
Refer to ~/.Xdefaults