setxkbmap seems to work better than xmodmap