Use local-set-key instead of globally setting the mode keys