Replace ~/.profile with ~/.zprofile and move rvm to it. Xserver will read ~/.zprofile on bootstrap.