Yes, you can pre-install any software compatible with your chosen operating system on your VPS RDP.