If you are currently playing in a windowed view, simply press ALT + Enter to switch to a full-screen view.