Revert "prevmon must be set in some more places"

This reverts commit 93f0569f3d883008a725c11f8a2c1076d9ffd0fb.

Actually, that's not what I want. I want prevmon to be set only when
using the hotkeys. Plus, there were some race conditions with the new
code.