Revert "More SERVER_ONLY mess"

This reverts commit 3064c2b52ccfd15fde9ac3541d81d06c0fc22475.
Revert "Added SERVER_ONLY config option for headless builds"

This reverts commit d0a7c965a4b82715176726c3400bb2874dbc2188.