Add admin command to stop and start responding

Fixes #27