Stop server, but only if we started it
Release 0.5.2, bump to 0.5.3pre