Fixes that server tests run multiple times initially
Bumps version to 0.5.1