Do not rely on a play app running to gather metrics

Fixes #44 
You have no guarantees either way.