Change flag name to avoid confusion with other plugin
Add initial test
Temporary workaround for before_run