Implement with handlers instead of controllers - this isolate the swagger stuff a little more from the application's pipeline