Don't reload middleware stack every request

This interferes with Better Errors, and we don't have any reloadable middleware anyway so it's probably fine to remove this.

cc @github/rails @holman