Only let errorhandler handle the error when not in production mode

More elaborate 500 page coming soon-ish.