Disable all Rack::Protection stuff to see if that prevents the random HTTP 500 errors.