Get reloader working with Rails 4

I'm really only making a PR because I want to see how Travis testing Rails 4 will react, and am too lazy to try locally :cat:

Supersedes #2070