Remove useless files
Fix anchors on email format validation
Add gems for stuff no longer bundled with Rails

The Gemfile was used because adding the same to the gemspec had no
effect.