Move Readline-loading specs inside normal suite

This simplifies our Rake and Travis config.