Move Readline-loading specs inside normal suite

This simplifies the test rake task and will guard better against
regressions.