Remove condition gem spec

Conditional gem specifications break Heroku. Removing it.