Fix specs when railties isn't available

When we drop 2.3 support we can just depend on railties, but for the moment we just need to recover when we don't have it.