Don't run factory specs with default rake task

https://trello.com/c/7PyhiAQb