Ignore spec/lib when building subtasks for rake