Create rake task, modify run tracking semantics