Fix tasks may run multiple times

Store each task as a {task, application} pair once run. This fixes
that a task run for a sub project in umbrella projects wasn't
properly registered as run.