Skip whenever tasks earlier if no hosts matched

Addresses #445

Basically skips whenever tasks when there's no matching hosts.