Support multiple task directories in CLI & API

+ tests!