[PERF] Reduce memory footprint of Task

So it can fit into cache better