Add support for nested jobs, caching, and performance enhancements for job status updates

Good spot, moved them all