new URL formats introduced, preparation for cache and other optimizations, docs updated to reflect the new job format