As we discussed in person, do some testing on how fast it takes to create a new JobConf. If it is fast, let's not bother with the caching.