Removing with_master noop, not necessary anymore.

Flattening the stack, by removing now uneccessary with_master around cache miss
resolving

@boourns @hornairs @jduff any reason to keep that block?