OpThresholdingTwoLevels: Don't use any cache inputs for non-cached outputs.