icache: (temporary) disable out of refill cacheline accesses.

This caused a regression on an Atlys board when booting
the linux kernel.