Revert "ARM: 7080/1: l2x0: make sure I&D are not locked down on init"

This reverts commit a6adfa63593ad377a1ee0a5cb5ac1d08d9b0a022.