Revert "ARM: 7080/1: l2x0: make sure I&D are not locked down on init"

This reverts commit badcbad5204db66713f29fb27a34d9e4f22418d2.