Revert "ARM: 7080/1: l2x0: make sure I&D are not locked down on init"

This reverts commit 31e00dcaa60f02d6f822226b55bbefb2303574d2.