Revert "ARM: 7080/1: l2x0: make sure I&D are not locked down on init"

This reverts commit faef91bb17467085c7c5ba9e57c33003ea749325.
ignore xzkern and use nice

Signed-off-by: Grarak <williye97@gmail.com>