mali: ux500: get rid of delays on (un)boost

Signed-off-by: Shilin Victor <chrono.monochrome@gmail.com>