does not hard lock after loading at91_ohci

Signed-off-by: Robert Nelson <robertcnelson@gmail.com>