Revert "ARM: ux500: Enable also 100MHz for SD1"

This reverts commit edc7174573470b6120ad586dcc19c760265997d7.