It is not difficult to switch to another broker. However, some brokers charge high fees to move your securities. Sometimes, it may be cheaper to sell your securities and buy them again at the new broker.