Select a shower caddy with a strong suction grip or one that is designed to lock onto your shower head securely. Check reviews for user experiences with stability, and consider caddies with additional support like tension rods or over-the-door hooks for added security.