There have been some reports of MagSafe wallets falling off, but it seems to be more likely that they will detach from the magnetism of the wallet case. If this happens, just remove the wallet and try again.