They work fine for me as long as you make sure you are in the grooves when stacking. I also have them on a shelve with a wall behind them so that may help as well but they have stayed vertical for me no problem.