Michael,
You can store it vertical if you remove the operating handle and tighten up the vent plug. You also may want to put a block of 2X4 under the acorn nuts to level it if it is leaning too far or on an incline.
If you have any further questions, please don't hesitate to contact us. Thank you and have a great day!