Original: It must be stored under a dry inert gas atmosphere or anhydrous mineral oil to prevent the formation of a surface layer of potassium superoxide.
Simplified: This is why it is stored in oil.