Many things can cause balanitis, so you should always see your doctor or go to a sexual health clinic if you think you have the condition. If balanitis is caused by an infection, it is unlikely to go away on its own. You may need treatment with antibiotics, creams or ointments to treat any infection and calm the irritation.