If the pubic cyst is caused by ingrown hair, it may go away on its own, or your doctor can remove it. If it’s infected, you’ll need antibiotics.