Yes, if stored improperly or for too long, olives do go bad. There was even a case of botulism linked to organic olives in Europe so always be careful!