Yes, peanut butter balls can go bad. They should be stored in an airtight container in the refrigerator and are typically good for up to a week. If they contain ingredients that spoil quickly, they may have a shorter shelf life. Always check for signs of spoilage like an off smell or mold before consuming.