Rivets can break if the metal is too thin or if the rivet is twisted too tightly. This can cause the metal to pull away from the object it's attached to, potentially causing damage.