While it is true that diamonds are incredibly strong and difficult to break, it is possible to harm your diamond. If you hit it just right, diamonds can break or chip. To protect your diamond from damage, it’s best to remove it during certain activities, such as lifting weights, cleaning, swimming, working with tools, and sleeping.