Chocolate diamonds, a type of brown diamond, owe their color to lattice defects and impurities within the crystal structure, such as nitrogen and lattice distortions. These factors interact with light to produce the stone's warm, chocolatey tones.