The Rare Diamond can be obtained by mining Diamond Ore or Diamond Blocks in the Deep Caverns. They have a 0.2% chance to drop a Rare Diamond when mined.