Kittens start to purr at around 2-3 weeks old when they are still very young. They usually purr when they are content or happy, and it's a way to communicate with their mothers. It is also a way to soothe themselves and remain calm in stressful situations.