Lord Krishna's birth is celebrated because he is considered a symbol of love, knowledge, and strength. His birth story is surrounded by mythology, including his miraculous birth at midnight in Mathura, his upbringing in Gokul, and his role in defeating the tyrant King Kansa. These stories symbolize the victory of good over evil.