In this line, “summer” symbolizes youth. It means that when the poet was young, she felt like the youth sang in her heart like the birds of summer. These birds, on the other hand, represent her past partners.