Bard's ability to retain context is purposefully limited for now. As Bard continues to learn, its ability to retain context during longer conversations will improve.