Yes, like any human (or wizard), Dumbledore was not infallible. He made mistakes and had his share of regrets, but he always sought to learn from them and make amends.