Add a changelog entry for previous commit