Properly remove added/changed/deleted headers.