Handle proper button color updating for DragExit states