Do not treat column activity caused by a refresh as user activity