manage finger remove timestamp and inactivity time