Try to prevent detecting "activity" on a resize and do detect it when using the keyboard to scroll