Only use double-tap logic when double-tap listeners are there.