Only handle hammer drag events, not touch