Reset click/touch handlers before setting