Don't try to add Hammer listener if the element isn't found.