Additional fix for #199

The touch improvements from #199 had some compatibility problems. This fix adds more checks to enable touching views that have user interactions disabled (e.g. labels).