Only draw rubber band if nothing else but main view was hit