Account for target views that might have been scaled in scroll views