Account for initial scroll offset when calculating view visibility