Respect the scroll offset when going directly to a slide