Don't scroll to top when destroying the smooth scroller