Don't limit gravatar loading during scrolling

Fixes #1030