Stopping infinite scroll from adding wrong items

Otherwise it will add things to views like favorites or recents that don't
use datafilters to query for objects.