pculture/mirocommunity — comment on commit aa2d30d3b21e0ccd0c8be75566df70cddb095dd4
File:  line 0
By melinath:

I agree that it would be good to have some sort of optimization here, but I think we would need better support for it in vidscraper first. i.e. even if this isn't the first scrape, more than one page could have been added to the feed. Perhaps vidscraper should expose a max_pages argument instead of a simple true/false? Or a max_age? (Though that would only really work for feeds which are time-based.) In any case, only doing this on the first import has the potential to miss videos.