add more accurate control of frequency

we can skip grabbing existing local profile pages, but still no deal
with wrong local pages
a TODO comment