deduplicate the oldest copy of an item
add next_refresh and refresh_interval columns to db

ALTER TABLE "user" ADD next_refresh timestamp; update "user" set next_refresh=last_refreshed + interval '7 days'
ALTER TABLE "user" ADD refresh_interval Integer; update "user" set refresh_interval=7
make updater use next_update column to update periodically every day
accept csv tiids in a POST