make sure we do not store too many urls at once