ignoring html and log files, these file are somthimes created while testing
the script now continues until the amount is reached however the yield is still quite low