fixed most scraping issues. good enough for now.