working scrape/compile routine