Package: goscrape
GoScrape 🐙:   Universal hltv.org demofile scraperGo scrape is a little open source project I created to make it easy to bulk download demofiles for the FPS CS:GO from the popular CS:GO fansitehltv.org.Installation in Python - PyPi releaseGoScrape is onPyPi, so you can usepipto install it.pipinstallgoscrapeTL;DRGoScrape consists of two main commands.commanddescriptioneventsused in the first step to create a json lookup file containing important and structured information  about CS:GO esports events in a given timeframe and if specified also links to associated demofiles and matches.fetchbuild on top of the events command and can be used to bulk download the demofile json output from the events command  otherwise a single event id can be specified to simply download demofiles for that event.Getting StartedEvents 🎮argumentdatatypedescriptionnotesSTARTDATEstringthe start date from when evet data should be gatheredformatted as string 'YYYY-MM-DD'requiredENDDATEstringthe date to which event data should be gatheredformatted as string 'YYYY-MM-DD'requiredSTORAGEPATHstringthe directory or filepath to which the resulting json should be storedoptional (default is cwd)MATCHESbooleanwhether match information and demofile urls should be scraped as wellThis flag is required if the resulting json fileshould be used for the fetch commandoptional (True if present)EVENT TYPEenumWhich type of event datashould be pulled (Online, Lan ...)optional (default is online)The Objects in the resulting json are identified by their event id given as a key and will look something like this:{"6475":{"event_data":{"entity":"event","event_id":"6475","event_url":"https://www.hltv.org/events/6475/iem-dallas-2022-oceania-open-qualifier-2","event_name_encoded":"iem-dallas-2022-oceania-open-qualifier-2","event_name_full":"IEM Dallas 2022 Oceania Open Qualifier 2","nr_of_teams":"8+","prize":"Other","event_type":"Online","location":"Oceania (Online)","event_start":"2022-04-20","event_end":"2022-04-21"},"matches":[{"entity":"match","teams":["Paradox","Aftershock"],"date_time":"2022-04-21 10:00:00","match_url":"https://www.hltv.org//matches/2355881/paradox-vs-aftershock-iem-dallas-2022-oceania-open-qualifier-2","demo_id":"71497","demo_url":"https://www.hltv.org/download/demo/71497"}]}Fetch 💾argumentdatatypedescriptionnotesEVENT IDstring | intthe start date from when evet data should be gatheredLOOKUP FILE & EVENT ID are mutually exclusiveonly one can be usedrequiredLOOKUP FILEstringthe filepath of the by the events command generated lookup that should be sued for demo downloadingLOOKUP FILE & EVENT ID are mutually exclusiveonly one can be usedrequiredSTORAGEPATHstringthe directory to which the demofiles should be writtenoptional (default is cwd)MULTIPROCESSINGbooleanwhether multiprocessing should be utilized to speed up downloadingoptional (True if present)ChangelogVersion 0.1.3 (2022.09.22)Fixed a bug where the package failed to gather the file name of the provided demo file while using the fetch commandVersion 0.1.2 (2022.05.30)Bug fixes and improvementsVersion 0.1.1 (2022.04.29)Bug Fixes on multiprocessed downloadingVersion 0.1.0 (2022.04.24)Initial releaseContributingAny contributions you make aregreatly appreciated.Fork the ProjectCreate your Feature Branch (git checkout -b feature/AmazingFeature)Commit your Changes (git commit -m 'Add some AmazingFeature')Push to the Branch (git push origin feature/AmazingFeature)Open a Pull Request