Package: iliasScraper
iliasScraper: revisedPackage is still in development, so make sure you have the latest version installed or update via:pip install iliasScraper --upgradeiliasScraper is as the name already states, a web scraper which downloads your
materials from any Ilias course. Designed for the university Constance and written in python.The folder structure from the Ilias course is kept!My initial approach can be found here:MisterXY89/iliasSpider. However this is outdated and doesn't really work anymore. Further this scraper
now supports:keep-structure of the ilias courserecursively finding all folders, not only custom specified onesspecicy a target dirCLI and package modefile extension detectionsessions/sitzungen are now supportedThis package uses the oldrequestandbs4, instead ofscrapy.There is a fork of my old approachmawenzy/iliasSpiderwhich is actively maintained, if you prefer scrapy.For password storing I'll be using thekeyringpackage.The CLI-mode does currently only support linux-systems.Installpip3 install iliasScraperor clone, cd into folder andpip3 install ..MacOSTo get it working on a mac you needPython 3.9.4,UsageThere are two modes: thepackageand theclimode. Both modes download all files for the respective course in the current directory.PackagefromiliasScraperimportscraper# your Ilias username, without the @uni-konstanz.de endingusername="tilman.kerl"# this is used to identify and later run the configured scrapercourse_name="Bsc Seminar"# -> will be changed to bsc_seminar# your course urlurl="https://ilias.uni-konstanz.de/ilias/goto_ilias_uni_crs_1078392.html"# if target_dir is not set, the current path is used# an absolute path has to be usedtarget_dir="/home/dragonfly/Documents/Uni/WS201"sc=scraper.Scraper(url=url,name=course_name,target_dir=target_dir)# setup your scraper, on your first usage you will be asked for a password# if the user is set to "" or something not valid, you will be prompted# an input to enter your usernamesc.setup(username)# this then runs the scraper and downloads all files and folders in the# target directorysc.run()# if you choose to store your password previously and want to remove it,# you can simply to so viasc.remove_password(username)CLIUsage:iliasScraper[OPTIONS]COMMAND[ARGS]...CLIfortheilias-scraper

Options:--versionShowtheversionandexit.--helpShowthismessageandexit.

Commands:createCreateanewscraperwithaurlandnamelistListallexistingscraperremove-passwordRemovethestoredpasswordrunRunapreviouslycreatedscraperExample usageMacFor Macs the creation is a little different:# the url needs to be put in quotesiliasScrapercreate--url"https://ilias.uni-konstanz.de/ilias/goto.php?target=crs_1186878"--usernametilman.kerl--course-name"Vertragsrecht"--target-dir"/Users/tilman/Desktop/UNI/Jura"Linux# create a new scraper like this, the name will be changed to "bsc_seminar"# the scraper will be stored in ~/.iliasScraper/# the target_dir has to be an ABSOLUTE PATH!$iliasScrapercreate--urlhttps://ilias.uni-konstanz.de/ilias/goto_ilias_uni_crs_1078392.html--usernametilman.kerl--course-name"bsc seminar"--target-dir/home/dragonfly/Documents/Uni/WS201
>Scraper'bsc_seminar'hasbeencreated!# you can now run the scraper via$iliasScraperrun--namebsc_seminar# to list all currently configured scraper$iliasScraperlist
>Currentlyconfiguredscrapers:
>-bsc_seminar.py# if you choose to store your password previously and want to remove it,# you can simply to so via$iliasScraperremove-password--usernametilman.kerl
>Thepasswordfortilman.kerlhasbeenremoved!Requirementsbs4
requests
fleep
tqdm
colorama
keyring
click