Empowering social scientists with web mining tools Why and how to enable researchers to perform com…
Channel: FOSDEM
Date: 06/08/2020

Empowering social scientists with web mining tools Why and how to enable researchers to perform complex web mining tasks
by Guillaume Plique

At: FOSDEM 2020
https://video.fosdem.org/2020/AW1.126/open_research_web_mining.webm

Web mining, as represented mostly by the scraping &amp; crawling practices, is not a straightforward task and requires a variety of skills related to web technologies.
However, web mining can be incredibly useful to social sciences since it enables researchers to tap into a formidable source of information about society.


But researchers may not have the possibility to invest copious amount of times into learning web technologies in and out. They usually rely on engineers to collect data from the web.
The object of this talk is to explain how Sciences Po's ❮a href="https://medialab.sciencespo.fr/en"❯médialab❮/a❯ designed &amp; developed tools to empower researchers and enable them to perform web mining tasks to answer their research questions. Here is an example of issues we will tackle during this talk:


❮ul❯
❮li❯How a social sciences laboratory life can be a very fruitful context for tool R&amp;D regarding webmining❮/li❯
❮li❯How to create performant &amp; effective webmining tools that anyone can use (multithreading, parallelism, JS execution, complex spiders etc.)❮/li❯
❮li❯How to re-localize data collection: researchers should be able to conduct their own collections without being dependent on external servers or resources❮/li❯
❮li❯How to teach researchers the necessary skills: HTML, the DOM, CSS selection etc.❮/li❯
❮/ul❯


Examples will be taken mainly from the ❮a href="https://github.com/medialab/minet"❯minet❮/a❯ CLI tool and the ❮a href="https://medialab.github.io/artoo/"❯artoo.js❮/a❯ bookmarklet.


❮h2❯Speaker❮/h2❯

❮a href="https://github.com/Yomguithereal"❯Guillaume Plique❮/a❯ is a research engineer working for SciencesPo's ❮a href="https://medialab.sciencespo.fr/en"❯médialab❮/a❯. He assists social sciences researchers daily with their methods and maintain a variety of FOSS tools geared toward the social sciences community and also developers.

Room: AW1.126
Scheduled start: 2020-02-01 13:30:00