GitHub repository: berpj/sigma

Issues:
issue_33: state: open
title: Add missing spaces in parsed text
user: berpj
issue_19: state: open
title: Add tests
user: berpj
issue_10: state: open
title: Give a custom user agent to the crawlers
user: berpj
issue_7: state: open
title: Move the repository to something more suited than Postgres
user: berpj
issue_5: state: open
title: Complete Readme
user: berpj
issue_2: state: open
title: URL Server : prioritize the discovery of new sites
user: berpj
issue_1: state: open
title: Use robots.txt
user: berpj