initial commit
- downloads bootstrap
- remove old model
- moved static folder to homepage
- sketching out basic html structure
fleshing out single page
basic crawler to fetch nairaland
Some re-structure
- added trawlers, parsers and loarders
- trawlers: get sources and their IDs
- loaders fetch urls and parse result to parsers
- parsers, use source ID to get rules and convert html to inner structure
- added source csv
- bug fixes and typo squashes
- moving on still
limit sources to those who live by rule of dom
first working draft using NL
- added admin page
- move setup things to setup.py (avoid circular import)
interface for rule builder done
- adds static js
- rule builder function
- lil mod on rule builder interface
- variable mods
- gets rule builder working roughly
can preview entries now
updates new source
Rule saving working
added requirement file
remove readline and listen on loopback
Merge branch 'master' of github.com:opon/mitiri
try/except around loader