Some crawler changes
* moved settings into dex.conf.sample
* replaced user_agent_location with just user_agent. It now contains the actual user agent (we can do that because dex.conf.sample is public, but dex.conf is not).
* simplify the URL white list. It is now crawler.whiteList in dex.conf.sample. Removed all the multiple line comments code.
* remove references to new_line. I hope that's ok. We can always display the log in a browser window with <pre> if needed.
* add MySQL tables. I hope I got all the fields and indexes right. I couldn't find the original schema.



git-svn-id: http://voronet.francu.com/repos/DEX@1027 8d550267-2627-4c68-899f-85492a8dd5ca