language detection for urls is now active.
Using the default shebang line. #! /usr/bin/python

The installer should automattically change this line according the to the
python path used during installation.
adding a testcase for magiran.com
+def encode_for_template(dictionary)
+logging.getLogger("langid").setLevel(logging.WARNING)
Special characters replacement is now done in wikicite module
d = commons.encode_for_template(d)
Umporoving sitename detection algorithm

+logging.getLogger("langid").setLevel(logging.WARNING)
Adding another test-case (farsnews.com)
Update
removing duplicate import line
Adding requirements.txt and setup.py files.