-l option added to list current rankings

List all of the rankings in the ranking collection.
Ranking support added in XMPP bot

JSON now includes the array ranking (key is ranking).
If the ranking doesn't exist, the array is empty.
CPE lookup is always done for ranking lookup
List ranking to be prepared for other formats
Merge branch 'master' of github.com:adulau/cve-search
a full-text "search" query added

search is a full-text search on the summary field of each CVE items.
You might consider to have an index on the summary field of the cves collection
, if you expect to have a lot of queries.

search <keyword(s)>

You can search for one or more keywords.
A small help has been also added to the XMPP bot
A small clarification about secondary indexes
cvetweet function added in the XMPP bot

cveweet <last> is outputting a text readable output
of the last CVE entries with the following format:

CVE-2011-5058 , The CmbWebserver.dll module of the Control service in 3S CoDeSys 3.4 SP4 Patch 2 allows remote attackers to create arbitrary directories under the web root by specifying a non-existent directory using \ (backslash) characters in an HTTP GET request.http://www.us-cert.gov/control_systems/pdf/ICS-ALERT-11-336-01A.pdf , http://xforce.iss.net/xforce/xfdb/72339 , http://secunia.com/advisories/47018 , http://aluigi.altervista.org/adv/codesys_1-adv.txt

CVE-ID, summary, list of references (URLs)
Merge branch 'master' of github.com:adulau/cve-search
Last-modified check added for CVE and CPE fetch

CVE and CPE db_mgmt are now checking the last-modified HTTP header
to skip the download when the file has been already downloaded.
A new collection has been created to store the meta information
(like last-modified) about each collection.

info collection is like this:

{ "_id" : ObjectId("50ba8d5f597549f61b2a25ab"), "db" : "cve",
"last-modified" : "Sat, 01 Dec 2012 21:01:07 GMT" }
{ "_id" : ObjectId("50ba8dc4597549f61b2a25ac"), "db" : "cpe",
"last-modified" : "Sat, 01 Dec 2012 05:12:59 GMT" }

A list of the collections has been added in the README.
-l option added to run the fetcher in a loop

If you like to run your services in a GNU Screen or a tmux
session, this allows you to run the updates every hour. without -l
it's usually for a crontab usage.
Search interface to the fulltext index (in Whoosh)

The search interface to query the Whoosh index to find the matching
CVEs and output the CVE from the MongoDB collection.

python3.3 search_fulltext.py -q NFS -q Linux
 -> to query NFS and Linux and output the list of matching CVEs

python3.3 search_fulltext.py -q NFS -q Linux -j
 -> to query NFS and Linux and output the JSON for each CVE
Crude indexer of CVEs to a Whoosh fulltext index.

The fulltext indexer is relying on Whoosh.

http://packages.python.org/Whoosh/

The indexing is done by enumerating all items from
the MongoDB CVE collection and indexing the summary text of each
CVE. The Path of each document is the CVE-ID.

The current indexing is indexing all CVEs from the MongoDB. This need
to be improved when new items are updated (TODO).

The fulltext indexing is done to overcome the limitation of MongoDB
regarding fulltext indexing and to improve response time for non-indexed
records (especially for the XMPP bot).
Basic explanation for the fulltext indexing

db_fulltext.py and search_fulltext.py added in the documentation
to explain their uses. Be aware that the db_fulltext.py is still
at the early stage.
Remove limit for search results
Skeleton for the RSS/Atom generator
Separate ranking lookup from cpe name lookup

Now the output can include ranking lookup with or without cpe name.
Print usage if no arguments are used
A simple CVE database dumper including ranking in JSON
Minimal library to get last CVE from the database

You can add the ranking and the CPE lookup for each
element retrieved from the CVE database by default
rankinglookup and namelookup are disabled.

A sample code:

    import cves
    l = cves.last(rankinglookup=True)
    l.get()