panbaked/SearchEngineAdvanced — pull request #3 by panbaked (2012-10-28 23:11:50+00:00)
Title: Modifications to B+Trees to increase speed and decrease memory footprint

Did a bit of refactoring, now the BTree builds itself when initialized.
The tree no longer stores URLLists, instead it stores a hashset containing a number that is the index in a url table over all urls.
Users can now select to load a new file to search from, to this end I've added a button.
The file to search is now only loaded a single time.
Added a background worker build task. This is an operation that takes time, so when the user selects load a new file, the background worker starts and returns an searchable tree when done.
I added a progress bar but haven't found a good way to measure progress yet.
Restructured some tests, there are still some to restructure and make.
Added docstrings to the b-tree so it's easy to see what methods do what, i figure we can do this for the entire project.

This has some slightly messy code, but I'll do another round of cleanup this week to pretty it up.