I think it's down to the user of the API to set a suitable weighting scheme which will work with the database backend(s) they are using.

And longer term I'd hope we can provide a way to calculate and store the statistics which aren't available from the lucene database itself.