fix non utf-8 encoding errors
add stop lists
tools to get index stats
lossy compression techniques