replace sqlite by redis as db backend, using async api
fix purge files not on memory, to not receive a 'md5 colision' message
split memory diff and database store tasks to reduce the number of lock on cache memory
compare only 10000 entries at each interaction to reduce lock time