sharding and persisting hummingbird indexes
fixed sharding. removed some debug logging