removed duplicate shards and added in the rest