Proper initializing of workers confusion matrix