Not moving forward much, it seems that the training algorithm will have to be adjusted - and perhaps initialization too.