learn kway classifiers first, so we can resume from there and learn siamese only