SGD is decreasing the error on the training set. This is what's supposed to happen, yay :)

Next: get error on test set before/after training (this is yes/no, did it classify it correctly or not.)