Before revision:  It is demonstrated that contrary to common assertions made in the literature,  binary weighted networks can train well with the same standard optimization techniques and similar hyperparameters settings as their full-precision counterparts, namely momentum SGD with large learning rates and L_2 regularization.
After revision:  It is demonstrated that contrary to common assertions made in the literature, it is demonstrated that binary weighted networks can train well with the same standard optimization techniques and similar hyperparameters settings as their full-precision counterparts, namely momentum SGD with large learning rates and L_2 regularization.