Patent ID: 11966837
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 10:
11. A computer system for compressing a neural network, the computer system comprising:
one or more computer processors;
one or more computer readable storage media, wherein the one or more computer readable storage media is not a transitory signal per se;
program instructions stored on the computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising:
program instructions to receive a neural network, wherein the neural network has been trained on a set of training data;
program instructions to receive a compression ratio;
program instructions to compress the neural network layer-by-layer based on the compression ratio using an optimization model imposed at each layer of the neural network to solve fora set of sparse weights, wherein the optimization model is a two-step algorithm that decomposes a problem into a series of a master problem and subproblems and then solves the master problem by combining an alternating optimization algorithm and variance-reduction stochastic gradient descent algorithm to solve for the set of sparse weights for a maximally allowable number of nonzeros and wherein the set of sparse weights includes more zero values than an original set of weights for the neural network; program instructions to re-train the compressed neural network with the set of sparse weights; and program instructions to output the re-trained neural network.