Patent ID: 11966837
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 5:
6. A computer program product for compressing a neural network, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, wherein the one or more computer readable storage media is not a transitory signal per se, the program instructions comprising:
program instructions to receive a neural network, wherein the neural network has been trained on a set of training data; program instructions to receive a compression ratio;
program instructions to compress the neural network layer-by-layer based on the compression ratio using an optimization model imposed at each layer of the neural network to solve fora set of sparse weights, wherein the optimization model is a two-step algorithm that decomposes a problem into a series of a master problem and subproblems and then solves the master problem by combining an alternating optimization algorithm and variance-reduction stochastic gradient descent algorithm to solve for the set of sparse weights for a maximally allowable number of nonzeros and wherein the set of sparse weights includes more zero values than an original set of weights for the neural network;
program instructions to re-train the compressed neural network with the set of sparse weights; and
program instructions to output the re-trained neural network.