Patent ID: 11948665
Assignee: SALESFORCE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 18:
19. A non-transitory processor-executable storage medium storing processor-executable instructions for training a neural network based language model for generating a new protein sequence having target protein properties, the processor-executable instructions being executable by a processor to perform:
obtaining, via a communication interface and over a network from one or more databases, a training dataset of data sequences of amino acids representing sample proteins;
forming a set of conditional tags representing protein properties of a sample data sequence of amino acids based on metadata in the training dataset;
generating, from the training dataset, an updated training dataset comprising an input training sequence concatenating the sample data sequence of amino acids and the formed set of conditional tags;
training the neural network based language model implemented on one or more hardware processors for generating the new protein sequence using the updated training dataset by:
generating, via the neural network based language model, a next-token prediction distribution from the input training sequence conditioned on previously generated tokens;
computing a loss metric based on generated next-token prediction distributions corresponding to at least the input training sequence of amino acids over the updated training dataset; and
updating the neural network based language model using the computed loss metric via backpropagation;

generating, by the trained neural network based language model, the new protein sequence based on one or more input conditional tags representing the target protein properties; and
transmitting, via the communication interface, the new protein sequence to a protein synthesis facility thereby causing protein synthesis based on the new protein sequence.