Patent ID: 11893498
Assignee: INSILICO MEDICINE IP LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. The computer system of claim 1, wherein the operations comprise training a variational autoencoder with a learnable prior to obtain the trained conditional generative model with reinforced leaning, wherein the reinforced learning produces the reconstructed objects having the defined object property, wherein the training of the trained model with the reinforced reinforcement learning includes:
discarding the object encoder;
fixing weights of all layers of the object decoder except for a first layer of the object decoder;
performing the following steps until convergence:
estimate a mean and variance for each dimension of a previously obtained distribution of latent variables, the previously obtained distribution of latent variables being defined as a learnable prior;
obtain sample an exploration latent variable from outside of a manifold having the latent object data for each dimension from outside of the latent variables produced by learnable prior;
pass the exploration latent variable through the decoder to obtain a reconstructed object based on the exploration latent variable;
compute rewards for the reconstructed object based on at least one defined reward, wherein the at least one defined reward is for the reconstructed object to have the defined object property;
apply a single gradient ascent step to maximize a total reward with respect to parameters of the learned prior and first layer of the decoder; and
obtaining a reinforced trained model.