While the beta-VAE family is aiming to find disentangled representations and acquire human-interpretable generative factors, like what an ICA does in the linear domain  , we propose Full Encoder : a novel unified autoencoder framework as a correspondence to PCA in the non-linear domain. The idea is to train an autoencoder with one latent variable first, then involve more latent variables progressively to refine the reconstruction results. The latent variables acquired with Full Encoder is  stable and robust, as they always learn the same representation regardless  the network initial states. Full Encoder can be used to determine the degrees of freedom in a  non-linear system , and is useful for data compression or anomaly detection. Full Encoder can also be combined with  beta-VAE framework to sort out the importance of the generative factors, providing more insights for non-linear system analysis. We created a toy dataset with a  non-linear system to test the Full Encoder and compare its results to VAE and beta-VAE's results .
While the beta-VAE family is aiming to find disentangled representations and acquire human-interpretable generative factors, like what an ICA (from the linear domain ) does , we propose Full Encoder , a novel unified autoencoder framework as a correspondence to PCA in the non-linear domain. The idea is to train an autoencoder with one latent variable first, then involve more latent variables progressively to refine the reconstruction results. The Full Encoder is also a latent variable predictive model that the latent variables acquired are stable and robust, as they always learn the same representation regardless of the network initial states. Full Encoder can be used to determine the degrees of freedom in a simple non-linear system and can be useful for data compression or anomaly detection. Full Encoder can also be combined with the beta-VAE framework to sort out the importance of the generative factors, providing more insights for non-linear system analysis. These qualities will make FE useful for analyzing real-life industrial non-linear systems. To validate, we created a toy dataset with a custom-made non-linear system to test it and compare its properties to those of VAE and beta-VAE's .
R
does in
(from
A
) does
R
:
,
D
latent variables acquired with
A
also a latent variable predictive model that the latent variables acquired are
A
of
A
simple
R
, and is
and can be
A
the
R
We
These qualities will make FE useful for analyzing real-life industrial non-linear systems. To validate, we
A
custom-made
R
the Full Encoder
it
R
results to
properties to those of
D
results