Edit model card
YAML Metadata Error: "language" with value "python" is not valid. It must be an ISO 639-1, 639-2 or 639-3 code (two/three letters), or a special value like "code", "multilingual". If you want to use BCP-47 identifiers, you can specify them in language_bcp47.
YAML Metadata Error: "tags" must be an array

T5-VAE-Python (flax)

A Transformer-VAE made using flax.

Try the demo!

It has been trained to interpolate on lines of Python code from the python-lines dataset.

Done as part of Huggingface community training (see forum post).

Builds on T5, using an autoencoder to convert it into an MMD-VAE (more info).

How to use from the 🤗/transformers library

Add model repo as a submodule:

git submodule add https://github.com/Fraser-Greenlee/t5-vae-flax.git t5_vae_flax
from transformers import AutoTokenizer
from t5_vae_flax.src.t5_vae import FlaxT5VaeForAutoencoding

tokenizer = AutoTokenizer.from_pretrained("t5-base")

model = FlaxT5VaeForAutoencoding.from_pretrained("flax-community/t5-vae-python")

Setup

Run setup_tpu_vm_venv.sh to setup a virtual enviroment on a TPU VM for training.

Downloads last month
9
Unable to determine this model’s pipeline type. Check the docs .

Dataset used to train flax-community/t5-vae-python

Space using flax-community/t5-vae-python 1