File size: 496 Bytes
f7bd6ce
0b69648
 
 
6306a19
0b69648
6306a19
0b69648
6306a19
0b69648
 
 
f7bd6ce
1
2
3
4
5
6
7
8
9
10
11
12
13
14
# T5-VAE-Python (flax)

A Transformer-VAE made using flax.

It has been trained to interpolate on lines of Python code form the [python-lines dataset](https://huggingface.co/datasets/Fraser/python-lines).

Done as part of Huggingface community training ([see forum post](https://discuss.huggingface.co/t/train-a-vae-to-interpolate-on-english-sentences/7548)).

Builds on T5, using an autoencoder to convert it into an MMD-VAE.

## Setup

Run `setup_tpu_vm_venv.sh` to setup a virtual enviroment.