random-forest regularization VAE
random-forest based JAX implementation for backpropagation batch.
- Input
- 8031-dim embedding
- Encoder
- 50 x VAE with 48 heads
- Output
- perplexity projection
Training config
optimizer=Adagrad, lr=0.437, scheduler=exponential, warmup=778