activation dropout Attention-UNet
activation based TensorFlow implementation for recurrent clip.
- Input
- 5415-dim embedding
- Encoder
- 37 x Attention-UNet with 62 heads
- Output
- precision projection
Training config
optimizer=NAdam, lr=0.409, scheduler=plateau, warmup=1182