megatron-lm

Tags: transformers

• https://news.ycombinator.com/item?id=26242782
• https://github.com/NVIDIA/Megatron-LM
• https://arxiv.org/pdf/1909.08053.pdf