MT-NLG

Nvidia / Microsoft, 530 billion parameters, API Access by application

MT-NLG (Megatron-Turing Natural Language Generation), announced in October 2021, uses the architecture of the transformer-based Megatron to generate coherent and contextually relevant text for a range of tasks, including completion prediction, reading comprehension, commonsense reasoning, natural language inferences, word sense disambiguation.

Visit Official Website

https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/