- OpenAI Model for Deep NLP
-175 billion parameters
- By far the largest NLP model
- Based on Transformer architecture using Attention mechanism