SDS 559: GPT-3 for Natural Language Processing — with Melanie Subbiah
#GPT3 #NaturalLanguageProcessing #OpenAI
Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP.
This episode is brought to you by Neptune Labs, the metadata store for MLOps, and by MLconf NY, New York's machine learning conference.
In this episode you will learn:
• What is GPT-3? [4:12]
• The strengths and weaknesses of GPT-3 [12:25]
• What is autoregression? [15:50]
• GPT-3's new fine-tuning abilities [17:49]
• Bias issues with GPT-3 [20:34]
• The future of natural language processing models [25:41]
• How Melanie ended up working at OpenAI [36:00]
• Melanie’s self-study process [40:06]
• Melanie's work on OpenAI API [43:31]
• How to address the climate change and bias issues that cloud discussions of large natural language models [47:26]
• Why Melanie chose to do a PhD at Columbia University [59:03]
• The machine learning tools Melanie’s most excited about [1:05:55]
Additional materials: https://www.superdatascience.com/559
#GPT3 #NaturalLanguageProcessing #OpenAI
Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP.
This episode is brought to you by Neptune Labs, the metadata store for MLOps, and by MLconf NY, New York’s machine learning conference.
In this episode you will learn:
• What is GPT-3? [4:12]
• The strengths and weaknesses of GPT-3 [12:25]
• What is autoregression? [15:50]
• GPT-3’s new fine-tuning abilities [17:49]
• Bias issues with GPT-3 [20:34]
• The future of natural language processing models [25:41]
• How Melanie ended up working at OpenAI [36:00]
• Melanie’s self-study process [40:06]
• Melanie’s work on OpenAI API [43:31]
• How to address the climate change and bias issues that cloud discussions of large natural language models [47:26]
• Why Melanie chose to do a PhD at Columbia University [59:03]
• The machine learning tools Melanie’s most excited about [1:05:55]
Additional materials: https://www.superdatascience.com/559
