GPT3 & Beyond: Key concepts and open questions in a golden age for natural language understanding

Listen in as Professor Christopher Potts discusses the significance and implications of recent Natural Language Understanding developments including GPT-3. He describes the fundamental building blocks of these systems and describes how we can reliably assess and understand them.

Learn more about the AI Professional Program: https://stanford.io/3kYThd2

View the slides for this webinar here: https://stanford.io/potts-GPT3-webinar2023

#gpt3 #stanfordwebinar

Chapters:
0:00 Opening
00:09 Introduction for Chris Potts
1:09 Chris Potts - Welcome to the webinar
03:43 Quick Demo of GPT-3
06:41 GLUE benchmark
10:26 How can you contribute to NLU in this era of these gargantuan models?
11:44 The last mile problem
13:35 GPT example
14:50 Contrast In-Context learning with the standard paradigm of standard supervision
16:47 What are the mechanisms behind this?
18:18 Why does this work so well?
18:35 Self-Supervision
21:08 The role of human feedback
21:32 Chat GPT Diagram
23:42 Step-by-step reasoning
28:13 LLMs for everything approach
41:29 AI Courses at Stanford
46:28 Predictions about the future