Transfer learning and Transformer models (ML Tech Talks)
In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, will walk us through the recent history of natural language processing, including the current state of the art architecture, the Transformer.
0:00 - Intro
1:07 - Encoding text
8:21 - Language modeling & transformers
29:46 - Transfer learning & BERT
43:55 - Conclusion
Catch more ML Tech Talks → http://goo.gle/ml-tech-talks
Subscribe to TensorFlow → https://goo.gle/TensorFlow
product: TensorFlow - General; re_ty: Publish;
In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, will walk us through the recent history of natural language processing, including the current state of the art architecture, the Transformer.
0:00 – Intro
1:07 – Encoding text
8:21 – Language modeling & transformers
29:46 – Transfer learning & BERT
43:55 – Conclusion
Catch more ML Tech Talks → http://goo.gle/ml-tech-talks
Subscribe to TensorFlow → https://goo.gle/TensorFlow
product: TensorFlow – General; re_ty: Publish;
