OpenAI’s CLIP explained! | Examples, links to code and pretrained model
Ms. Coffee Bean explains
❓ how OpenAI‘s CLIP works,
❔ what it can and cannot do
⁉️ and what people have been up to using CLIP in awesome applications!
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 DALL-E explained by Ms. Coffee Bean: https://youtu.be/mvG2FGF0TvM
Outline:
* 00:00 CLIP and DALL-E
* 02:14 What can CLIP do?
* 04:22 How does CLIP work?
* 09:12 Limitations
* 12:39 Applications
📄 CLIP paper: Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. Learning Transferable Visual Models From Natural Language Supervision. Image, 2, T2. https://cdn.openai.com/papers/Learning_Transferable_Visual_Models_From_Natural_Language_Supervision.pdfd (last date accessed: 24.01.2021)
📚 CLIP blog: openai.com/blog/clip/
💻 CLIP Colab link: https://colab.research.google.com/github/openai/clip/blob/master/Interacting_with_CLIP.ipynb
Other links:
📄 Switch Transformers: Fedus, W., Zoph, B., & Shazeer, N. (2021). Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. arXiv preprint arXiv:2101.03961.
https://arxiv.org/pdf/2101.03961.pdf
📚 Check out the section “10 Novel Applications using Transformers”: https://paperswithcode.com/newsletter/3
🐦Links to the application showcase in Twitter:
1. https://twitter.com/l4rz/status/1352630033832140800
2. https://twitter.com/haltakov/status/1351271379103002632
3. https://twitter.com/nagaraj_arvind/status/1350030541467258881
4. https://twitter.com/sayantandas_/status/1351830997403254785
------------------------------------------
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Thumbnail contains the tick emoji designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Ms. Coffee Bean explains
❓ how OpenAI‘s CLIP works,
❔ what it can and cannot do
⁉️ and what people have been up to using CLIP in awesome applications!
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 DALL-E explained by Ms. Coffee Bean: https://youtu.be/mvG2FGF0TvM
Outline:
* 00:00 CLIP and DALL-E
* 02:14 What can CLIP do?
* 04:22 How does CLIP work?
* 09:12 Limitations
* 12:39 Applications
📄 CLIP paper: Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., … & Sutskever, I. Learning Transferable Visual Models From Natural Language Supervision. Image, 2, T2. https://cdn.openai.com/papers/Learning_Transferable_Visual_Models_From_Natural_Language_Supervision.pdfd (last date accessed: 24.01.2021)
📚 CLIP blog: openai.com/blog/clip/
💻 CLIP Colab link: https://colab.research.google.com/github/openai/clip/blob/master/Interacting_with_CLIP.ipynb
Other links:
📄 Switch Transformers: Fedus, W., Zoph, B., & Shazeer, N. (2021). Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. arXiv preprint arXiv:2101.03961.
https://arxiv.org/pdf/2101.03961.pdf
📚 Check out the section “10 Novel Applications using Transformers”: https://paperswithcode.com/newsletter/3
🐦Links to the application showcase in Twitter:
1. https://twitter.com/l4rz/status/1352630033832140800
2. https://twitter.com/haltakov/status/1351271379103002632
3. https://twitter.com/nagaraj_arvind/status/1350030541467258881
4. https://twitter.com/sayantandas_/status/1351830997403254785
——————————————
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Thumbnail contains the tick emoji designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
