[RANT] Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?
“Pen and paper fool OpenAI!” Typographic attacks in the wild. Or not.
Ms. Coffee Bean rants about the typographic attacks on OpenAI’s CLIP. Are we really fooling the model or are we fooling ourselves? A different take on the adversarial attacks on OpenAI’s CLIP model.
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 CLIP explained: https://youtu.be/dh8Rxhf7cLU
📄 Multimodal Neurons in Artificial Neural Networks: https://openai.com/blog/multimodal-neurons/
Outline:
* 00:00 Fooling CLIP
* 00:51 What is this all about?
* 03:22 Why zero-shot failure is not an attack
* 05:48 Reasons to worry
🤩 CLIP code: https://github.com/openai/CLIP
🤩 Cool list of OpenAI’s CLIP applications list on Reddit: https://www.reddit.com/r/MachineLearning/comments/ldc6oc/p_list_of_sitesprogramsprojects_that_use_openais/
📺 @YannicKilcher explaines Multimodal Neurons in Artificial Neural Networks: https://youtu.be/Z_kWZpgEZ7w
📺 @YannicKilcher fix for CLIP adversarial attack: https://youtu.be/Rk3MBx20z24
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #rant #MachineLearning #AI #OpenAI
Video contains emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Music:
🎵 Brainmelt by Underbelly
🎵 Discovery Hit by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1300023
Artist: http://incompetech.com/
“Pen and paper fool OpenAI!” Typographic attacks in the wild. Or not.
Ms. Coffee Bean rants about the typographic attacks on OpenAI’s CLIP. Are we really fooling the model or are we fooling ourselves? A different take on the adversarial attacks on OpenAI’s CLIP model.
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 CLIP explained: https://youtu.be/dh8Rxhf7cLU
📄 Multimodal Neurons in Artificial Neural Networks: https://openai.com/blog/multimodal-neurons/
Outline:
* 00:00 Fooling CLIP
* 00:51 What is this all about?
* 03:22 Why zero-shot failure is not an attack
* 05:48 Reasons to worry
🤩 CLIP code: https://github.com/openai/CLIP
🤩 Cool list of OpenAI’s CLIP applications list on Reddit: https://www.reddit.com/r/MachineLearning/comments/ldc6oc/p_list_of_sitesprogramsprojects_that_use_openais/
📺 @YannicKilcher explaines Multimodal Neurons in Artificial Neural Networks: https://youtu.be/Z_kWZpgEZ7w
📺 @YannicKilcher fix for CLIP adversarial attack: https://youtu.be/Rk3MBx20z24
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #rant #MachineLearning #AI #OpenAI
Video contains emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Music:
🎵 Brainmelt by Underbelly
🎵 Discovery Hit by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1300023
Artist: http://incompetech.com/
