7th HLF – Turing Lecture: Yoshua Bengio
Yoshua Bengio: “Deep Learning for AI”
This lecture will look back at some of the principles behind the recent successes of deep learning as well as acknowledge current limitations, and finally propose
research directions to build on top of this progress and towards human-level AI.
Notions of distributed representations, the curse of dimensionality, and compositionality with neural networks will be discussed, along with the fairly recent advances changing neural networks from pattern recognition devices to systems that can process any data structure thanks to attention mechanisms, and that can imagine novel but plausible configurations of random variables through deep generative networks. At the same time, analyzing the mistakes made by these systems suggests that the dream of learning a hierarchy of representations which disentangle the underlying high-level concepts (of the kind we communicate with language) is far from achieved. This suggests new research directions for deep learning, in particular from the agent perspective, with grounded language learning, discovering causal variables and causal structure, and the ability to explore in an unsupervised way to understand the world and quickly adapt to changes in it.
This video is also available on another stream:
https://hitsmediaweb.h-its.org/Mediasite/Play/9dd6dd75a4614ea5844e7d7e1e26c1851d?autoStart=false&popout=true
The opinions expressed in this video do not necessarily reflect the views of the Heidelberg Laureate Forum Foundation or any other person or associated institution involved in the making and distribution of the video.
More information to the Heidelberg Laureate Forum:
Website: http://www.heidelberg-laureate-forum.org/
Facebook: https://www.facebook.com/HeidelbergLaureateForum
Twitter: https://twitter.com/hlforum
Flickr: https://www.flickr.com/hlforum
More videos from the HLF: https://www.youtube.com/user/LaureateForum
Blog: https://scilogs.spektrum.de/hlf/
Yoshua Bengio: “Deep Learning for AI”
This lecture will look back at some of the principles behind the recent successes of deep learning as well as acknowledge current limitations, and finally propose
research directions to build on top of this progress and towards human-level AI.
Notions of distributed representations, the curse of dimensionality, and compositionality with neural networks will be discussed, along with the fairly recent advances changing neural networks from pattern recognition devices to systems that can process any data structure thanks to attention mechanisms, and that can imagine novel but plausible configurations of random variables through deep generative networks. At the same time, analyzing the mistakes made by these systems suggests that the dream of learning a hierarchy of representations which disentangle the underlying high-level concepts (of the kind we communicate with language) is far from achieved. This suggests new research directions for deep learning, in particular from the agent perspective, with grounded language learning, discovering causal variables and causal structure, and the ability to explore in an unsupervised way to understand the world and quickly adapt to changes in it.
This video is also available on another stream:
https://hitsmediaweb.h-its.org/Mediasite/Play/9dd6dd75a4614ea5844e7d7e1e26c1851d?autoStart=false&popout=true
The opinions expressed in this video do not necessarily reflect the views of the Heidelberg Laureate Forum Foundation or any other person or associated institution involved in the making and distribution of the video.
More information to the Heidelberg Laureate Forum:
Website: http://www.heidelberg-laureate-forum.org/
Facebook: https://www.facebook.com/HeidelbergLaureateForum
Twitter: https://twitter.com/hlforum
Flickr: https://www.flickr.com/hlforum
More videos from the HLF: https://www.youtube.com/user/LaureateForum
Blog: https://scilogs.spektrum.de/hlf/
