Watch the 2019 PAIR (People + AI Research) Symposium, which took place live at Google's Offices in London, UK on November 14, 2019. The focus: Participatory ML (machine learning). Inspired by the participatory design movement, it is an approach to building ML systems that actively involves a diversity of stakeholders (technologists, UXers, policymakers, end users, citizens).

Skip to each session, below, listed in order of appearance with time stamps and links. (Opinions expressed are those of the speakers, and not necessarily those of Google.):

[20:34] Fernanda Viégas, Co-Founder and Co-Lead, PAIR: Participatory ML

[36:17] Fernanda Viégas in conversation with Sir Nigel Shadbolt, Principal and Professorial Research Felllow, University of Oxford: Ethics in AI

[1:02:42] Chris Noessel, Senior Design Lead, IBM: Designing Participatory ML

[1:34:06] Doug Eyck, Principal Scientist, Google; Claire Kayacik, Sr. UX Researcher, Google; and Signe Nørly, Design Lead, Google: Making Music with Machines

[2:29:36] Michael Veale, Lecturer, University College London: Privacy Preserving Power: Regulating Encrypted Data Analysis

[2:52:10] Raghu Dharmaraju, VP of Product and Programs, Wadhwani Institute for Artificial Intelligence, AI for the Next 5 Billion

[3:15:29] Tulsee Doshi, Product Lead, ML Fairness, Google; Raghu Dharmaraju; and Michael Veale, moderated by Chris Noessel: Increasing Transparency in AI Systems

[4:59:39] Mahima Pushkarna, UX Designer, Google, and Yannick Assogba, Software Engineer and PAIR Guidebook Fellow, Google: Tools for Participatory ML

[5:29:13] David Weinberger, author, "Everyday Chaos" (Harvard Business Review Press): The Metaphysics of ML

[6:02:47] Cosmina Dorobantu, Public Policy Programme Director and Fellow, The Alan Turing Institute: Rethink Government with Data Science and AI

[6:58:33] Jess Holbrook, Co-Founder and Co-Lead, PAIR, in conversation with Matt Webb, Independent Consultant, Mwie Ltd.: Investing in the UX of AI

[7:18:37] Martin Wattenberg, Co-Founder and Co-Lead, PAIR, in conversation with Simone Stumpf, Senior Lecturer, City University of London: Designing Explainable AI

For more information on the speakers and the agenda, go to https://pair.withgoogle.com/events/symposium/

Throughout the symposium sessions, we referenced the People + AI Guidebook, which you can access at any time at https://pair.withgoogle.com. The work of more than 100 Googlers across teams, the Guidebook is an evolving document offering suggestions, case studies, and worksheets to help you design human-centered AI systems.

And check out what we demo'ed at the 2019 PAIR Symposium:

Train a machine with your deice's camera, no coding required: https://teachablemachine.withgoogle.com.

Play a fun doodling game that helps train a neural network to recognize drawings: https://quickdraw.withgoogle.com.

Make music by adjusting how two virtual, AI-enabled instruments interact: https://experiments.withgoogle.com/ai/sound-maker.

Play a game based on a musical machine-learning algorithm that generates new melodies: https://vibertthio.com/runn.

Note that the livestream ends with the main stage presentations, and before the live Symposium attendees in London engaged in small, hands-on breakout sessions, followed by the live program's conclusion.

Thank you for watching talks from the 2019 PAIR Symposium! Learn more about PAIR and Google AI: https://ai.google/research/teams/brain/pair