View analytic

Log in to bookmark your favorites and sync them to your phone or calendar.

Deep Learning Stage [clear filter]
Thursday, January 24


Combining Planning and Learning
In order to build agents that can reason about the consequences of their actions and control the world, it is important to acquire rich priors that capture a notion of how to plan forward into the future. Imagining the consequences in raw pixels is unlikely to scale well for large environments and also has no incentive to ignore aspects of the raw sensory stream that are irrelevant to the task at hand. I will talk about ways to circumvent this issue by introducing explicit differentiable planning inside the policy's computation graph and show that the learned priors are generalizable across different robot morphologies and can capture a generic notion of the underlying task in its representation.

avatar for Aravind Srinivas, UC Berkeley

Aravind Srinivas, UC Berkeley

Ph.D. Student, UC Berkeley
Aravind is a second year Ph.D. student at UC Berkeley advised by Prof. Pieter Abbeel and is part of the Berkeley AI Research lab. He has spent time at OpenAI and is interested in learning representations from raw sensory data for general intelligence.

Thursday January 24, 2019 11:05am - 11:25am
Grand Ballroom Hyatt Regency San Francisco, 5 Embarcadero Center, San Francisco, CA 94111, USA


Go-Explore: A New Type of Algorithm for Hard-exploration Problems
A grand challenge in reinforcement learning is producing intelligent exploration, especially when rewards are sparse or deceptive. I will present Go-Explore, a new algorithm for such ‘hard exploration problems.’ Go-Explore dramatically improves the state of the art on benchmark hard-exploration problems, enabling previously unsolvable problems to be solved. I will explain the algorithm and the new research directions it opens up. I will also explain why we believe it will enable progress on previously unsolvable hard-exploration problems in a variety of domains, especially the many that harness a simulator during training (e.g. robotics). More information can be found at https://eng.uber.com/go-explore

avatar for Jeff Clune, Uber AI Labs

Jeff Clune, Uber AI Labs

Senior Research Scientist & Founding Member, Uber AI Labs
Jeff Clune is the Loy and Edith Harris Associate Professor in Computer Science at the University of Wyoming and a Senior Research Scientist and founding member of Uber AI Labs. He focuses on robotics, reinforcement learning, and training neural networks either via deep learning or... Read More →

Thursday January 24, 2019 11:25am - 11:45am
Grand Ballroom Hyatt Regency San Francisco, 5 Embarcadero Center, San Francisco, CA 94111, USA


Deep Learning for Robotics and Robotics for Deep Learning
Large-scale, data-driven techniques for robotic learning have imbued robots with unprecedented capabilities in recent years. However, a long-standing challenge for goal-directed learning on robots is the problem of supervision: how do we know if the robot actually achieved some goal, such as picking up the correct object? I present recent work in which we use robotic interaction to provide free supervision signals for deep representation learning, and reuse those very same representations to learn instance grasping. This synergy leads to interpretable visual representation learning and useful grasping skills, freeing us from ever having to label any data.

avatar for Eric Jang, Google Brain Robotics

Eric Jang, Google Brain Robotics

Research Engineer , Google Brain Robotics
Eric is a research engineer on the Google Brain team, working on robotic grasping and manipulation. He is interested in meta-learning for robotics, deep generative models, and Artificial Life. He received his M.Sc. in CS and Bachelors in Math/CS at Brown University in 2016.

Thursday January 24, 2019 11:45am - 12:05pm
Grand Ballroom Hyatt Regency San Francisco, 5 Embarcadero Center, San Francisco, CA 94111, USA


Recent Advances From OpenAI
avatar for Ilya Sutskever, OpenAI

Ilya Sutskever, OpenAI

Co-Founder & Chief Scientist, OpenAI
Ilya Sutskever received his PhD in 2012 from the University of Toronto working with Geoffrey Hinton. After completing his PhD, he cofounded DNNResearch with Geoffrey Hinton and Alex Krizhevsky which was acquired by Google. He is interested in all aspects of neural networks and their... Read More →

Thursday January 24, 2019 12:05pm - 12:30pm
Grand Ballroom Hyatt Regency San Francisco, 5 Embarcadero Center, San Francisco, CA 94111, USA