Loading Events

« All Events

  • This event has passed.

Spring 2023 GRASP on Robotics: Jeannette Bohg, Stanford University, “Scaling Robot Learning for Long-Horizon Manipulation Tasks with Language, Logic and Youtube”

March 3, 2023 at 10:30 AM - 11:45 AM

This is a hybrid event with in-person attendance in Wu and Chen and virtual attendance via Zoom. This week’s presenter will be in-person as well. 

 

ABSTRACT

My long-term research goal is enable real robots to manipulate any kind of object such that they can perform many different tasks in a wide variety of application scenarios such as in our homes, in hospitals, warehouses, or factories. Many of these tasks will require long-horizon reasoning and sequencing of skills to achieve a goal state. While learning approaches promise generalization beyond what the robot has seen during training, they require large data collection – a challenge when operating on real robots and specifically for long-horizon tasks. In this talk, I will present our work on enabling long-horizon reasoning on real robots for a variety of different long-horizon tasks that can be solved by sequencing a large variety of composable skill primitives. We approach this problem from many different angles such as (i) using large-scale, language-annotated video datasets as a cheap data source for skill learning; (ii) sequencing these learned skill primitives to resolve geometric dependencies prevalent in long-horizon tasks; (iii) learning grounded predicates thereby enabling closed-loop, symbolic task planning.

Jeannette Bohg

Stanford University

Jeannette Bohg is an Assistant Professor of Computer Science at Stanford University. She was a group leader at the Autonomous Motion Department (AMD) of the MPI for Intelligent Systems until September 2017. Before joining AMD in January 2012, Jeannette Bohg was a PhD student at the Division of Robotics, Perception and Learning (RPL) at KTH in Stockholm. In her thesis, she proposed novel methods towards multi-modal scene understanding for robotic grasping. She also studied at Chalmers in Gothenburg and at the Technical University in Dresden where she received her Master in Art and Technology and her Diploma in Computer Science, respectively. Her research focuses on perception and learning for autonomous robotic manipulation and grasping. She is specifically interested in developing methods that are goal-directed, real-time and multi-modal such that they can provide meaningful feedback for execution and learning. Jeannette Bohg has received several Early Career and Best Paper awards, most notably the 2019 IEEE Robotics and Automation Society Early Career Award and the 2020 Robotics: Science and Systems Early Career Award.

Details

Date:
March 3, 2023
Time:
10:30 AM - 11:45 AM
Event Category:
Website:
https://www.grasp.upenn.edu/events/spring-2023-grasp-on-robotics-jeannette-bohg/

Organizer

General Robotics, Automation, Sensing and Perception (GRASP) Lab
Email
grasplab@seas.upenn.edu
View Organizer Website

Venue

Wu and Chen Auditorium (Room 101), Levine Hall
3330 Walnut Street
Philadelphia, PA 19104 United States
+ Google Map
View Venue Website