- This event has passed.
Fall 2022 GRASP SFI: Srinath Sridhar, Brown University, “Learning to Generate, Edit, and Arrange 3D Shapes”
October 19, 2022 at 3:00 PM - 4:00 PM
This is a hybrid event with in-person attendance in Levine 307 and virtual attendance via Zoom.
ABSTRACT
In computer vision and robotics, we often need to deal with 3D objects. For instance, we may want to generate instances of 3D chairs, edit the generated chairs using natural language instructions, or arrange them in a canonical orientation. In this talk, I will present some of our work on addressing these problems. First, I will talk about ShapeCrafter, a model for recursively generating and modifying 3D shapes using natural language descriptions. ShapeCrafter generates a 3D shape distribution that gradually evolves as more phrases are added resulting in shapes closer to text instructions. In addition, I will introduce the notions of invariance, equivariance, and ‘canonicalization’, and discuss their importance in 3D understanding. I will describe ConDor, a self-supervised method for canonicalizing the orientation of full and partial 3D shapes. Finally, I will identify future directions including opportunities for expanding 3D understanding to neural fields, articulating objects, and object collections.
Srinath Sridhar
Brown University
Srinath Sridhar is an assistant professor of computer science at Brown University. He received his PhD at the Max Planck Institute for Informatics and was subsequently a postdoctoral researcher at Stanford. His research interests are in 3D computer vision and machine learning. Specifically, his group focuses on visual understanding of 3D human physical interactions with applications ranging from robotics to mixed reality. He is a recipient of the NSF CAREER award, Google Research Scholar award, and his work received the Eurographics Best Paper Honorable Mention. He has previously spent time at Microsoft Research Redmond, and Honda Research Institute.