Loading Events

« All Events

  • This event has passed.

ASSET Seminar: Learning with Small Data, Pratik Chaudhari (University of Pennsylvania)

October 5, 2022 at 12:00 PM - 1:30 PM

The relevant limit for machine learning is not N → infinity but instead N → 0. The human visual system is proof that it is possible to learn categories with extremely few samples. This talk will discuss steps towards building such systems and it is structured in three parts. The first part will discuss algorithms to adapt representations of deep networks to new categories with few labeled data. The second part will discuss when such adaptation works well and when it does not. It will develop a method to compute the optimal distance between two learning tasks and algorithmic tools to learn tasks that are far away from each other. The third part will discuss how make the optimal use of unlabeled data to learn a task.

This talk will discuss results from the following papers.
1. An Information-Geometric Distance on the Space of Tasks. Yansong
Gao, Pratik Chaudhari. ICML 2021.
Paper: https://arxiv.org/abs/2011.00613, Code: https://github.com/Yansongga/An-Information-Geometric-Distance-on-the-Space-of-Tasks
2. Model Zoo: A Growing “Brain” That Learns Continually. Rahul
Ramesh, Pratik Chaudhari. ICLR 22.
Paper: https://arxiv.org/abs/2106.03027. Code:
3. Deep Reference Priors: What is the best way to pretrain a model?. Yansong Gao, Rahul Ramesh, and Pratik Chaudhari. ICML 22.
Paper: https://arxiv.org/abs/2202.00187, Code: https://github.com/grasp-lyrl/deep_reference_priors

Pratik Chaudhari is an Assistant Professor in Electrical and Systems Engineering and Computer and Information Science at the University of Pennsylvania. He is a member of the GRASP Laboratory. From 2018–19, he was a Senior Applied Scientist at Amazon Web Services and a Postdoctoral Scholar in Computing and Mathematical Sciences at Caltech. Pratik received his PhD (2018) in Computer Science from UCLA, his Master’s (2012) and Engineer’s (2014) degrees in Aeronautics and Astronautics from MIT and his Bachelor’s degree (2010) from IIT Bombay. He was a part of NuTonomy Inc. (now Aptiv) from 2014–16. He received the NSF CAREER award and the Intel Rising Star faculty award in 2022.


October 5, 2022
12:00 PM - 1:30 PM
Event Category:
Event Tags:


Computer and Information Science
View Organizer Website


Levine 307
3330 Walnut Street
Philadelphia, PA 19104 United States
+ Google Map