Large Language Models (LLMs) have brought remarkable advancements to the computing industry. However, a high barrier exists between the LLMs and the vast majority of researchers and practitioners, brought by the engineering challenges with the enormous model sizes and the substantial compute requirements. In this talk, I’ll discuss my research on system innovations to democratize […]

The potential of data to transform science and society has spurred unparalleled efforts to collect it in increasingly sensitive and granular forms, which has raised a variety of societal concerns about how this data is handled and used. Though today, at-rest and in-transit encryption are standard practices, these alone are insufficient to address the security […]

ABSTRACT: Flow matching models learn a (possibly stochastic) mapping between source and target distributions. Common paradigms include diffusion models, score matching models, and continuous normalizing flows. In this talk I will first present methods for improved training of flow matching models using ideas from optimal transport. I will then show how these improved methods can […]