ABSTRACT: Artificial Intelligence is being increasingly relied on in safety-critical domains. But the predictive models underlying these systems are notoriously brittle, and trustworthy deployment remains a significant challenge. In this talk, I give an overview of my work towards a rigorous foundation for robust machine learning (ML). Using a case study of invariant prediction, we […]

ABSTRACT: "Trustworthy Machine Learning" has become a buzz-word in recent years. But what exactly are the semantics of the promise that we are supposed to trust? In this talk we will make a proposal, through the lens of downstream decision makers using machine learning predictions of payoff relevant states: Predictions are "Trustworthy" if it is in the interests of the downstream decision […]

ABSTRACT:  The rapid progress made over the last few years in generating linguistically coherent natural language has blurred, in the mind of many, the difference between natural language generation, understanding, and the ability to reason with respect to the world. Nevertheless, robust support of high-level decisions that depend on natural language understanding, and one that […]

ABSTRACT: Language models work well, but they are far from trustworthy. Major open questions remain on high-stakes issues such as detecting benchmark contamination, identifying LM-generated text, and reliably generating factually correct outputs. Addressing these challenges will require us to build more precise, reliable algorithms and evaluations that provide guarantees that we can trust. Despite the […]