TILOS Seminar: The Dissimilarity Dimension: Sharper Bounds for Optimistic Algorithms

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Aldo Pacchiano, Assistant Professor, Boston University Center for Computing and Data Sciences Abstract: The principle of Optimism in the Face of Uncertainty (OFU) is one of the foundational algorithmic design choices in Reinforcement Learning and Bandits. Optimistic algorithms balance exploration and exploitation by deploying data collection strategies that maximize expected rewards in plausible models. This […]

TILOS-HDSI Distinguished Colloquium: The Synergy between Machine Learning and the Natural Sciences

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Max Welling, Research Chair in Machine Learning, University of Amsterdam Abstract: Traditionally machine learning has been heavily influenced by neuroscience (hence the name artificial neural networks) and physics (e.g. MCMC, Belief Propagation, and Diffusion based Generative AI). We have recently witnessed that the flow of information has also reversed, with new tools developed in the […]

AI Ethics in Research Webinar

Virtual

Please join Dr. Nisheeth Vishnoi from Yale and Dr. David Danks from UC San Diego who will discuss their Research in AI Ethics. Professor Danks develops practical frameworks and methods to incorporate ethical and policy considerations throughout the AI lifecycle, including different ways to include them in optimization steps. Bias and fairness have been a […]

TILOS Seminar: How Large Models of Language and Vision Help Agents to Learn to Behave

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Roy Fox, Assistant Professor and Director of the Intelligent Dynamics Lab, UC Irvine Abstract: If learning from data is valuable, can learning from big data be very valuable? So far, it has been so in vision and language, for which foundation models can be trained on web-scale data to support a plethora of downstream tasks; […]

TILOS Seminar: Transformers learn in-context by (functional) gradient descent

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Xiang Cheng, TILOS Postdoctoral Scholar, MIT Abstract: Motivated by the in-context learning phenomenon, we investigate how the Transformer neural network can implement learning algorithms in its forward pass. We show that a linear Transformer naturally learns to implement gradient descent, which enables it to learn linear functions in-context. More generally, we show that a non-linear […]

TILOS Seminar: Large Datasets and Models for Robots in the Real World

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Nicklas Hansen, UC San Diego Abstract: Recent progress in AI can be attributed to the emergence of large models trained on large datasets. However, teaching AI agents to reliably interact with our physical world has proven challenging, which is in part due to a lack of large and sufficiently diverse robot datasets. In this talk, […]

TILOS Seminar: What Kinds of Functions do Neural Networks Learn? Theory and Practical Applications

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Robert Nowak, University of Wisconsin Abstract: This talk presents a theory characterizing the types of functions neural networks learn from data. Specifically, the function space generated by deep ReLU networks consists of compositions of functions from the Banach space of second-order bounded variation in the Radon transform domain. This Banach space includes functions with smooth […]

TILOS-SDSU Seminar: AI/ML & NLP for UAS/Air Traffic Management

San Diego State University 5500 Campanile Dr, San Diego, United States

Krishna Kalyanam, NASA Ames Research Center Abstract: We introduce several Air Traffic Management (ATM) initiatives envisioned by NASA and FAA for a future airspace that combines conventional traffic and new entrants (e.g., drones) without sacrificing safety. In this framework, we demonstrate the use of state-of-the-art AI/ML modeling and prediction tools that will enable efficient and […]

TILOS Seminar: Data Models for Deep Learning: Beyond i.i.d. Assumptions

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Elchanan Mossel, Professor of Mathematics, MIT Abstract: Classical Machine Learning theory is largely built upon the assumption that data samples are independent and identically distributed (i.i.d.) from general distribution families. In this talk, I will present novel insights that emerge when we move beyond these traditional assumptions, exploring both dependent sampling scenarios and structured generative […]

TILOS Seminar: Off-the-shelf Algorithmic Stability

HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

Rebecca Willett, University of Chicago Abstract: Algorithmic stability holds when our conclusions, estimates, fitted models, predictions, or decisions are insensitive to small changes to the training data. Stability has emerged as a core principle for reliable data science, providing insights into generalization, cross-validation, uncertainty quantification, and more. Whereas prior literature has developed mathematical tools for […]