TILOS (The NSF National AI Institute for Learning-enabled Optimization at Scale) will hold its 3rd Annual Industry Day on June 18, 2024, at the Halıcıoğlu Data Science Institute at UC San Diego, which is the campus hub for Data Science. Our first two Industry Days have attracted more than 100 participants, each featuring (1) talks from invited Industry […]
Robert Nowak, University of Wisconsin Abstract: This talk presents a theory characterizing the types of functions neural networks learn from data. Specifically, the function space generated by deep ReLU networks consists of compositions of functions from the Banach space of second-order bounded variation in the Radon transform domain. This Banach space includes functions with smooth […]
Krishna Kalyanam, NASA Ames Research Center Abstract: We introduce several Air Traffic Management (ATM) initiatives envisioned by NASA and FAA for a future airspace that combines conventional traffic and new entrants (e.g., drones) without sacrificing safety. In this framework, we demonstrate the use of state-of-the-art AI/ML modeling and prediction tools that will enable efficient and […]
Elchanan Mossel, Professor of Mathematics, MIT Abstract: Classical Machine Learning theory is largely built upon the assumption that data samples are independent and identically distributed (i.i.d.) from general distribution families. In this talk, I will present novel insights that emerge when we move beyond these traditional assumptions, exploring both dependent sampling scenarios and structured generative […]
Rebecca Willett, University of Chicago Abstract: Algorithmic stability holds when our conclusions, estimates, fitted models, predictions, or decisions are insensitive to small changes to the training data. Stability has emerged as a core principle for reliable data science, providing insights into generalization, cross-validation, uncertainty quantification, and more. Whereas prior literature has developed mathematical tools for […]
Jason Lee, Princeton University Abstract: The incredible success of transformers on sequence modeling tasks can be largely attributed to the self-attention mechanism, which allows information to be transferred between different parts of a sequence. Self-attention allows transformers to encode causal structure which makes them particularly suitable for sequence modeling. However, the process by which transformers […]
Adam Tauman Kalai, OpenAI Abstract: Pretrained language models (LMs) tend to preserve many qualities present in their training data, such as grammaticality, formatting, and politeness. However, for specific types of factuality, even LMs pretrained on factually correct statements tend to produce falsehoods at high rates. We explain these “hallucinations” by drawing a connection to binary […]
Rajesh Rajamani, University of Minnesota Abstract: This talk presents some interesting problems in estimation related to vehicle autonomy. First, a teleoperation application in which a remote operator can intervene to control an autonomous vehicle is considered. Fundamental challenges here include the need to design an effective teleoperation station, bandwidth and time-criticality constraints in wireless communication, […]
