TILOS Seminar Series

Events Search and Views Navigation

Event Views Navigation

Today

  • TILOS Seminar: Synthetic Tasks as Testbeds for Attributing Model Behavior

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Surbhi Goel, University of Pennsylvania Abstract: Understanding how different components of the machine learning pipeline—spanning data composition, architectural choices, and optimization dynamics—shape model behavior remains a fundamental challenge. In this talk, I will argue that synthetic tasks, which enable precise control over data distribution and task complexity, serve as powerful testbeds for analyzing and attributing […]

  • TILOS Seminar: Single location regression and attention-based models

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Claire Boyer, Université Paris-Saclay Abstract: Attention-based models, such as Transformer, excel across various tasks but lack a comprehensive theoretical understanding, especially regarding token-wise sparsity and internal linear representations. To address this gap, we introduce the single-location regression task, where only one token in a sequence determines the output, and its position is a latent random […]

  • TILOS Seminar: Foundational Methods for Foundation Models for Scientific Machine Learning

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Michael W. Mahoney, ICSI, LBNL, and Department of Statistics, UC Berkeley Abstract: The remarkable successes of ChatGPT in natural language processing (NLP) and related developments in computer vision (CV) motivate the question of what foundation models would look like and what new advances they would enable, when built on the rich, diverse, multimodal data that […]

  • TILOS Seminar: Amplifying human performance in combinatorial competitive programming

    Virtual

    Petar Veličković, Google DeepMind Abstract: Recent years have seen a significant surge in complex AI systems for competitive programming, capable of performing at admirable levels against human competitors. While steady progress has been made, the highest percentiles still remain out of reach for these methods on standard competition platforms such as Codeforces. In this talk, […]

  • TILOS Seminar: Optimal Quantization for LLMs and Matrix Multiplication

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Yury Polyanskiy, MIT Abstract: The main building block of large language models is matrix multiplication, which is often bottlenecked by the speed of loading these matrices from memory. A number of recent quantization algorithms (SmoothQuant, GPTQ, QuIP, SpinQuant etc) address this issue by storing matrices in lower precision. We derive optimal asymptotic information-theoretic tradeoff between […]

  • TILOS-HDSI Seminar with Adam Klivans (UT Austin): A New Paradigm for Learning with Distribution Shift

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Adam Klivans, The University of Texas at Austin Abstract: We revisit the fundamental problem of learning with distribution shift, where a learner is given labeled samples from training distribution D, unlabeled samples from test distribution D′ and is asked to output a classifier with low test error. The standard approach in this setting is to […]

  • Optimization for ML and AI Seminar with Courtney Paquette (McGill University): High-dimensional Optimization with Applications to Compute-Optimal Neural Scaling Laws

    CSE 1242 and Virtual 3235 Voigt Dr, La Jolla, CA, United States

    Courtney Paquette, McGill University Abstract: Given the massive scale of modern ML models, we now only get a single shot to train them effectively. This restricts our ability to test multiple architectures and hyper-parameter configurations. Instead, we need to understand how these models scale, allowing us to experiment with smaller problems and then apply those […]

  • TILOS-SDSU Seminar with Jeremy Schwartz (Zoox)

    SDSU and Virtual

    Title and abstract TBA... Jeremy Schwartz is a robotics engineer at Zoox with expertise in a wide variety of areas of mechanical and electrical engineering and computer science. His primary professional expertise is in autonomy and behavioral algorithms, and he has worked in the aerospace industry as well as ground robotics, specializing in autonomous systems […]

  • Optimization for AI and ML Seminar with Volkan Cevher (EPFL)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Volkan Cevher received the B.Sc. (valedictorian) in electrical engineering from Bilkent University in Ankara, Turkey, in 1999 and the Ph.D. in electrical and computer engineering from the Georgia Institute of Technology in Atlanta, GA in 2005. He was a Research Scientist with the University of Maryland, College Park from 2006-2007 and […]

  • Optimization for ML and AI Seminar with Frank E. Curtis (Lehigh University)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Frank E. Curtis is a Professor in the Department of Industrial and Systems Engineering at Lehigh University, where he has been employed since 2009. He received a bachelor’s degree from the College of William and Mary in 2003 with a double major in Computer Science and Mathematics, received a master’s degree […]