TILOS Seminar Series

Events Search and Views Navigation

Event Views Navigation

Today

  • TILOS Seminar: Optimal Quantization for LLMs and Matrix Multiplication

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Yury Polyanskiy, MIT Abstract: The main building block of large language models is matrix multiplication, which is often bottlenecked by the speed of loading these matrices from memory. A number of recent quantization algorithms (SmoothQuant, GPTQ, QuIP, SpinQuant etc) address this issue by storing matrices in lower precision. We derive optimal asymptotic information-theoretic tradeoff between […]

  • TILOS-HDSI Seminar with Adam Klivans (UT Austin): A New Paradigm for Learning with Distribution Shift

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Adam Klivans, The University of Texas at Austin Abstract: We revisit the fundamental problem of learning with distribution shift, where a learner is given labeled samples from training distribution D, unlabeled samples from test distribution D′ and is asked to output a classifier with low test error. The standard approach in this setting is to […]

  • Optimization for ML and AI Seminar with Courtney Paquette (McGill University): High-dimensional Optimization with Applications to Compute-Optimal Neural Scaling Laws

    CSE 1242 and Virtual 3235 Voigt Dr, La Jolla, CA, United States

    Courtney Paquette, McGill University Abstract: Given the massive scale of modern ML models, we now only get a single shot to train them effectively. This restricts our ability to test multiple architectures and hyper-parameter configurations. Instead, we need to understand how these models scale, allowing us to experiment with smaller problems and then apply those […]

  • TILOS-SDSU Seminar with Jeremy Schwartz (Zoox)

    SDSU and Virtual

    Title and abstract TBA... Jeremy Schwartz is a robotics engineer at Zoox with expertise in a wide variety of areas of mechanical and electrical engineering and computer science. His primary professional expertise is in autonomy and behavioral algorithms, and he has worked in the aerospace industry as well as ground robotics, specializing in autonomous systems […]

  • Optimization for AI and ML Seminar with Volkan Cevher (EPFL)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Volkan Cevher received the B.Sc. (valedictorian) in electrical engineering from Bilkent University in Ankara, Turkey, in 1999 and the Ph.D. in electrical and computer engineering from the Georgia Institute of Technology in Atlanta, GA in 2005. He was a Research Scientist with the University of Maryland, College Park from 2006-2007 and […]

  • Optimization for ML and AI Seminar with Frank E. Curtis (Lehigh University)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Frank E. Curtis is a Professor in the Department of Industrial and Systems Engineering at Lehigh University, where he has been employed since 2009. He received a bachelor’s degree from the College of William and Mary in 2003 with a double major in Computer Science and Mathematics, received a master’s degree […]

  • TILOS-HDSI Seminar with Yi Wu (Tsinghua University)

    CSE 4140 and Virtual 9500 Gilman Dr, La Jolla, CA, United States

    Title and abstract TBA... Yi Wu is an Assistant Professor at Tsinghua University's Institute for Interdisciplinary Information Sciences (IIIS). He received his Ph.D. from the University of California, Berkeley, advised by Professor Stuart Russell. Before joining IIIS, Dr. Wu was a researcher at OpenAI. His research interest include deep reinforcement learning, multi-agent learning, natural language […]

  • Optimization for ML and AI Seminar with Joel Tropp (Caltech)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Joel A. Tropp is Steele Family Professor of Applied & Computational Mathematics at the California Institute of Technology. His research centers on applied mathematics, machine learning, data science, numerical algorithms, and random matrix theory. Some of his best-known contributions include matching pursuit algorithms, randomized SVD algorithms, matrix concentration inequalities, and statistical phase transitions. Prof. Tropp attained the […]

  • Optimization for ML and AI Seminar with Tengyu Ma (Stanford)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Tengyu Ma is an assistant professor of computer science at Stanford University. His research interests broadly include topics in machine learning, algorithms and their theory, such as deep learning, (deep) reinforcement learning, pre-training / foundation models, robustness, non-convex optimization, distributed optimization, and high-dimensional statistics. Zoom: https://bit.ly/Opt-AI-ML

  • Optimization for ML and AI Seminar with Yang Zheng (UC San Diego)

    HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United States

    Title and abstract TBA... Yang Zheng is an Assistant Professor in Electrical and Computer Engineering at UC San Diego, and is affiliated with the department of Computer Science and Engineering and the Contextual Robotics Institute. From March 2019 to August 2020, Dr. Zheng was a postdoctoral scholar in SEAS and CGBC at Harvard University, working […]