BEGIN:VCALENDAR
VERSION:2.0
PRODID:-// - ECPv6.15.18//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://tilos.ai
X-WR-CALDESC:Events for 
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20250309T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20251102T090000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20260308T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20261101T090000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20270314T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20271107T090000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20260327T100000
DTEND;TZID=America/Los_Angeles:20260327T110000
DTSTAMP:20260404T005702
CREATED:20260317T231250Z
LAST-MODIFIED:20260331T142721Z
UID:8222-1774605600-1774609200@tilos.ai
SUMMARY:TILOS-Optimization for ML and AI Seminar: Implicit bias results for Muon\, Adam\, and Friends
DESCRIPTION:Matus Telgarsky\, New York University \nAbstract: This talk will give both an empirical overview and a few simple bonds controlling the optimization path\, or implicit bias\, of modern optimization methods such as Adam and Muon (and Friends). The talk will begin with empirical results demonstrating the implicit bias phenomenon with shallow networks and also transformers combined with chain-of-thought. The talk will then briefly survey a few mathematical implicit bias analyses of nonlinear networks\, which unfortunately do not carry through to transformers. As such\, the talk concludes with a technical portion presenting another approach to analyzing these optimization methods in the linear case\, providing generic implicit bias results for them\, and empirically demonstrating hope that this particular methodology can carry over to the nonlinear case. \n\nMatus Telgarsky is an Associate Professor of Computer Science at the Courant Institute of Math at NYU\, specializing in deep learning theory. The highlight of his academic career was completing a PhD under Sanjoy Dasgupta at UC San Diego. Adventures since then include co-chairing the Midwest ML Symposium in 2017 with Po-Ling Loh\, and chairing two semester-long Simons Institute Programs at UC Berkeley. Accolades include a 2018 NSF Career Award and delivering a COLT 2025 keynote.
URL:https://tilos.ai/event/tilos-optimization-for-ml-and-ai-seminar-implicit-bias-results-for-muon-adam-and-friends/
LOCATION:HDSI 123 and Virtual\, 3234 Matthews Ln\, La Jolla\, CA\, 92093\, United States
CATEGORIES:TILOS Seminar Series,TILOS Sponsored Event
ATTACH;FMTTYPE=image/jpeg:https://tilos.ai/wp-content/uploads/2026/03/telgarsky-matus-e1773789078482.jpg
END:VEVENT
END:VCALENDAR