TILOS-HDSI Seminar: Kinetic Theory Perspective of Foundation Models for Physics
HDSI 123 and Virtual 3234 Matthews Ln, La Jolla, CA, United StatesMaarten de Hoop, Rice University Abstract: We present a kinetic theory perspective of foundation models for physics. We begin with providing a mathematical framework for analyzing transformers. To uniformly address their expressivity, we consider the case that the mappings are conditioned on a context represented by a probability distribution of tokens. That is, transformers become […]
