The UC San Diego HDSI-TILOS “LLM Meets Theory” Workshop aims to bring together students and faculty to discuss the future of mathematical and scientific theory and large language models (LLMs). LLMs are like a miracle—not one that breaks the laws of nature (that would be impossible, of course), but something that defied all expectations and […]
TILOS (The NSF National AI Institute for Learning-enabled Optimization at Scale) will hold its 3rd Annual Industry Day on June 18, 2024, at the Halıcıoğlu Data Science Institute at UC San Diego, which is the campus hub for Data Science. Our first two Industry Days have attracted more than 100 participants, each featuring (1) talks from invited Industry […]
Adam Tauman Kalai, OpenAI Abstract: Pretrained language models (LMs) tend to preserve many qualities present in their training data, such as grammaticality, formatting, and politeness. However, for specific types of factuality, even LMs pretrained on factually correct statements tend to produce falsehoods at high rates. We explain these “hallucinations” by drawing a connection to binary […]
