TILOS logo
  • TILOS Home
  • Team
    • Faculty & Leadership
    • Postdoctoral Scholars
    • Students
    • Industry Liaisons
    • Advisory Board
    • Alumni
  • Ethics
  • Research
    • Publications
    • Foundations
    • Chip Design
    • Robotics
    • Networks
    • All TILOS Projects
  • News
    • TILOS in the News
    • Latest Newsletter
    • Past Newsletters
      • Winter 2026
      • Fall 2025
      • Summer 2025
      • March + April 2025
      • January + February 2025
      • November + December 2024
      • September + October 2024
      • July + August 2024
      • May + June 2024
      • March + April 2024
      • January + February 2024
  • Seminars & Events
    • Seminar Series
    • All Upcoming Events
    • Past Events
    • Recorded Talks
  • Educational Resources
    • Courses & Tutorials
    • K-12 Educational Activities
    • Lab 3.0 at UC San Diego
    • Video Interviews
    • Recorded Talks
    • TILOS YouTube Channel
    • Software & Datasets
      • Machine Learning & Hyperdimensional Computing
      • Robotics & Autonomous Systems
      • VLSI Design & Hardware Optimization
      • Datasets
    • University & Professional
  • Industry & Partnership
    • Industrial Partner Program
    • Visitor Programs
    • ExpandAI@SD
  • Contact
  • TILOS Home
  • Team
    •         - Faculty & Leadership
    •         - Postdoctoral Scholars
    •         - Students
    •         - Industry Liaisons
    •         - Advisory Board
    •         - Alumni
  • Ethics
  • Research
    •         - Publications
    •         - Foundations
    •         - Chip Design
    •         - Robotics
    •         - Networks
    •         - All TILOS Projects
  • News
    •         - TILOS in the News
    •         - Latest Newsletter
    •         - Past Newsletters
      •                 - Winter 2026
      •                 - Fall 2025
      •                 - Summer 2025
      •                 - March + April 2025
      •                 - January + February 2025
      •                 - November + December 2024
      •                 - September + October 2024
      •                 - July + August 2024
      •                 - May + June 2024
      •                 - March + April 2024
      •                 - January + February 2024
  • Seminars & Events
    •         - Seminar Series
    •         - All Upcoming Events
    •         - Past Events
    •         - Recorded Talks
  • Educational Resources
    •         - Courses & Tutorials
    •         - K-12 Educational Activities
    •         - Lab 3.0 at UC San Diego
    •         - Video Interviews
    •         - Recorded Talks
    •         - TILOS YouTube Channel
    •         - Software & Datasets
      •                 - Machine Learning & Hyperdimensional Computing
      •                 - Robotics & Autonomous Systems
      •                 - VLSI Design & Hardware Optimization
      •                 - Datasets
    •         - University & Professional
  • Industry & Partnership
    •         - Industrial Partner Program
    •         - Visitor Programs
    •         - ExpandAI@SD
  • Contact
Published 30 January 2025 at 838 × 631 in How Transformers Learn Causal Structure with Gradient Descent

Previous
Next
NSF UC San Diego Yale Texas Penn MIT National
OUR SISTER NSF AI INSTITUTES

This project is supported by the U.S. National Science Foundation under CCF-2112665. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the U.S. National Science Foundation.

UC San Diego 9500 Gilman Dr. La Jolla, CA 92093 (858) 534-2230
Copyright © 2025 Regents of the University of California. All rights reserved.
Accessibility | Privacy Policy | Terms of Use | Feedback