Spin Glass Language Model

This picture is not exact.

Brain simulate spin glass.


Physics can explain GPT.

1. Mechanistic Interpretability

2. Modern Hopfield Network

3. Positional Embedding and RKKY

4. Spin Glass and Linguistics

5. LLM without training