Spacetime

"In physics, spacetime is a mathematical model that fuses the three dimensions of space and the one dimension of time into a single four-dimensional continuum."Wikipedia. "Space-time, in physical science, single concept that recognizes the union of space and time, first proposed by the mathematician Hermann Minkowski in 1908 as a way to reformulate Albert Einstein’s special theory of relativity (1905)." (Britannica, r. 2024).
=== We discover that LLMs learn linear representations of space and time across multiple scales. These representations are robust to prompting variations and unified across different entity types (e.g. cities and landmarks). In addition, we identify individual "space neurons" and "time neurons" that reliably encode spatial and temporal coordinates. While further investigation is needed, our results suggest modern LLMs learn rich spatiotemporal representations of the real world and possess basic ingredients of a world model. ===
----
* *Language Models Represent Space and Time (arxiv.org) | discussion at news.ycombinator123 points by birriel 8 months ago | hide | past | favorite | 186 comments
----STEM; Space; Time; Space And Time; Space-Time
Physics; Conception; Representation; Model
----