The Emergent Symbolic Structure of Artificial Neural Networks
热度趋势
趋势数据积累中
百分比基于当前可用热度信号，而非评论数或独立用户人数。
- 判定依据
- 热度约为该来源近期上榜条目中位水平的 3.7 倍
- 指标对比
- 179 vs 中位 48.5（20 条基线样本）
- 检出时间
- 09/02 10:01
一篇题为“人工神经网络的涌现符号结构”的新研究论文已在arXiv.org上发布。该文档的标识符为arXiv:2608.29530v1，共30页正文，另附29页参考文献和附录。该研究属于计算与语言（cs.CL）以及人工智能（cs.AI）领域。该论文由Tom McCoy于2026年8月30日03:32:13 UTC提交。
View PDF HTML (experimental)
Abstract: Modern systems in artificial intelligence (AI) somehow excel in domains for which they seem poorly suited. Intelligence has traditionally been modeled as operating over structured combinations of symbols, such as logical formulas. However, the strongest modern AI systems are based on neural networks, which instead represent information in continuous vectors. Vectors seem inadequate for capturing the structure of language, logic, and other cognitive domains, yet neural networks achieve impressive performance in these areas. How do they do it? In this work, we propose a potential answer: Despite appearances, perhaps the internal representations of neural networks implicitly realize symbolic structure. In support of this hypothesis, we show that the vector representations of a variety of neural networks can be closely approximated with symbolic structures: we can replace the network's entire representation-generating process with a closed-form equation instantiating a symbolic structure, and the network's behavior remains largely unchanged. This finding holds for both small-scale neural networks trained to manipulate lists as well as large language models (LLMs) operating in four domains that are central in symbolic traditions: arithmetic, logic, computer code, and language. Further, our symbolic approximation allows us to modify an LLM's behavior in targeted ways via precise interventions on its internal representations, showing that the LLM's behavior is reliant on the symbolic structures we have identified. This work provides a potential way to reconcile longstanding symbolic conceptions of intelligence with the vector-based nature of modern AI.
Comments: 30 pages, plus 29 pages of references and appendices
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as: arXiv:2608.29530 [cs.CL]
(or arXiv:2608.29530v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.29530
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Tom McCoy [view email] [v1] Sun, 30 Aug 2026 03:32:13 UTC (1,107 KB)