Wittgenstein and LLMs
Heat trend
The percentage is based on available heat signal, not comment count or independent people.
A Reddit user inquired about the connection between Wittgenstein's concept of "language-games" from *Philosophical Investigations* and the development of Large Language Models (LLMs). They noted that this concept, which posits that language meaning is derived from contextual "rules of the game" rather than abstract meaning, is rumored to have influenced LLM training. The user sought clarification on whether this influence was intentional or an emergent outcome of the training process.
Sorry if this is the wrong sub. I may crosspost to Ask Philosophy. I just have heard that Wittgenstein's concept of language-games - the meaning of language is based on "rules of the game," so the context of language, not abstract meaning - from Philosophical Investigations has informed the development and training of LLMs. I'm not sure if this was intentional or simply an outcome of the training.
Is anyone here familiar with this link or involved with the training of LLM that uses this concept?