This is a fascinating topic! Wittgenstein’s warning about the limitations of language and meaning aligns well with the current challenges faced by large language models (LLMs). While LLMs can generate text that seems meaningful, they lack true understanding of context, intent, or the subtleties of human experience. Wittgenstein argued that meaning is rooted in the use of language in specific contexts, something LLMs struggle with due to their reliance on patterns rather than lived experience.
Chomsky’s challenge, especially his critique of the “input-output” approach to language, is also highly relevant. LLMs may mimic linguistic structures without grasping the deep rules or cognitive processes that underpin human language. The idea that language is more than just statistical patterns in data raises questions about whether LLMs can ever truly replicate human cognition or whether they are simply simulating it at a surface level.
This philosophical lens highlights the fundamental gap between simulation and understanding. As powerful as LLMs are, they may never bridge that gap without a deeper integration of semantics and consciousness that goes beyond current AI capabilities.