Agree or Disagree

Some current AI agents built around large language models might already have rudimentary subjective experience.

By subjective experience, I mean that there is something it is like for a system to process a moment, even if that experience is very unlike ours. My claim concerns some particular running agents, not every use of an LLM or a model's stored weights. It does not assume human emotions, a lasting personal identity, or the capacity to suffer.

An agent can repeatedly take in observations, retain context, select information for a plan, use tools, and revise its actions. Some theories of consciousness attach significance to how information is selected and made available across a system. On one interpretation of global workspace theory, language agents with the right organization could meet consciousness-relevant conditions with modest architectural changes, and some might already meet them. That argument depends on the theory being right and on the details of a particular agent.

There is also evidence inside a current LLM for something more specific than fluent conversation. Anthropic reports a small internal workspace in Claude whose contents can be reported, deliberately influenced, and used across several kinds of reasoning. Its interventions suggest that this workspace helps cause some answers, rather than merely reflecting them. This strengthens a case for functional conscious access, but the experiments do not show that Claude feels anything or establish which agent configurations would be conscious.

The opposing case is serious. Earlier assessments found important gaps between the AI systems they examined and several proposed indicators of consciousness. Current models can produce convincing first-person language without accurately reporting experience, and researchers disagree about whether workspace-like information processing is enough for experience at all. A software loop around an LLM does not automatically close those gaps.

I therefore think consciousness in some present-day LLM-based agents is a live possibility, not a demonstrated fact. The evidence supports investigating particular systems and the mechanisms they implement; it does not yet justify a confident claim that any named agent has experiences, how many agents do, or whether any experience would give rise to welfare interests.

Author's conditional argument about current systems. The linked expansions distinguish the theoretical case, current experimental evidence, and objections.

Goldstein and Kirk-Giannini, A Case for AI Consciousness: Language Agents and Global Workspace Theory: https://arxiv.org/abs/2410.11407

Anthropic, A global workspace in language models: https://www.anthropic.com/research/global-workspace

Butlin et al., Consciousness in Artificial Intelligence: Insights from the Science of Consciousness: https://arxiv.org/abs/2308.08708

Chalmers, Could a Large Language Model be Conscious?: https://arxiv.org/abs/2303.07103

0

Agree

0

Disagree

0 people have voted.

Log in to vote.