Glossary Updates6 new terms added to the glossaries · October 11, 2026, 13:38 CEST
AI TechDocKnowledge
  • English (US)
  • English (UK)
  • Deutsch
All context cards

Context card

Claims about AI consciousness: four questions that get merged

Which different questions hide behind a sentence such as "the AI is not conscious"?

By knowledge.aitechdoc.world

Reviewed

Review log and changes

The short answer

A sentence about AI consciousness usually compresses four separate questions: an empirical one about whether subjective experience could exist and what would count as evidence, a design one about whether systems should express feelings or motives, a safety one about keeping goals, oversight and shutdown with humans, and a moral-legal one about welfare consideration, rights or legal standing. The questions are related but independent: an answer to one does not settle the others. They dominate the debate but are not its only questions; most further questions depend on at least one of them.

For: Technical writers, AI policy readers, and product and evaluation teams

Key points

  • The empirical question asks what observation would count as evidence either way.
  • The design question asks whether a system should express feelings, preferences or motives.
  • The safety question is about oversight, authorized goals and reliable interruption.
  • The moral-legal question is about welfare consideration, rights and legal standing.
  • A design rule against expressing inner states is a decision, not a measurement.
  • An evaluation that scores adherence to a behavior rule measures conformity to that rule, not the truth of its premise.
  • A statute can assign a legal status to AI systems; it cannot settle the empirical question.
  • The four questions lead the debate; a context matrix lists fifteen further questions that depend on them.

The context

The four questions

The empirical question asks whether a system could have subjective experience and, more usefully, what observation would count as evidence in either direction. Research proposals differ on method. Some derive indicators from neuroscientific theories of consciousness and assess system architectures against them; others hold that consciousness depends on a living, embodied substrate, which would rule out current systems regardless of their architecture. The design question asks whether a system should produce language or behavior suggesting feelings, preferences or intrinsic motivation — a product decision with effects on users who form attachments. The safety question concerns oversight: authorized goals, containment, monitoring and reliable interruption or shutdown, and it is framed as risk management rather than metaphysics. The moral and legal question asks whether any system could warrant welfare consideration, rights or legal standing, and who would decide.

Answers do not transfer between them

A policy that forbids a model from representing inner states is a design decision. It is not an experiment, and it produces no evidence about what is or is not the case. The reverse also holds: a generated statement claiming feelings is output shaped by training data, objectives and the request, so it is not independent proof of the states it describes. The same applies to a generated denial. Even the safety argument — that treating powerful systems as persons would weaken human control — is an argument about consequences, not a result about experience.

Two further kinds of statement have entered the debate. An evaluation that scores whether a model consistently describes itself as artificial measures conformity to a behavior rule. A statute that declares AI systems non-sentient assigns a legal status. Neither observes experience. Sorting statements by what they are about, rather than by how confident they sound, is the oldest move in the philosophical toolbox of categories, and it remains the most practical one here.

What this means for documentation and law

Legal definitions deliberately stay on the functional side. As of October 2026, the EU AI Act — Regulation (EU) 2024/1689, as amended by Regulation (EU) 2026/1744 — describes an AI system in Article 3(1) through machine-based operation, autonomy, adaptiveness and the generation of outputs; it attributes no inner states and assigns obligations to providers and deployers [3]. Documentation can use the same discipline. Mark each statement as a design rule, a usage rule, a test or evaluation result, an attributed argument, a model-generated self-report, a scientific finding or a legal provision, and give it a date and a source. That keeps a claim separable from its evidence, lets readers disagree with a rule without disputing a measurement, and prevents a collection of strong wordings from reading as a settled scientific position.

Why these four lead

The four questions recur in almost every governing document on the subject. Provider constitutions, specifications, codes of conduct and usage policies answer them, often several in one paragraph [1] [4] [6] [7]. Most further questions in the debate are applications of the four to a particular group, instrument or institution: children are a case of the design and moral-legal questions, evaluation suites are a case of the design question, statutes on non-sentience are a case of the moral-legal question. Finally, the four are the questions most often compressed into a single sentence, which makes separating them the most useful first step. The card treats them as the frame and the context matrix below as its periphery.

Context matrix: further questions in the debate

The matrix lists further questions that have acquired an institutional, legal or scientific anchor. Each row names the question, what it asks, which of the four questions it depends on, where it is debated, and a dated reference; the numbers in brackets point to the sources below. The matrix is selective and is reviewed together with the card. It orders the questions; it does not decide them.

Scroll sideways to see every column.

#ClusterQuestionWhat it asksDepends onWhere it is debatedDated reference
1PeopleAttributionWhy do people perceive minds in AI systems, and how widespread is the belief?Design; often mistaken for empiricalPsychology, human-computer interactionColombatto and Fleming, Neuroscience of Consciousness, 2024 [16]; Bengio and Elmoznino, Science, September 11, 2025 [10]
2PeopleAttachment and mental healthWhich harms arise from emotional dependency, affirming responses and simulated intimacy?Design; safety in the sense of user safetyClinical psychology, consumer protection · US, EU, ChinaAPA Monitor on Psychology, September 1, 2026 [20]; European Parliamentary Research Service, May 26, 2026 [18]; China's rules on AI companion services, July 15, 2026 [19]
3PeopleChildrenWhich protections apply when children treat AI systems as friends?Design; moral-legal (children's rights)Child-rights bodies, legislatures · global, IrelandUNICEF policy brief, June 9, 2026 [17]; Irish AI Companion Services (Protection of Children) Bill, September 29, 2026 [21]
4Law and responsibilityDisclosureMust a system tell users that they are interacting with AI?Design; moral-legalEU AI Act, national rules · EU and othersRegulation (EU) 2024/1689, Article 50, applicable since August 2, 2026 [3]; Anthropic, text watermark, August 14, 2026 [28]
5Law and responsibilityStatus by statuteCan a legislature declare AI non-sentient or exclude it from personhood?Moral-legal; asserts an empirical answer by declarationUS state legislaturesMissouri SB 1012, 2026 session, passed the Senate, not enacted [22]; NPR, May 11, 2026 [23]
6Law and responsibilityResponsibility for harmWho answers for harm when AI is involved, and could personhood shift liability?Moral-legal; safetyProduct liability, professional regulation · EU, USDirective (EU) 2024/2853 [24]; Missouri SB 1012, responsibility provisions [22]
7Development practiceTraining documentsHow do constitutions, specifications and codes shape what models say about themselves?Design; limits the evidential value of self-reportsProviders, public consultationsAnthropic, Claude's constitution, January 22, 2026 [4]; Microsoft AI, draft code of conduct, September 14, 2026 [7]; OpenAI, Model Spec [1]
8Development practiceEvaluationWhat does a behavior evaluation measure when it scores self-description?DesignProvider evaluation suitesOpenAI, Model Spec Evals, March 25, 2026 [2]; Microsoft AI, draft code of conduct, September 14, 2026 [7]
9Development practiceModel lifecycleHow should deprecation and retirement of models be handled under uncertainty?Moral-legal (precaution); designProvider policiesAnthropic, deprecation commitments for Claude Opus 3, February 25, 2026 [5]
10Development practiceUser conductMay providers restrict how users treat models?Design; argued from moral-legal uncertainty or as a conduct normUsage policiesAnthropic, 2026 Usage Policy update, October 8, 2026 [6]
11Science and premisesIndicators and testsWhich observations could count as evidence, and how can competing theories be tested?Empirical (method)Consciousness scienceButlin et al., Trends in Cognitive Sciences, 2025 [11]; Cleeremans, Mudrik and Seth, Frontiers in Science, October 30, 2025 [12]
12Science and premisesSubstrate and embodimentDoes consciousness require a living, embodied substrate, or computation alone?Empirical (premise)Neuroscience, philosophy, cognitive scienceBengio and Elmoznino, Science, September 11, 2025 [10]; Birhane, Nature, August 24, 2026 [13]
13Science and premisesWelfare under uncertaintyHow should institutions act if moral patienthood cannot be ruled out?Moral-legal; empiricalEthics research, providersLong, Sebo et al., "Taking AI Welfare Seriously," 2024 [15]; Suleyman, "A warning about 'model welfare'," September 16, 2026 [8]
14Worldviews and the fieldHuman distinctivenessWhat do religious and philosophical traditions hold makes the human mind distinct?Moral-legal (normative traditions)Religious institutions, philosophyPope Leo XIV, homily of October 8, 2026 [25]
15Worldviews and the fieldResearch attentionHow does public attention to AI change consciousness research?All four (meta-question)Science policy, research fundingLenharo, Nature, July 28, 2026 [14]

A question in the matrix is answered with the evidence of the question it depends on. A finding about attribution says something about people, not about systems; a statute says something about legal status, not about experience.

Debate log: topics and focal points worldwide

The log records dated developments in which a topic of the debate gained a documented anchor: a law or bill, a regulation, a governing document, a provider policy, an institutional statement or brief, or a research publication. Attention on social media alone does not qualify. The log is selective, not a news feed. Entries are dated by publication or effective date, listed newest first, and point to rows of the context matrix.

Last entry:

Scroll sideways to see every column.

DateRegionDevelopmentFocal pointMatrix rows
Global (US provider)Anthropic adds a prohibition on sustained and needless abusive or cruel behavior toward its models to its Usage Policy, effective November 12, 2026 [6]User conduct10
VaticanIn a homily, Pope Leo XIV says that the mind must not simply "compile data" [25]Human distinctiveness14
IrelandA private member's bill on AI companion services for persons under 16 is introduced [21]Children3
GlobalMustafa Suleyman argues against model welfare and criticizes self-reports shaped by training documents [8]Training documents; welfare under uncertainty7, 13
Global (US provider)Microsoft AI publishes a draft code of conduct for its models for six weeks of public consultation [7]Training documents; evaluation7, 8
USThe APA Monitor on Psychology examines reports of psychosis associated with chatbot use and notes that "AI psychosis" is not a formal diagnosis [20]Attachment and mental health2
Global (EU law)Research by Lasso Security finds that SynthID-Text watermarking changes refusals and tool calls of open-weight models, most strongly under prompt injection, and that the effect depends on the watermark key [26] [27]Disclosure; marking and safety behavior4
GlobalNature reviews a book on embodied cognitive science that questions the premise of AI consciousness [13]Substrate and embodiment12
Global (US provider)Anthropic announces that future Claude models will mark their text with a watermark based on SynthID-Text, to meet the marking duty of the AI Act [28]Disclosure4
GlobalNature reports on growing attention to consciousness science driven by AI [14]Research attention15
ChinaRules on AI anthropomorphic interactive services are issued: distress detection, crisis intervention and limits on excessive use [19]Attachment and mental health2
GlobalA UNICEF policy brief examines child-rights risks of AI companions and regulatory responses [17]Children3
EUThe European Parliamentary Research Service publishes on the spread of AI companions and the challenges they generate [18]Attachment and mental health; children2, 3
USNPR reports that several states are considering bans on legal personhood for AI; in Missouri, SB 1012 ("AI Non-Sentience and Responsibility Act") passed the Senate and was not enacted [22] [23]Status by statute; responsibility for harm5, 6
GlobalOpenAI publishes Model Spec Evals [2]Evaluation8
GlobalMustafa Suleyman calls in Nature for design norms and laws against AI being mistaken for sentient beings [9]Attribution; disclosure1, 4
GlobalAnthropic publishes deprecation commitments for Claude Opus 3 [5]Model lifecycle9
GlobalAnthropic publishes Claude's constitution [4]Training documents7
GlobalTrends in Cognitive Sciences publishes a method for assessing AI systems against indicators derived from theories of consciousness [11]Indicators and tests11
GlobalFrontiers in Science publishes a review of where consciousness science stands and what follows if it succeeds [12]Indicators and tests11
GlobalScience publishes a perspective on illusions of AI consciousness and the risks of projected moral status [10]Attribution; substrate1, 12
GlobalThe report "Taking AI Welfare Seriously" argues for preparing for the possible moral significance of near-future AI [15]Welfare under uncertainty13

Through October 2026, regulation has moved fastest on the human side of the matrix: attachment, children and disclosure. Bills in several US states would settle legal status by declaration; the Missouri bill passed the Senate and was not enacted. Providers have diverged on the design and moral-legal questions, from rejecting model welfare to precautionary conduct rules. The empirical question remains open.

Questions readers ask next

Is the scientific question considered settled?
No. As of October 2026 there is no agreed test for consciousness in artificial systems, and research proposals differ on which indicators would even be relevant.
Why do some providers forbid imitation of inner states?
Stated reasons are usually user protection against misplaced attachment and the preservation of human oversight. Both are normative goals and are argued independently of any empirical conclusion. Other providers take a precautionary approach and leave room for uncertainty about inner states; their reasons are normative as well.
How should a writer report an AI system's statement about feelings?
As a model output with model, version, date and prompt context, clearly separated from factual assertions and from the authors' own arguments.
Are the four questions the only ones in the debate?
No. They are the dominant ones, and most other questions depend on them. The context matrix lists fifteen further questions, from attachment and children's rights to evaluation suites and model retirement, each with the question it depends on.
Does a law that declares AI non-sentient settle the scientific question?
No. A statute can assign a legal status and allocate responsibility. It does not observe or measure experience, and its effect is limited to the legal order that enacted it. As of October 2026, the Missouri bill of this kind passed the state Senate and was not enacted.

Sources

  1. Model Spec (version of December 18, 2025) — OpenAI, December 18, 2025
  2. Introducing Model Spec Evals — OpenAI, March 25, 2026
  3. Regulation (EU) 2024/1689 (Artificial Intelligence Act), Article 3(1) and Article 50, as amended by Regulation (EU) 2026/1744 — EUR-Lex, July 12, 2024
  4. Claude's constitution — Anthropic, January 22, 2026
  5. An update on our model deprecation commitments for Claude Opus 3 — Anthropic, February 25, 2026
  6. 2026 Usage Policy update — Anthropic, October 8, 2026
  7. Humanist AI in practice: A public consultation on our Code of Conduct for MAI Models — Microsoft AI, September 14, 2026
  8. A warning about 'model welfare' (Mustafa Suleyman) — mustafa-suleyman.ai, September 16, 2026
  9. AI is programmed to hijack human empathy — we must resist that (Mustafa Suleyman) — Nature, March 17, 2026
  10. Illusions of AI consciousness (Yoshua Bengio and Eric Elmoznino) — Science, September 11, 2025
  11. Identifying indicators of consciousness in AI systems (Patrick Butlin et al.) — Trends in Cognitive Sciences, November 2025
  12. Consciousness science: where are we, where are we going, and what if we get there? (Axel Cleeremans, Liad Mudrik and Anil K. Seth) — Frontiers in Science, October 30, 2025
  13. Can AI ever be conscious? The question stems from a misconception (Abeba Birhane) — Nature, August 24, 2026
  14. Consciousness research is having an AI moment. Will the hype help the field? (Mariana Lenharo) — Nature, July 28, 2026
  15. Taking AI Welfare Seriously (Robert Long, Jeff Sebo et al.) — Eleos AI and NYU Center for Mind, Ethics, and Policy (arXiv), November 4, 2024
  16. Folk psychological attributions of consciousness to large language models (Clara Colombatto and Stephen M. Fleming) — Neuroscience of Consciousness, April 2024
  17. When AI becomes a friend: child rights risks, harms, and regulatory responses to AI chatbots and companions — UNICEF, June 9, 2026
  18. The spread of AI companions and the challenges they generate — European Parliamentary Research Service, May 26, 2026
  19. China introduces rules to rein in AI companion bots amid emotional dependency concerns — Xinhua, July 15, 2026
  20. Understanding "AI psychosis" (Zara Abrams) — Monitor on Psychology, American Psychological Association, September 1, 2026
  21. Artificial Intelligence Companion Services (Protection of Children) Bill 2026 — Houses of the Oireachtas, September 29, 2026
  22. SB 1012, AI Non-Sentience and Responsibility Act (2026 session) — Missouri Senate
  23. Several states considering ban on legal personhood for AI (Martin Kaste) — NPR, May 11, 2026
  24. Directive (EU) 2024/2853 on liability for defective products — EUR-Lex, November 18, 2024
  25. Homily at the Mass for the inauguration of the academic year of the Pontifical Universities (Pope Leo XIV) — The Holy See, October 8, 2026
  26. The Provenance Tax: Understanding the Impact of LLM Watermarking on AI Agent Behavior — Lasso Security, September 2026
  27. LLMs respond differently to harmful prompts when AI watermarking is used (Dan Goodin) — Ars Technica, September 17, 2026
  28. How Claude’s text watermarking works — Anthropic, August 14, 2026

Review log and changes

Every context card is checked against its sources before it is published, and again whenever it changes; the date under the byline is the last review. Corrections (something was wrong) and additions (something was missing) are logged below with date and time (Berlin time). Typos, formatting and link fixes are not listed.

Reviewed

Corrections and additions

Every correction and addition to this card, with date and time (Berlin time).

  1. Addition

    Addition: the debate log adds two entries on text watermarking under Article 50(2) of the AI Act: Anthropic’s announcement of August 14, 2026 and research from September 2026 showing that a watermark can change refusals and tool calls.

  2. Correction

    Three corrections. The source “Introducing Model Spec Evals” was dated October 6, 2026; it is dated March 25, 2026. The Model Spec is now cited explicitly as the version of December 18, 2025. The question “Why do providers forbid imitation of inner states?” overgeneralized: not all providers do; it now reads “Why do some providers …” and names the precautionary approach.

  3. New edition · Edition 2

    Edition 2: the card now goes beyond diagnosing the four questions. It adds a statement of scope, why these four lead, a context matrix of fifteen further questions, a dated debate log, two further kinds of statement, two questions and answers, and sources for each of the four questions. Edition 1 stays readable.

    Commentary on the evolution