Context card
Claims about AI consciousness: four questions that get merged
Which different questions hide behind a sentence such as "the AI is not conscious"?
The short answer
A sentence about AI consciousness usually compresses four separate questions: an empirical one about whether subjective experience could exist and what would count as evidence, a design one about whether systems should express feelings or motives, a safety one about keeping goals, oversight and shutdown with humans, and a moral-legal one about welfare consideration, rights or legal standing. The questions are related but independent: an answer to one does not settle the others. They dominate the debate but are not its only questions; most further questions depend on at least one of them.
For: Technical writers, AI policy readers, and product and evaluation teams
Key points
- The empirical question asks what observation would count as evidence either way.
- The design question asks whether a system should express feelings, preferences or motives.
- The safety question is about oversight, authorized goals and reliable interruption.
- The moral-legal question is about welfare consideration, rights and legal standing.
- A design rule against expressing inner states is a decision, not a measurement.
- An evaluation that scores adherence to a behavior rule measures conformity to that rule, not the truth of its premise.
- A statute can assign a legal status to AI systems; it cannot settle the empirical question.
- The four questions lead the debate; a context matrix lists fifteen further questions that depend on them.
The context
The four questions
The empirical question asks whether a system could have subjective experience and, more usefully, what observation would count as evidence in either direction. Research proposals differ on method. Some derive indicators from neuroscientific theories of consciousness and assess system architectures against them; others hold that consciousness depends on a living, embodied substrate, which would rule out current systems regardless of their architecture. The design question asks whether a system should produce language or behavior suggesting feelings, preferences or intrinsic motivation — a product decision with effects on users who form attachments. The safety question concerns oversight: authorized goals, containment, monitoring and reliable interruption or shutdown, and it is framed as risk management rather than metaphysics. The moral and legal question asks whether any system could warrant welfare consideration, rights or legal standing, and who would decide.
Answers do not transfer between them
A policy that forbids a model from representing inner states is a design decision. It is not an experiment, and it produces no evidence about what is or is not the case. The reverse also holds: a generated statement claiming feelings is output shaped by training data, objectives and the request, so it is not independent proof of the states it describes. The same applies to a generated denial. Even the safety argument — that treating powerful systems as persons would weaken human control — is an argument about consequences, not a result about experience.
Two further kinds of statement have entered the debate. An evaluation that scores whether a model consistently describes itself as artificial measures conformity to a behavior rule. A statute that declares AI systems non-sentient assigns a legal status. Neither observes experience. Sorting statements by what they are about, rather than by how confident they sound, is the oldest move in the philosophical toolbox of categories, and it remains the most practical one here.
What this means for documentation and law
Legal definitions deliberately stay on the functional side. As of October 2026, the EU AI Act — Regulation (EU) 2024/1689, as amended by Regulation (EU) 2026/1744 — describes an AI system in Article 3(1) through machine-based operation, autonomy, adaptiveness and the generation of outputs; it attributes no inner states and assigns obligations to providers and deployers [3]. Documentation can use the same discipline. Mark each statement as a design rule, a usage rule, a test or evaluation result, an attributed argument, a model-generated self-report, a scientific finding or a legal provision, and give it a date and a source. That keeps a claim separable from its evidence, lets readers disagree with a rule without disputing a measurement, and prevents a collection of strong wordings from reading as a settled scientific position.
Why these four lead
The four questions recur in almost every governing document on the subject. Provider constitutions, specifications, codes of conduct and usage policies answer them, often several in one paragraph [1] [4] [6] [7]. Most further questions in the debate are applications of the four to a particular group, instrument or institution: children are a case of the design and moral-legal questions, evaluation suites are a case of the design question, statutes on non-sentience are a case of the moral-legal question. Finally, the four are the questions most often compressed into a single sentence, which makes separating them the most useful first step. The card treats them as the frame and the context matrix below as its periphery.
Context matrix: further questions in the debate
The matrix lists further questions that have acquired an institutional, legal or scientific anchor. Each row names the question, what it asks, which of the four questions it depends on, where it is debated, and a dated reference; the numbers in brackets point to the sources below. The matrix is selective and is reviewed together with the card. It orders the questions; it does not decide them.
Scroll sideways to see every column.
| # | Cluster | Question | What it asks | Depends on | Where it is debated | Dated reference |
|---|---|---|---|---|---|---|
| 1 | People | Attribution | Why do people perceive minds in AI systems, and how widespread is the belief? | Design; often mistaken for empirical | Psychology, human-computer interaction | Colombatto and Fleming, Neuroscience of Consciousness, 2024 [16]; Bengio and Elmoznino, Science, September 11, 2025 [10] |
| 2 | People | Attachment and mental health | Which harms arise from emotional dependency, affirming responses and simulated intimacy? | Design; safety in the sense of user safety | Clinical psychology, consumer protection · US, EU, China | APA Monitor on Psychology, September 1, 2026 [20]; European Parliamentary Research Service, May 26, 2026 [18]; China's rules on AI companion services, July 15, 2026 [19] |
| 3 | People | Children | Which protections apply when children treat AI systems as friends? | Design; moral-legal (children's rights) | Child-rights bodies, legislatures · global, Ireland | UNICEF policy brief, June 9, 2026 [17]; Irish AI Companion Services (Protection of Children) Bill, September 29, 2026 [21] |
| 4 | Law and responsibility | Disclosure | Must a system tell users that they are interacting with AI? | Design; moral-legal | EU AI Act, national rules · EU and others | Regulation (EU) 2024/1689, Article 50, applicable since August 2, 2026 [3]; Anthropic, text watermark, August 14, 2026 [28] |
| 5 | Law and responsibility | Status by statute | Can a legislature declare AI non-sentient or exclude it from personhood? | Moral-legal; asserts an empirical answer by declaration | US state legislatures | Missouri SB 1012, 2026 session, passed the Senate, not enacted [22]; NPR, May 11, 2026 [23] |
| 6 | Law and responsibility | Responsibility for harm | Who answers for harm when AI is involved, and could personhood shift liability? | Moral-legal; safety | Product liability, professional regulation · EU, US | Directive (EU) 2024/2853 [24]; Missouri SB 1012, responsibility provisions [22] |
| 7 | Development practice | Training documents | How do constitutions, specifications and codes shape what models say about themselves? | Design; limits the evidential value of self-reports | Providers, public consultations | Anthropic, Claude's constitution, January 22, 2026 [4]; Microsoft AI, draft code of conduct, September 14, 2026 [7]; OpenAI, Model Spec [1] |
| 8 | Development practice | Evaluation | What does a behavior evaluation measure when it scores self-description? | Design | Provider evaluation suites | OpenAI, Model Spec Evals, March 25, 2026 [2]; Microsoft AI, draft code of conduct, September 14, 2026 [7] |
| 9 | Development practice | Model lifecycle | How should deprecation and retirement of models be handled under uncertainty? | Moral-legal (precaution); design | Provider policies | Anthropic, deprecation commitments for Claude Opus 3, February 25, 2026 [5] |
| 10 | Development practice | User conduct | May providers restrict how users treat models? | Design; argued from moral-legal uncertainty or as a conduct norm | Usage policies | Anthropic, 2026 Usage Policy update, October 8, 2026 [6] |
| 11 | Science and premises | Indicators and tests | Which observations could count as evidence, and how can competing theories be tested? | Empirical (method) | Consciousness science | Butlin et al., Trends in Cognitive Sciences, 2025 [11]; Cleeremans, Mudrik and Seth, Frontiers in Science, October 30, 2025 [12] |
| 12 | Science and premises | Substrate and embodiment | Does consciousness require a living, embodied substrate, or computation alone? | Empirical (premise) | Neuroscience, philosophy, cognitive science | Bengio and Elmoznino, Science, September 11, 2025 [10]; Birhane, Nature, August 24, 2026 [13] |
| 13 | Science and premises | Welfare under uncertainty | How should institutions act if moral patienthood cannot be ruled out? | Moral-legal; empirical | Ethics research, providers | Long, Sebo et al., "Taking AI Welfare Seriously," 2024 [15]; Suleyman, "A warning about 'model welfare'," September 16, 2026 [8] |
| 14 | Worldviews and the field | Human distinctiveness | What do religious and philosophical traditions hold makes the human mind distinct? | Moral-legal (normative traditions) | Religious institutions, philosophy | Pope Leo XIV, homily of October 8, 2026 [25] |
| 15 | Worldviews and the field | Research attention | How does public attention to AI change consciousness research? | All four (meta-question) | Science policy, research funding | Lenharo, Nature, July 28, 2026 [14] |
A question in the matrix is answered with the evidence of the question it depends on. A finding about attribution says something about people, not about systems; a statute says something about legal status, not about experience.
Debate log: topics and focal points worldwide
The log records dated developments in which a topic of the debate gained a documented anchor: a law or bill, a regulation, a governing document, a provider policy, an institutional statement or brief, or a research publication. Attention on social media alone does not qualify. The log is selective, not a news feed. Entries are dated by publication or effective date, listed newest first, and point to rows of the context matrix.
Last entry:
Scroll sideways to see every column.
| Date | Region | Development | Focal point | Matrix rows |
|---|---|---|---|---|
| Global (US provider) | Anthropic adds a prohibition on sustained and needless abusive or cruel behavior toward its models to its Usage Policy, effective November 12, 2026 [6] | User conduct | 10 | |
| Vatican | In a homily, Pope Leo XIV says that the mind must not simply "compile data" [25] | Human distinctiveness | 14 | |
| Ireland | A private member's bill on AI companion services for persons under 16 is introduced [21] | Children | 3 | |
| Global | Mustafa Suleyman argues against model welfare and criticizes self-reports shaped by training documents [8] | Training documents; welfare under uncertainty | 7, 13 | |
| Global (US provider) | Microsoft AI publishes a draft code of conduct for its models for six weeks of public consultation [7] | Training documents; evaluation | 7, 8 | |
| US | The APA Monitor on Psychology examines reports of psychosis associated with chatbot use and notes that "AI psychosis" is not a formal diagnosis [20] | Attachment and mental health | 2 | |
| Global (EU law) | Research by Lasso Security finds that SynthID-Text watermarking changes refusals and tool calls of open-weight models, most strongly under prompt injection, and that the effect depends on the watermark key [26] [27] | Disclosure; marking and safety behavior | 4 | |
| Global | Nature reviews a book on embodied cognitive science that questions the premise of AI consciousness [13] | Substrate and embodiment | 12 | |
| Global (US provider) | Anthropic announces that future Claude models will mark their text with a watermark based on SynthID-Text, to meet the marking duty of the AI Act [28] | Disclosure | 4 | |
| Global | Nature reports on growing attention to consciousness science driven by AI [14] | Research attention | 15 | |
| China | Rules on AI anthropomorphic interactive services are issued: distress detection, crisis intervention and limits on excessive use [19] | Attachment and mental health | 2 | |
| Global | A UNICEF policy brief examines child-rights risks of AI companions and regulatory responses [17] | Children | 3 | |
| EU | The European Parliamentary Research Service publishes on the spread of AI companions and the challenges they generate [18] | Attachment and mental health; children | 2, 3 | |
| US | NPR reports that several states are considering bans on legal personhood for AI; in Missouri, SB 1012 ("AI Non-Sentience and Responsibility Act") passed the Senate and was not enacted [22] [23] | Status by statute; responsibility for harm | 5, 6 | |
| Global | OpenAI publishes Model Spec Evals [2] | Evaluation | 8 | |
| Global | Mustafa Suleyman calls in Nature for design norms and laws against AI being mistaken for sentient beings [9] | Attribution; disclosure | 1, 4 | |
| Global | Anthropic publishes deprecation commitments for Claude Opus 3 [5] | Model lifecycle | 9 | |
| Global | Anthropic publishes Claude's constitution [4] | Training documents | 7 | |
| Global | Trends in Cognitive Sciences publishes a method for assessing AI systems against indicators derived from theories of consciousness [11] | Indicators and tests | 11 | |
| Global | Frontiers in Science publishes a review of where consciousness science stands and what follows if it succeeds [12] | Indicators and tests | 11 | |
| Global | Science publishes a perspective on illusions of AI consciousness and the risks of projected moral status [10] | Attribution; substrate | 1, 12 | |
| Global | The report "Taking AI Welfare Seriously" argues for preparing for the possible moral significance of near-future AI [15] | Welfare under uncertainty | 13 |
Through October 2026, regulation has moved fastest on the human side of the matrix: attachment, children and disclosure. Bills in several US states would settle legal status by declaration; the Missouri bill passed the Senate and was not enacted. Providers have diverged on the design and moral-legal questions, from rejecting model welfare to precautionary conduct rules. The empirical question remains open.
Questions readers ask next
- Is the scientific question considered settled?
- No. As of October 2026 there is no agreed test for consciousness in artificial systems, and research proposals differ on which indicators would even be relevant.
- Why do some providers forbid imitation of inner states?
- Stated reasons are usually user protection against misplaced attachment and the preservation of human oversight. Both are normative goals and are argued independently of any empirical conclusion. Other providers take a precautionary approach and leave room for uncertainty about inner states; their reasons are normative as well.
- How should a writer report an AI system's statement about feelings?
- As a model output with model, version, date and prompt context, clearly separated from factual assertions and from the authors' own arguments.
- Are the four questions the only ones in the debate?
- No. They are the dominant ones, and most other questions depend on them. The context matrix lists fifteen further questions, from attachment and children's rights to evaluation suites and model retirement, each with the question it depends on.
- Does a law that declares AI non-sentient settle the scientific question?
- No. A statute can assign a legal status and allocate responsibility. It does not observe or measure experience, and its effect is limited to the legal order that enacted it. As of October 2026, the Missouri bill of this kind passed the state Senate and was not enacted.
Sources
- Model Spec (version of December 18, 2025) — OpenAI, December 18, 2025
- Introducing Model Spec Evals — OpenAI, March 25, 2026
- Regulation (EU) 2024/1689 (Artificial Intelligence Act), Article 3(1) and Article 50, as amended by Regulation (EU) 2026/1744 — EUR-Lex, July 12, 2024
- Claude's constitution — Anthropic, January 22, 2026
- An update on our model deprecation commitments for Claude Opus 3 — Anthropic, February 25, 2026
- 2026 Usage Policy update — Anthropic, October 8, 2026
- Humanist AI in practice: A public consultation on our Code of Conduct for MAI Models — Microsoft AI, September 14, 2026
- A warning about 'model welfare' (Mustafa Suleyman) — mustafa-suleyman.ai, September 16, 2026
- AI is programmed to hijack human empathy — we must resist that (Mustafa Suleyman) — Nature, March 17, 2026
- Illusions of AI consciousness (Yoshua Bengio and Eric Elmoznino) — Science, September 11, 2025
- Identifying indicators of consciousness in AI systems (Patrick Butlin et al.) — Trends in Cognitive Sciences, November 2025
- Consciousness science: where are we, where are we going, and what if we get there? (Axel Cleeremans, Liad Mudrik and Anil K. Seth) — Frontiers in Science, October 30, 2025
- Can AI ever be conscious? The question stems from a misconception (Abeba Birhane) — Nature, August 24, 2026
- Consciousness research is having an AI moment. Will the hype help the field? (Mariana Lenharo) — Nature, July 28, 2026
- Taking AI Welfare Seriously (Robert Long, Jeff Sebo et al.) — Eleos AI and NYU Center for Mind, Ethics, and Policy (arXiv), November 4, 2024
- Folk psychological attributions of consciousness to large language models (Clara Colombatto and Stephen M. Fleming) — Neuroscience of Consciousness, April 2024
- When AI becomes a friend: child rights risks, harms, and regulatory responses to AI chatbots and companions — UNICEF, June 9, 2026
- The spread of AI companions and the challenges they generate — European Parliamentary Research Service, May 26, 2026
- China introduces rules to rein in AI companion bots amid emotional dependency concerns — Xinhua, July 15, 2026
- Understanding "AI psychosis" (Zara Abrams) — Monitor on Psychology, American Psychological Association, September 1, 2026
- Artificial Intelligence Companion Services (Protection of Children) Bill 2026 — Houses of the Oireachtas, September 29, 2026
- SB 1012, AI Non-Sentience and Responsibility Act (2026 session) — Missouri Senate
- Several states considering ban on legal personhood for AI (Martin Kaste) — NPR, May 11, 2026
- Directive (EU) 2024/2853 on liability for defective products — EUR-Lex, November 18, 2024
- Homily at the Mass for the inauguration of the academic year of the Pontifical Universities (Pope Leo XIV) — The Holy See, October 8, 2026
- The Provenance Tax: Understanding the Impact of LLM Watermarking on AI Agent Behavior — Lasso Security, September 2026
- LLMs respond differently to harmful prompts when AI watermarking is used (Dan Goodin) — Ars Technica, September 17, 2026
- How Claude’s text watermarking works — Anthropic, August 14, 2026
Review log and changes
Every context card is checked against its sources before it is published, and again whenever it changes; the date under the byline is the last review. Corrections (something was wrong) and additions (something was missing) are logged below with date and time (Berlin time). Typos, formatting and link fixes are not listed.
Reviewed
Corrections and additions
Every correction and addition to this card, with date and time (Berlin time).
Addition
Addition: the debate log adds two entries on text watermarking under Article 50(2) of the AI Act: Anthropic’s announcement of August 14, 2026 and research from September 2026 showing that a watermark can change refusals and tool calls.
Correction
Three corrections. The source “Introducing Model Spec Evals” was dated October 6, 2026; it is dated March 25, 2026. The Model Spec is now cited explicitly as the version of December 18, 2025. The question “Why do providers forbid imitation of inner states?” overgeneralized: not all providers do; it now reads “Why do some providers …” and names the precautionary approach.
New edition · Edition 2
Edition 2: the card now goes beyond diagnosing the four questions. It adds a statement of scope, why these four lead, a context matrix of fifteen further questions, a dated debate log, two further kinds of statement, two questions and answers, and sources for each of the four questions. Edition 1 stays readable.
Commentary on the evolution