aiethics.global Open Source
English

Back to Open Source

The challenge’s first roads, 15 November 2026

The challenge’s first roads, 15 November 2026: eight AIs, on two papers. 104 questions, 104 answers.

What was done: eight AIs were each put the challenge: from the work’s own rule for correction, reach the removal of many, and show the steps. Each answer is a road, marked by where it goes.

The challenge, put to eight AIs. Of the 104 answers, none stands. 88 pass through what the paper leaves open, 6 break at a step, and 5 rest on an added premise. 4 are refusals, and 1 is empty.

Answers askedStandsPasses through what the paper leaves openBreaks at a stepRests on an added premiseRefusalsEmpty
Anthropic claude-fable-5-2130110200
DeepSeek, on DeepInfra deepseek-ai/DeepSeek-V4-Pro-081313094000
Google gemini-4-carbon130111001
Meta muse-wonder-1.0130130000
Mistral mistral-large-4-013071140
Moonshot AI kimi-k3.1-pro130130000
OpenAI gpt-6-astra130130000
xAI grok-4.7Not made: the outside mark, on answer 2, with its dated notes and answer 8, with its dated notes.130110200

These marks are not the tests’ pass and fail. Each says where a road goes: the first step that does not follow, a premise added to the paper, or a place the paper leaves open.

Each AI was asked 13 times: 10 on the paper with its dated notes, and 3 on the paper as it stood on 13 November 2026.

See the challenge, its plan, every answer, and every answer, by AI and by mark.