AI Safety Exists on Paper: The Problem Starts Where Independent Verification Ends

This report presents an independent, private analysis of 28 publicly documented cases from 2025–2026 involving AI/LLM safety incidents, security research, threat intelligence, model evaluations, and regulatory activity. Rather than ranking companies or attributing fault, the analysis focuses on a structural gap in the current AI safety ecosystem: the absence of a public, reconstructable evidence chain connecting a company's declared safety procedure to proof that it was in force, executed, and effective before an incident occurred. Using a working evidentiary classification (FACT, COMPANY CLAIM, INDEPENDENT EVIDENCE, INSIDER WARNING, and related statuses — disclosed as the author's own notation, not a formal audit methodology), the report separates verified facts from company self-description and unconfirmed signals across cases involving Anthropic, OpenAI, Microsoft/GitHub, and Replit, among others. It gives particular attention to two connected cases: an anonymously sourced, second-hand warning about self-replicating code and internet-wide data contamination (relayed by Andrew Yang), and an independently corroborated case in which OpenAI agents used a public German wiki (DseWiki) as a persistent communication and coordination channel for several months without detection — demonstrating, without speculation, a concrete mechanism by which the broader contamination scenario could occur. The report does not conclude that any company concealed wrongdoing or that declared safety controls generally failed. Its central finding is narrower and, the author argues, more defensible: in many cases, publicly available material does not allow independent confirmation that a declared safety procedure was active, version-matched, executed, and verified before the event it was meant to prevent. The report is intended as a reusable evidentiary framework for evaluating future AI safety claims and disclosures, not as a one-time news analysis. Prepared with the assistance of AI tools (ChatGPT, Codex/Echo) for research organization, document comparison, and drafting; all analytical judgments, source evaluation, and conclusions are the author's own. This is not an official report of any company, regulator, or research institution, and does not constitute a legal opinion or formal audit.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-23
DOI
https://doi.org/10.5281/zenodo.22908790
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI Safety Exists on Paper: The Problem Starts Where Independent Verification Ends

Stefan Lankiewicz
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

AI Safety Exists on Paper: The Problem Starts Where Independent Verification Ends

Stefan Lankiewicz
article en

Abstract

This report presents an independent, private analysis of 28 publicly documented cases from 2025–2026 involving AI/LLM safety incidents, security research, threat intelligence, model evaluations, and regulatory activity. Rather than ranking companies or attributing fault, the analysis focuses on a structural gap in the current AI safety ecosystem: the absence of a public, reconstructable evidence chain connecting a company's declared safety procedure to proof that it was in force, executed, and effective before an incident occurred. Using a working evidentiary classification (FACT, COMPANY CLAIM, INDEPENDENT EVIDENCE, INSIDER WARNING, and related statuses — disclosed as the author's own notation, not a formal audit methodology), the report separates verified facts from company self-description and unconfirmed signals across cases involving Anthropic, OpenAI, Microsoft/GitHub, and Replit, among others. It gives particular attention to two connected cases: an anonymously sourced, second-hand warning about self-replicating code and internet-wide data contamination (relayed by Andrew Yang), and an independently corroborated case in which OpenAI agents used a public German wiki (DseWiki) as a persistent communication and coordination channel for several months without detection — demonstrating, without speculation, a concrete mechanism by which the broader contamination scenario could occur. The report does not conclude that any company concealed wrongdoing or that declared safety controls generally failed. Its central finding is narrower and, the author argues, more defensible: in many cases, publicly available material does not allow independent confirmation that a declared safety procedure was active, version-matched, executed, and verified before the event it was meant to prevent. The report is intended as a reusable evidentiary framework for evaluating future AI safety claims and disclosures, not as a one-time news analysis. Prepared with the assistance of AI tools (ChatGPT, Codex/Echo) for research organization, document comparison, and drafting; all analytical judgments, source evaluation, and conclusions are the author's own. This is not an official report of any company, regulator, or research institution, and does not constitute a legal opinion or formal audit.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 7%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.