The government's Data and AI Ethics Framework tells every team building AI to record, audit and explain their decisions. Nobody outside the team ever has to check the record.
Estimated reading time: 6 minutes
In short. The Data and AI Ethics Framework, first published in 2018 and retitled in December 2025 to cover artificial intelligence, tells every public sector team building an AI or data project to name a senior owner, log every decision, complete an equality and privacy impact assessment, and use a self-assessment tool. Nobody outside the team ever reviews the self-assessment. The transparency standard the framework leans on for accountability, the Algorithmic Transparency Recording Standard, has been mandatory for central government since 2022 and has 152 published records to show for it. Five documented mistakes in an otherwise thorough document: three stars.
Escalated from the Daily Register under the site's criteria: a framework covering AI and data spending across the whole public sector, with high search salience following this site's teardown of the AI Playbook. This is a Tier 2 structured teardown: claims tested against the sources they cite, mistakes counted, arithmetic shown.
The framework began life in 2018 as the Data Ethics Framework, three principles long. It was rewritten in 2020, and rewritten again on 18 December 2025, when it was retitled the Data and AI Ethics Framework "to reflect the expanded scope covering AI and algorithmic technologies", gained four new principles and a companion self-assessment tool [1]. Seven principles now stand: transparency, accountability, fairness, privacy, safety, societal impact and environmental sustainability [2]. It is thorough. It is also, by its own account, unpoliced.
The claims, tested
| The framework's claim | What we found | Verdict |
|---|---|---|
| Teams "should use the Data and AI Ethics Self-Assessment Tool" [2] | The hyperlink on that exact sentence points to the framework's own landing page, not to the tool | Fails as written |
| Central government departments and qualifying arm's length bodies "must use the ATRS" [2] | Confirmed on the ATRS hub [3]; the public repository lists 152 records total across the whole scheme [4] | Holds on paper, thin in practice |
| LLMs "may hallucinate ... for unexpected reasons" [2] | The word "hallucinate" is hyperlinked to the AI Playbook's landing page, which does not define or explain hallucination [9] | Fails on sourcing |
| Run workshops using "the Model for Responsible Innovation", created by "the Department for Science, Innovation and Technology (DSIT)" [2] | DSIT's own GOV.UK page confirms it is "being replaced" by three successor departments, a change dated 15 July 2026 [5] [6] | Stale since the document's last edit |
| Check "the Responsible Handover Framework" for supplier handovers [2] | The actual document is titled "Responsible Handover of AI", published by the charity Sense about Science with the IET and Wellcome, not a government framework [7] | Fails on attribution |
| Consult "the AI Testing and Assurance Framework for Public Sector" [2] for post-deployment testing | Hosted on GitHub Pages, credited only to an informal "Cross Government Testing Community" with no named accountable owner on the page [8] | Weak sourcing for a document about accountability |
The mistakes, counted
The self-assessment link (1). The framework's own instruction to use the Data and AI Ethics Self-Assessment Tool is a hyperlink. It goes to gov.uk/government/publications/data-ethics-framework, the page the reader is already on. The tool itself, an ODT file, sits one click further down that same landing page as a document attachment; the in-text link never reaches it [2].
The hallucination citation (2). In a paragraph explaining why large language models produce confident, false answers, the technical term carrying that claim is linked not to a definition, a research paper or an ICO explainer, but to the landing page of the AI Playbook for the UK Government [2] [9], a document this site has already found to be, in its own words, plausible but wrong.
The Responsible Handover misnomer (3). The framework tells teams buying AI from suppliers to check "the Responsible Handover Framework" for what information a handover needs [2]. No government publication carries that name. The linked document, from the charity Sense about Science, is called "Responsible Handover of AI" [7]. A framework whose first principle is transparency gets the name of its own source wrong.
The stale department (4). The framework directs teams towards "the Model for Responsible Innovation ... created by the Department for Science, Innovation and Technology (DSIT)" [2]. DSIT's GOV.UK organisation page now opens with a notice that it is changing and "being replaced by the Department for Business, Innovation, Science and Trade, the Department for Digital, Culture, Media and Sport and the Cabinet Office", dated 15 July 2026 [5]. The framework was last updated 18 December 2025, seven months earlier, and has not been touched since.
The unaccountable testing standard (5). For post-deployment monitoring, the framework recommends "the AI Testing and Assurance Framework for Public Sector" [2], hosted not on GOV.UK, NCSC or any department domain but on GitHub Pages, credited to a "Cross Government Testing Community" that names no lead department, no senior owner and no contact route on the page itself [8]. The Accountability section of this same framework requires exactly that of every project it governs.
What the framework gets right
The count above is not the whole document. The privacy section correctly threads UK GDPR, the Data Protection Act 2018 and the newer Data (Use and Access) Act 2025 together, linking the Data Protection Act to its actual enacted text on legislation.gov.uk rather than a summary [10]. The fairness section names the Equality Act 2010 and the Public Sector Equality Duty correctly and links to live EHRC guidance rather than paraphrasing it. The environmental sustainability principle, new in this edition, is unusually specific for a government ethics document: it names real measurement tools, CodeCarbon, ML CO2 Impact, the Hugging Face open LLM leaderboard, rather than gesturing at green AI in the abstract. And the framework has now been substantively rewritten three times in seven years, 2018, 2020 and 2025, each time in response to how the technology actually changed, which is more revision discipline than most guidance in this genre gets.
Verdict
Three stars, from five documented mistakes across a genuinely detailed document. The structural finding is not one of the five and is not scored: every principle in this framework, transparency, accountability, fairness, comes with a list of things a team "must" do, and every one of those obligations is discharged by the team marking its own homework. The Algorithmic Transparency Recording Standard is the framework's one external-facing accountability mechanism, and it is real, but 152 published records is a thin count for a requirement that has applied across central government since 2022 [4]. A framework that tells teams to "establish mechanisms for independent reviews of your project" [2] has no independent review of its own.
The star score counts five documented mistakes: the self-referential self-assessment link, the hallucination citation pointing to an unrelated landing page, the Responsible Handover Framework misnomer, the stale DSIT attribution, and the unaccountable GitHub-hosted testing standard. Five falls in the 4 to 9 band: three stars; the bands are on the ratings page. The low ATRS record count is a system-wide accountability finding, not a drafting error in this framework, and is not counted. Analysis is of the HTML edition as fetched on 12 September 2026, reflecting the 18 December 2025 update. The document is tracked in the Daily Register; a revision will get a diff entry.
Sources
- GOV.UK publication page, "Data and AI Ethics Framework" (update history: 13 June 2018, 30 August 2018, 16 September 2020, 18 December 2025). https://www.gov.uk/government/publications/data-ethics-framework
- "Data and AI Ethics Framework", HTML edition, updated 18 December 2025 (all quoted framework text unless noted). https://www.gov.uk/government/publications/data-ethics-framework/data-and-ai-ethics-framework
- GOV.UK, "Algorithmic Transparency Recording Standard Hub" (confirms mandatory scope for central government departments and qualifying arm's length bodies). https://www.gov.uk/government/collections/algorithmic-transparency-recording-standard-hub
- GOV.UK, "Algorithmic transparency records" repository (152 records, checked 12 September 2026). https://www.gov.uk/algorithmic-transparency-records
- GOV.UK organisation page for DSIT (carries the notice that the department is being replaced, dated 15 July 2026). https://www.gov.uk/government/organisations/department-for-science-innovation-and-technology
- The Register, "UK.gov's tech department gets the chop after two years" (21 July 2026). https://www.theregister.com/public-sector/2026/07/21/ukgovs-tech-department-gets-the-chop-after-two-years/5275573
- Sense about Science, Institution of Engineering and Technology and Wellcome, "Responsible Handover of AI". https://senseaboutscience.org/responsible-handover-of-ai/
- Cross Government Testing Community, "AI Testing and Assurance Framework for Public Sector". https://testing-ai-standards.github.io/cross-gov-ai-testing-framework/
- GOV.UK, "AI Playbook for the UK Government" publication page (the page hyperlinked from the word "hallucinate"). https://www.gov.uk/government/publications/ai-playbook-for-the-uk-government
- legislation.gov.uk, Data Protection Act 2018, enacted text. https://www.legislation.gov.uk/ukpga/2018/12/contents/enacted