Deloitte refunded the Australian government after its own AI tool fabricated citations in a $440k policy report
Deloitte Australia / Department of Employment and Workplace Relations (DEWR)·an in-house generative AI tool chain (Azure OpenAI GPT-4o) used to draft the report
Deloitte used a generative AI large language model tool chain licensed by DEWR to help write an independent assurance review of the government's welfare compliance IT system, and the resulting report contained fabricated academic references, an invented quote attributed to a Federal Court judgment in the robo-debt case, and citations to papers that do not exist.
- Blast radius
- A university academic found over a dozen fabricated citations and quotes in the published report; Deloitte had to reissue corrected versions twice and partially refund the Australian government $440,000 (AUD) contract fee.
- Root cause
- AI-generated content in a client deliverable was not verified against real sources before publication and sign-off.
- How it was caught
- An external academic, Chris Rudge of the University of Sydney, spotted the fake citations after the report was already published, not through Deloitte's own review.
- What changed
- Deloitte reissued a corrected version of the report and settled the matter with the client via a partial refund; DEWR said the report's substantive recommendations were unchanged.
Take-awayNever publish an AI-assisted deliverable to a client without independently verifying every citation and quotation against the primary source.
First surfaced: Press · Recorded