DWP's automated risk-scoring algorithm wrongly flagged 200,000 people for benefit fraud

UK Department for Work and Pensions·DWP automated risk-scoring algorithm for housing benefit claims

DWP's automated risk-scoring algorithm flagged over 200,000 housing benefit claims as high risk for fraud or error and triggered investigations, even though roughly two-thirds of the flagged claims turned out to be legitimate.

Blast radius

Hundreds of thousands of claimants were put through unnecessary fraud investigations and stress, and public funds and investigator time were wasted chasing false positives, despite the algorithm having shown initial success in a pilot before real-world deployment.

Root cause

The model's real-world performance fell far short of its pilot results once scaled to the full claimant population, reflecting overreliance on an automated system in welfare administration.

How it was caught

Surfaced through investigative reporting on DWP's fraud-detection performance, not through internal DWP disclosure.

What changed

Not disclosed in available sources; DWP's wider use of AI in benefits decisions has remained under continued scrutiny, including a later DWP 'fairness analysis' that found bias in a related fraud-detection system.

Take-awayA fraud-detection model's pilot accuracy does not predict its real-world false-positive rate at national scale — validate continuously after rollout, not just before it.