Black students sue after AI mistakes Doritos bag for gun
Four Black high school students in Baltimore County have filed a lawsuit after an AI weapon-detection system used in their school mistook a bag of chips for a gun, leading to their detention and search. According to the report, the incident occurred in October 2025 at Kenwood High School, where the Omnilert Gun Detect system flagged a student's bag of Doritos as a firearm with 90% probability. The alert continued even after school staff and police reviewed the image and determined it was a mistake; although the alert was canceled, armed police were dispatched anyway. The students were ordered to their knees, handcuffed, and searched just steps from their school's entrance.
The lawsuit was filed against Omnilert, LLC, Baltimore County Public Schools, the Baltimore County Police Department, and individual officers. According to a statement from the Lawyers' Committee for Civil Rights Under Law, school officials knew the system regularly produced false alerts but failed to take adequate precautions. The report says that while school and police officials canceled the alert, armed police were still sent because there were insufficient protocols to prevent canceled alerts from triggering armed responses.
Damon Hewitt, president and executive director of the Lawyers' Committee, said, "These students were failed not only by a technology that is prone to false alerts, but also by the very adults meant to keep them safe." He added that overreliance on AI combined with poor communication among officials is a toxic mix. The lawsuit seeks to reform local police and school procedures to prevent similar incidents.
The incident highlights the potential consequences of unregulated AI-powered security systems. Freida Winfield, the mother of one of the students, said police told her son "this could have been a real problem," and that no child should face such danger while waiting outside school.