futurism.com
Generated Police Report Claimed Officer Transformed Into Frog
The police department in Heber City, Utah, was forced to explain why a police report software declared that an officer had somehow shapeshifted into a frog. As Salt Lake City-based Fox 13 reports, the flawed tool seems to have picked up on some unrelated background chatter to devise its fantastical fairy tale ending. “The body cam software and the AI report writing software picked up on the movie that was playing in the background, which happened to be ‘The Princess and the Frog,'” police sergeant Rick Keel told the broadcaster, referring to Disney’s 2009 musical comedy. “That’s when we learned the importance of correcting these AI-generated reports.” The department had begun testing an AI-powered software called Draft One to automatically generate police reports from body camera footage. The goal was to reduce the amount of paperwork — but considering that immense mistakes are falling through the cracks, results clearly vary. Draft One was first announced by police tech company Axon — the same firm behind the Taser, a popular electroshock weapon — last year. The software makes use of OpenAI’s GPT large language models to generate entire police reports from body camera audio. Experts quickly warned that hallucinations could fall through the cracks in these important documents. Critics also argue that the tool could be used to introduce deniability and make officers less accountable in case mistakes were to fall through the cracks.
Note: For more along these lines, read our concise summaries of news articles on AI and police corruption.
- Futurism