Police in England installed an AI camera system along a major road. It caught almost 300 drivers in its first 3 days.::An AI camera system installed along a major road in England caught 300 offenses in its first 3 days.There were 180 seat belt offenses and 117 mobile phone
Nobody cares about false negatives. As long as the number isn’t something so massive that the system is completely useless false negatives in an automatic system are not a problem.
What are the false positives? Every single false positive is a gross injustice. If you can’t come up with a number for that, then you haven’t even evaluated your system.
The system works with AI signaling phone usage by driving.
Then a human will verify the photo.
AI is used to respect people’s privacy.
The combination of the AI detection+human review leads to a 95% false negative rate, and most probably 0% false positive.
This means that the AI missed at most 5% positives, but probably less because of the human reviewer not being 100% sure there was an offense.
Look, I’m not saying it’s a bad system. Maybe it’s great. “Most probably 0%” is meaningless though. If all you’ve got is gut feelings about it, then you don’t know anything about it. Humans make mistakes in the best of circumstances, and they get way, way worse when you’re telling them that they’re evaluating something that’s already pretty reliable. You need to know it’s not giving false positive, not have a warm fuzzy feeling about it.
Again, I don’t know if someone else has already done that. Maybe they have. I don’t live in the Netherlands. I don’t trust it until I see the numbers that matter though, and the more numbers that don’t matter I see without the ones that do, the less I trust it.