However, facial recognition technology is far from perfect and comes with unintended racial and gender biases baked directly into the computer code. The effectiveness of technologies like facial recognition has in the past been vastly overestimated by the local officials tasked with putting them to use. The FBI’s facial recognition systems are reportedly inaccurate in roughly 15% of cases and more often misidentify black people than whites. And Amazon’s facial recognition software misidentified 28 members of Congress as criminals.

This sort of technology is just the beginning, which alarms privacy advocates. While Huntington Park’s disclosures make no mention of it, some cities deploy systems that augment facial recognition and license plate reader data with “predictive policing” software—something the ACLU finds deeply troubling from a civil liberties perspective.

Manufacturers claim AI-powered predictive policing systems have the ability to forecast potential trouble spots, allowing police departments to more efficiently allocate resources. This, of course, doesn’t mean the technology can pinpoint crimes that will happen at specific times and specific locations. Yet, as Quartz recently reported, the city of Lancaster, California is currently working with IBM on a predictive policing initiative that officials believe can do something it definitely cannot.

“With machine learning, with automation, there’s a 99% success, so that robot is—will be—99% accurate in telling us what is going to happen next, which is really interesting,” a Lancaster official told mayor R. Rex Parris during a March 26 city council meeting.

“Well, why aren’t we mounting .50-calibers [out there]?” Parris replied, referring to a powerful rifle used by military snipers, before explaining that he was just “being facetious.”

Huntington Park’s K5 has been in use since June, with the three-year contract up for review after 12 months. Projected costs were $6,000 per month, but the city’s police department is currently paying $8,000. Invoices reviewed by MuckRock include a reimbursement of $1,066 issued to Huntington Park by Knightscope for four days of downtime in June.

📬 Sign up for the Daily Brief

Our free, fast, and fun briefing on the global economy, delivered every weekday morning.