DOCUMENTS SHOW IBM PITCHED THE NYPD FACIAL RECOGNITION SOFTWARE WITH BUILT-IN RACIAL PROFILING OPTIONS

SOURCE: TECH DIRT

Documents obtained by The Intercept show the NYPD and IBM engaged in a long-running facial recognition tech partnership from .... While some of this deployment was discussed publicly, details about the extent of the program -- as well as it's more problematic elements -- haven't been.

As the article's title informs the reader, camera footage could be scanned for face matches using skin tone as a search constraint. Considering this was pushed by IBM as a tool to prevent the next 9/11, it's easy to see why the NYPD -- given its history of surveilling Muslim New Yorkers -- might be willing to utilize a tool like this to pare down lists of suspects to just the people it suspected all along (Muslims).

There are a number of surprises contained in the long, detailed article, but the first thing that jumps out is IBM's efforts and statements, rather than the NYPD's. We all know the government capitalizes on tragedies to expand its power, but here we see a private corporation appealing to this base nature to make a sale.

In New York, the terrorist threat “was an easy selling point,” recalled Jonathan Connell, an IBM researcher who worked on the initial NYPD video analytics installation. “You say, ‘Look what the terrorists did before, they could come back, so you give us some money and we’ll put a camera there.”

From this pitch sprung an 8-year program -- deployed in secrecy by the NYPD to gather as much footage as possible of New Yorkers for dual purposes: its own law enforcement needs and to serve as a testing ground for IBM's new facial recognition tech. Needless to say, New Yorkers were never made aware of their lab rat status in IBM's software development process.

Even though the software could search by skin tone (as well as by "head color," age, gender, and facial hair), the NYPD claims it never used that feature in a live environment, despite IBM's urging.

According to the NYPD, counterterrorism personnel accessed IBM’s bodily search feature capabilities only for evaluation purposes, and they were accessible only to a handful of counterterrorism personnel. “While tools that featured either racial or skin tone search capabilities were offered to the NYPD, they were explicitly declined by the NYPD,” Donald, the NYPD spokesperson, said. “Where such tools came with a test version of the product, the testers were instructed only to test other features (clothing, eyeglasses, etc.), but not to test or use the skin tone feature. That is not because there would have been anything illegal or even improper about testing or using these tools to search in the area of a crime for an image of a suspect that matched a description given by a victim or a witness. It was specifically to avoid even the suggestion or appearance of any kind of technological racial profiling.”

It's easy to disbelieve this statement by the NYPD, given its long history of racial profiling, but it may be those handling the secret program deployment actually understood no program remains secret forever and sought to head off complaints and lawsuits by discouraging use of a controversial search feature. It also may be the NYPD was super-sensitive to these concerns following the partial dismantling of its stop-and-frisk program and the outing of its full-fledged, unconstitutional surveillance of local Muslims.

The thing is IBM is still selling this tech it beta tested live from New York. The same features the NYPD rejected are used to sell other law enforcement agencies on the power of its biometric profiling software.

In 2017, IBM released Intelligent Video Analytics 2.0, a product with a body camera surveillance capability that allows users to detect people captured on camera by “ethnicity” tags, such as “Asian,” “Black,” and “White.”

And there's a counter-narrative that seems to dispute the NYPD's assertions about controversial image tagging features. The IBM researcher who helped develop the skin tone recognition feature is on record stating the company doesn't develop features unless there's a market for them. In his estimation, the NYPD approached IBM to ask for this feature while the 8-year pilot program was still underway. The NYPD may have opted out after the feature went live, but it may have only done so to steer clear of future controversy. An ulterior motive doesn't make it the wrong move, but it also shouldn't be assumed the NYPD has morphed into heroic defenders of civil liberties and personal privacy.

What's available to other law enforcement agencies not similarly concerned about future PR black eyes is "mass racial profiling" at their fingertips. IBM has built a product that appeals to law enforcement's innate desire to automate police work, replacing officers on the street with cameras and software. Sure, there will be some cameras on patrol officers as well, but those are just for show. The real work of policing is done at desks using third-party software that explicitly allows -- if not encourages -- officers to narrow down suspect lists based on race. In a country so overly concerned about terrorism, this is going to lead to a lot of people being approached by law enforcement simply because of their ethnicity.

An additional problem with IBM's software -- and with those produced by competitors -- is a lot of markers used to identify potential suspects can easily net a long list of probables who share nothing but similar body sizes or clothing preferences. Understandably, more work is done by investigators manning these systems before cops start rounding people up, but the potential for inadvertent misuse (never mind actual misuse) is still incredibly high.

The secrecy of these programs is also an issue. Restrictive NDAs go hand-in-hand with private sector partnerships and these are often translated by police officials to mean information must be withheld from judges, criminal defendants, and department oversight. When that happens, due process violations gather atop the privacy violation wreckage until the whole thing collapses under its own audacity. Nothing stays secret forever, but entities like the NYPD and IBM could do themselves a bunch of favors by engaging in a little proactive transparency.

SHARE THIS ARTICLE...

Views: 56

Comment

You need to be a member of 12160 Social Network to add comments!

Join 12160 Social Network

Comment by Burbia on September 10, 2018 at 8:12pm

Then we have Bozos the Amazonian...

Amazon facial recognition kit ‘racist and unreliable’

https://www.thetimes.co.uk/article/amazon-facial-recognition-kit-ra...

Comment by Sweettina2 on September 10, 2018 at 12:50pm

sharing

Comment by Sweettina2 on September 10, 2018 at 12:50pm

I believe it's used way more than we know. I've always heard that by the time they admit to something, its old news and they are much more advanced than what they're showing.

Comment by DTOM on September 10, 2018 at 12:41pm

Considering this was pushed by IBM as a tool to prevent the next 9/11...

Then the NYPD might want to make some (((adjustments)) to their profiling...

Latest Activity

Diana commented on Old Denmark's video
Thumbnail

SPECIAL FORCES RAID VIA BLACKHAWK HELOS ON BIOLOGICAL WEAPON DOWNTOWN LOS ANGELES

"Notice Wells Fargo in the video.  Don't know if this is connected, but I thought the timing was interesting. Military Operations Involving Wells Fargo Followed By Outages. What is Going On?…"
20 minutes ago
Diana favorited Old Denmark's video
50 minutes ago
Less Prone favorited Old Denmark's video
51 minutes ago
Diana favorited Central Scrutinizer's blog post CONSPIRACY RESEARCHER DAVID ICKE BANNED FROM SPEAKING IN AUSTRALIA
53 minutes ago
Diana commented on Central Scrutinizer's blog post CONSPIRACY RESEARCHER DAVID ICKE BANNED FROM SPEAKING IN AUSTRALIA
"It's not the "lizard people" that's the problem: "David Icke, a well-known British holocaust denier, should not be allowed entry into Australia to preach his toxic message," he told parliament. Watts…"
53 minutes ago
Diana favorited Central Scrutinizer's blog post The Final Version of the EU's Copyright Directive Is the Worst One Yet
1 hour ago
Diana posted photos
1 hour ago
Diana commented on Raz Putin's blog post NY Times busted using a November 2018 photo of Ruth Bader Ginsberg in recent article claiming she is back to work at SCOTUS.
1 hour ago
Old Denmark posted videos
2 hours ago
Thomas Less posted a blog post

Daily Verse

We give thanks to you, O God, we give thanks, for your Name is near; men tell of your wonderful deeds. — Psalm 75:1See More
2 hours ago
Deep Space posted videos
4 hours ago
Central Scrutinizer posted blog posts
5 hours ago
Central Scrutinizer favorited Chris of the family Masters's discussion Very interesting FOR THOSE WHO THINK USA IS A FREE COUNTRY
5 hours ago
Central Scrutinizer replied to Central Scrutinizer's discussion A Hot Time in the Ol Town Tonight
"Truly want to Thank Each & All here who's expressed or shared their concerns, thoughts and well wishes for .....the Dog ;)  For those inquiring minds, all's well, not even any smoke damage, & burning a fire @ the moment ,…"
5 hours ago
Central Scrutinizer commented on DTOM's group High Strangeness & General Weirdness
"Diner dies after having 'poisonous'   mushrooms at Michelin-starred eatery"
6 hours ago
Chris of the family Masters commented on Chris of the family Masters's blog post person (n.)
"In the nutshell, IBM is a person. WILLIAM BROWN is a person. William Brown is a man."
7 hours ago

Please remember this website is supported by your donations...

© 2019   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2015 - all rights reserved. unless otherwise noted