DOCUMENTS SHOW IBM PITCHED THE NYPD FACIAL RECOGNITION SOFTWARE WITH BUILT-IN RACIAL PROFILING OPTIONS

SOURCE: TECH DIRT

Documents obtained by The Intercept show the NYPD and IBM engaged in a long-running facial recognition tech partnership from .... While some of this deployment was discussed publicly, details about the extent of the program -- as well as it's more problematic elements -- haven't been.

As the article's title informs the reader, camera footage could be scanned for face matches using skin tone as a search constraint. Considering this was pushed by IBM as a tool to prevent the next 9/11, it's easy to see why the NYPD -- given its history of surveilling Muslim New Yorkers -- might be willing to utilize a tool like this to pare down lists of suspects to just the people it suspected all along (Muslims).

There are a number of surprises contained in the long, detailed article, but the first thing that jumps out is IBM's efforts and statements, rather than the NYPD's. We all know the government capitalizes on tragedies to expand its power, but here we see a private corporation appealing to this base nature to make a sale.

In New York, the terrorist threat “was an easy selling point,” recalled Jonathan Connell, an IBM researcher who worked on the initial NYPD video analytics installation. “You say, ‘Look what the terrorists did before, they could come back, so you give us some money and we’ll put a camera there.”

From this pitch sprung an 8-year program -- deployed in secrecy by the NYPD to gather as much footage as possible of New Yorkers for dual purposes: its own law enforcement needs and to serve as a testing ground for IBM's new facial recognition tech. Needless to say, New Yorkers were never made aware of their lab rat status in IBM's software development process.

Even though the software could search by skin tone (as well as by "head color," age, gender, and facial hair), the NYPD claims it never used that feature in a live environment, despite IBM's urging.

According to the NYPD, counterterrorism personnel accessed IBM’s bodily search feature capabilities only for evaluation purposes, and they were accessible only to a handful of counterterrorism personnel. “While tools that featured either racial or skin tone search capabilities were offered to the NYPD, they were explicitly declined by the NYPD,” Donald, the NYPD spokesperson, said. “Where such tools came with a test version of the product, the testers were instructed only to test other features (clothing, eyeglasses, etc.), but not to test or use the skin tone feature. That is not because there would have been anything illegal or even improper about testing or using these tools to search in the area of a crime for an image of a suspect that matched a description given by a victim or a witness. It was specifically to avoid even the suggestion or appearance of any kind of technological racial profiling.”

It's easy to disbelieve this statement by the NYPD, given its long history of racial profiling, but it may be those handling the secret program deployment actually understood no program remains secret forever and sought to head off complaints and lawsuits by discouraging use of a controversial search feature. It also may be the NYPD was super-sensitive to these concerns following the partial dismantling of its stop-and-frisk program and the outing of its full-fledged, unconstitutional surveillance of local Muslims.

The thing is IBM is still selling this tech it beta tested live from New York. The same features the NYPD rejected are used to sell other law enforcement agencies on the power of its biometric profiling software.

In 2017, IBM released Intelligent Video Analytics 2.0, a product with a body camera surveillance capability that allows users to detect people captured on camera by “ethnicity” tags, such as “Asian,” “Black,” and “White.”

And there's a counter-narrative that seems to dispute the NYPD's assertions about controversial image tagging features. The IBM researcher who helped develop the skin tone recognition feature is on record stating the company doesn't develop features unless there's a market for them. In his estimation, the NYPD approached IBM to ask for this feature while the 8-year pilot program was still underway. The NYPD may have opted out after the feature went live, but it may have only done so to steer clear of future controversy. An ulterior motive doesn't make it the wrong move, but it also shouldn't be assumed the NYPD has morphed into heroic defenders of civil liberties and personal privacy.

What's available to other law enforcement agencies not similarly concerned about future PR black eyes is "mass racial profiling" at their fingertips. IBM has built a product that appeals to law enforcement's innate desire to automate police work, replacing officers on the street with cameras and software. Sure, there will be some cameras on patrol officers as well, but those are just for show. The real work of policing is done at desks using third-party software that explicitly allows -- if not encourages -- officers to narrow down suspect lists based on race. In a country so overly concerned about terrorism, this is going to lead to a lot of people being approached by law enforcement simply because of their ethnicity.

An additional problem with IBM's software -- and with those produced by competitors -- is a lot of markers used to identify potential suspects can easily net a long list of probables who share nothing but similar body sizes or clothing preferences. Understandably, more work is done by investigators manning these systems before cops start rounding people up, but the potential for inadvertent misuse (never mind actual misuse) is still incredibly high.

The secrecy of these programs is also an issue. Restrictive NDAs go hand-in-hand with private sector partnerships and these are often translated by police officials to mean information must be withheld from judges, criminal defendants, and department oversight. When that happens, due process violations gather atop the privacy violation wreckage until the whole thing collapses under its own audacity. Nothing stays secret forever, but entities like the NYPD and IBM could do themselves a bunch of favors by engaging in a little proactive transparency.

SHARE THIS ARTICLE...

Views: 124

Comment

You need to be a member of 12160 Social Network to add comments!

Join 12160 Social Network

Comment by Burbia on September 10, 2018 at 8:12pm

Then we have Bozos the Amazonian...

Amazon facial recognition kit ‘racist and unreliable’

https://www.thetimes.co.uk/article/amazon-facial-recognition-kit-ra...

Comment by Sweettina2 on September 10, 2018 at 12:50pm

sharing

Comment by Sweettina2 on September 10, 2018 at 12:50pm

I believe it's used way more than we know. I've always heard that by the time they admit to something, its old news and they are much more advanced than what they're showing.

Comment by DTOM on September 10, 2018 at 12:41pm

Considering this was pushed by IBM as a tool to prevent the next 9/11...

Then the NYPD might want to make some (((adjustments)) to their profiling...

"Destroying the New World Order"

TOP CONTENT THIS WEEK

THANK YOU FOR SUPPORTING THE SITE!

mobile page

12160.info/m

12160 Administrators

 

Latest Activity

Doc Vega posted blog posts
6 hours ago
Less Prone commented on Less Prone's photo
Thumbnail

NATO KB FINLAND

"Finland is the next Ukraine with our gungho president who gladly sends the young Finns to die for…"
9 hours ago
Less Prone favorited MAC's video
9 hours ago
cheeki kea posted a photo
10 hours ago
Sandy posted a video

New technology could help save the Colorado River

Cloud seeding is a form of weather modification that can increase rain and snow production by up to 15% and is being used to help the Colorado River recover ...
yesterday
tjdavis commented on MAC's video
yesterday
tjdavis posted a video

“The Stench is Unbearable”: Dead Bodies Piling Up, FEMA Abandons NC Residents Amid Hurricane Helene

CORRECTION: Amanda stated the fire chief of Fairview, North Carolina had sent private helicopters away that were attempting to provide relief to residents. S...
yesterday
tjdavis posted a blog post

Music To bomb By...

".3" - Porcupine Tree…See More
Tuesday
Doc Vega posted blog posts
Tuesday
cheeki kea commented on cheeki kea's photo
Thumbnail

Fast News Incoming...

"I guess the Nord pipeline event will never be 'solved' or strange cuts in fibre optic…"
Tuesday
cheeki kea favorited Doc Vega's blog post The Siege Against America and the West: What’s the Reason?
Tuesday
cheeki kea commented on Less Prone's photo
Thumbnail

NATO KB FINLAND

"Oh wow this is an outrage and why does Sweden get to crown themselves to leaders of the pack? Their…"
Tuesday
cheeki kea commented on Doc Vega's blog post The World of Cancer Research and Abandoning True Cures!
"More good nicotine news, anyone notice the better it gets the harder the govt. persist in…"
Tuesday
tjdavis posted a video

Stephen Stills - Sounding Out (1970)

1970's profile of Stephen Stills. By the end of the 1960s, Stephen Stills had written one of the decade's most successful protest songs, played a central rol...
Tuesday
Dave Svoboda favorited truth's blog post Site Help & Tips -
Tuesday
Doc Vega commented on Doc Vega's blog post The World of Cancer Research and Abandoning True Cures!
"Thank you! "
Monday
Doc Vega favorited Doc Vega's blog post The World of Cancer Research and Abandoning True Cures!
Monday
tjdavis posted blog posts
Monday
Doc Vega posted blog posts
Sunday
Less Prone commented on Less Prone's photo
Thumbnail

NATO KB FINLAND

"Link to Ukrainian Military News Site "Stubb added that since the Middle Ages, the Finnish…"
Sunday

© 2024   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2019 - all rights reserved. unless otherwise noted