Russian startup is building a controversial ‘ethnicity-detecting’ AI

A startup from Russia is building an AI which uses facial recognition to determine ethnicity, prompting fears it could be used for automated racial profiling.

NtechLab lists ‘ethnicity detection’ as an upcoming feature of its solution. The algorithm promises the ability to examine people and determine their ethnicity. An image, which has since been pulled as the result of backlash, showed classifications of people including ‘European’, ‘African’, and ‘Arabic’.

The company is full of award-winning talent and the accuracy of NtechLab’s system has even been independently verified and lauded by theU.S. Department of Commerce andthe University of Washington. It powers Moscow’s ~170,000 surveillance cameras and the app FindFace, which identified random strangers with 70 percent accuracy back in 2017.

While detecting ethnicity is ripe for abuse and causing offence, there are some genuine use cases. In health, for example, some medicines are targeted at specific ethnic clusters which are shown to have a propensity for a certain disorder.

As foundon Wikipedia:

“The first example of this in the U.S. was when BiDil, a medication for congestive heart failure, was licensed specifically for use in American patients that self-identify as black. Previous studies had shown that African American patients with congestive heart failure generally respond less effectively to traditional treatments than white patients with similar conditions.”

Although not the first to promote an ethnicity detection feature, NtechLab is receiving a lot more scrutiny. This is most likely due to an increased awareness of the problem of racial profiling.

Many privacy advocates, such as the American Civil Liberties Union, are against facial recognition at any level. It’s widely used in nations such as China but in the more privacy-conscious West it remains fairly taboo. Adding the ability to detect people’s ethnic background feels even more Orwellian.

Back in April 2017, former ImageNet competition winner Matthew Zeiler launched an API called ‘Demographics’ as part ofClarifai which also identified ‘multicultural appearance’.

In ablog post, Zeiler admitted the feature could be used maliciously but “it’s not our business to limit what developers create and we choose to believe that most people will use our Demographics for good – like bringing attention tofemale representation in tech, or bringing an end tohuman trafficking.”

Call me a cynic, but I don’t believe any of these solutions will be mostly used for good.

What are your thoughts on ethnicity-detecting facial recognition? Let us know in the comments.

 Interested in hearing industry leaders discuss subjects like this and sharing their use-cases? Attend the co-located AI & Big Data Expo events with upcoming shows in Silicon Valley, London and Amsterdam to learn more. Co-located with the  IoT Tech Expo, Blockchain Expo and Cyber Security & Cloud Expo so you can explore the future of enterprise technology in one place.

Leave a Reply

Your email address will not be published. Required fields are marked *