Welp. Turns out AI learns gender and race stereotypes from humans.

Computers know us a little too well.
 By 
Rebecca Ruiz
 on 
Welp. Turns out AI learns gender and race stereotypes from humans.
Human resources, CRM, market segmentation and social media concept - officer looking for employee represented by icon.; Shutterstock ID 514850650; PO: AI bias; Job: Rebecca Ruiz; Client: Mashable Credit: Shutterstock / Jirsak

When humans teach computers how to behave, the machines have no choice but to learn from us.

That much is clear in a new study published Thursday in the journal Science that found artificial intelligence replicates the same gender and racial stereotypes we already struggle to control.

That finding, while not entirely surprising, suggests that AI might accidentally perpetuate bias instead of simply streamlining data analysis and work tasks.

To reveal this troubling dynamic, the researchers used off-the-shelf AI and developed an algorithm to determine how it associated pairs of words. The AI generated by machine learning was based on a recent large-scale crawl of the web that captured the complexity of the English language.

Then the researchers turned to what's known as an Implicit Association Test, a scientific measure of the unconscious connections people rapidly make between, say, a person's gender and their career, or a person's name, race, and likability. No matter how much we insist we're not racist, sexist or homophobic, years of research using the IAT show that we hold biases, often without realizing it.

In order to see whether the AI associated neutral words with biases, the researchers first used an IAT about whether flowers and insects were pleasant or unpleasant. The AI responded how most people would: flowers were likable, insects not so much.

Via Giphy

Then they moved on to IATs related to stereotypes we have of certain groups of people. A previous experiment using resumes of the same quality but featuring either European-American names and African-American names found that people in the former group were twice as likely to get called for an interview. When the researchers conducting this study tried to replicate those results with the same database of names and tested for an association with pleasantness or unpleasantness, the European-American names were viewed more favorably by the AI.

"It was a disturbing finding to see just by names we are able to replicate the stereotypes."

"It was a disturbing finding to see just by names we are able to replicate the stereotypes," says Aylin Caliskan, the study's lead author and a postdoctoral researcher at Princeton University's Center for Information Technology Policy.

A different study from 2002 found that female names were more associated with family than career words, but that wasn't the case for male names.

You can probably see where this is going.

The AI once again replicated those results, among others, showing that female words like "woman" and "girl" are more associated than male words with the arts versus mathematics or the sciences.

The findings shed light on a maddening chicken or egg problem: Do humans put their biases into language or do we learn them through language? Caliskan can't conclusively answer this question — yet.

"We are suggesting that instead of trying to remove bias from the machine, [we should] put a human in the loop to help the machine make the right decision," she says.

That, of course, requires a human who is aware of his or her own tendency to stereotype.

Via Giphy

Kate Ratliff, executive director of Project Implicit and an assistant professor in the department of psychology at the University of Florida, says it's currently unrealistic to try to eradicate biases because there's no empirical evidence that it's possible. After all, our language, culture, entertainment, and politics are rife with stereotypes that keep reinforcing the associations we're trying to reject.

"Maybe you could train people to spot these biases and override them," says Ratliff, who was not involved in the Science study.

Indeed, that's what many companies, including Facebook, are attempting to do through employee trainings. And that's exactly the kind of skill and self-awareness you'd need in a human charged with preventing a computer from stereotyping a stranger.

Those human-machine matches will no doubt make quite the pair.

Rebecca Ruiz
Rebecca Ruiz
Senior Reporter

Rebecca Ruiz is a Senior Reporter at Mashable. She frequently covers mental health, digital culture, and technology. Her areas of expertise include suicide prevention, screen use and mental health, parenting, youth well-being, and meditation and mindfulness. Rebecca's experience prior to Mashable includes working as a staff writer, reporter, and editor at NBC News Digital and as a staff writer at Forbes. Rebecca has a B.A. from Sarah Lawrence College and a masters degree from U.C. Berkeley's Graduate School of Journalism.

Mashable Potato

Recommended For You
'Scarlet' review: Mamoru Hosoda's latest is the craziest 'Hamlet' adaptation you'll ever see
Princess Scarlet floats upward through water in "Scarlet."

You need to watch this very good dog interrupt the women's Olympic ski race
A dog wanders on the ski trail during the women's team cross country free sprint qualification event of the Milano Cortina 2026 Winter Olympic Games

JBL Endurance Race 2 earbuds have hit a record-low price at Amazon — save over $30
jbl endurance race 2 earbuds against an orange and blue patterned background

'Bridgerton' author Julia Quinn on Benophie, gender flipping, and the 'yearnaissance'
A collage of images related to 'Bridgerton' surround a portrait of the author Julia Quinn.

Jamie Dornan loses out on a Bond audition in 'SNL UK' promo
A man sits on a studio stage, frowning.

Trending on Mashable
NYT Connections hints today: Clues, answers for April 3, 2026
Connections game on a smartphone

Wordle today: Answer, hints for April 3, 2026
Wordle game on a smartphone


NYT Connections hints today: Clues, answers for April 2, 2026
Connections game on a smartphone

You can track Artemis II in real time as Orion flies to the moon
Victor Glover and Reid Wiseman piloting the Orion spacecraft
The biggest stories of the day delivered to your inbox.
These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up. See you at your inbox!