Search Algorithms Responsible for Exhibiting and Amplifying Gender Bias, Study Says

Technology experts have expressed concern that algorithms used by modern AI systems produce discriminatory outputs.

Search Algorithms Responsible for Exhibiting and Amplifying Gender Bias, Study Says

Photo Credit: Pexels/ Sharon McCutcheon

Certain 1950s ideas about gender are actually still embedded in our database systems

Highlights
  • Algorithms used by modern AI systems produce discriminatory outputs
  • The results suggest cycle of bias propagation between society, AI, users
  • The research was conducted using a VPN-based Internet search methodology
Advertisement

As per a new research, algorithms are quite responsible for exhibiting and amplifying gender bias.
The work, which appeared in the journal Proceedings of the National Academy of Sciences (PNAS), is among the latest to uncover how artificial intelligence (AI) can alter our perceptions and actions.

"There is increasing concern that algorithms used by modern AI systems produce discriminatory outputs, presumably because they are trained on data in which societal biases are embedded," said Madalina Vlasceanu, a postdoctoral fellow in New York University's Department of Psychology and the paper's lead author.

"As a consequence, their use by humans may result in the propagation, rather than reduction, of existing disparities," Madalina added.

"These findings call for a model of ethical AI that combines human psychology with computational and sociological approaches to illuminate the formation, operation, and mitigation of algorithmic bias," author David Amodio, a professor in NYU's Department of Psychology and the University of Amsterdam shared.

Technology experts have expressed concern that algorithms used by modern AI systems produce discriminatory outputs, presumably because they are trained on data in which societal biases are ingrained.

"Certain 1950s ideas about gender are actually still embedded in our database systems," Meredith Broussard, author of Artificial Unintelligence: How Computers Misunderstand the World and a professor at NYU's Arthur L. Carter Journalism Institute, told the Markup earlier this year.

Researchers performed Google image searches for the gender-neutral term "person" in different countries in two analyses - one involving 37 countries and another involving 52 countries - in the countries' dominant language and found that in countries with higher gender inequality, the first 100 search results contained more photos of men-presenting individuals than women-presenting individuals; in a further experiment, when participants in the United States were shown Google image search results for unfamiliar job titles that included more men than women, they were more likely to state that they would hire a man to do the job, suggesting that gender inequality is mirrored in internet search algorithms and can lead to biased decision-making, according to the authors.

"These results suggest a cycle of bias propagation between society, AI, and users," Vlasceanu and Amodio wrote, adding that the "findings demonstrate that societal levels of inequality are evident in internet search algorithms and that exposure to this algorithmic output can lead human users to think and potentially act in ways that reinforce the societal inequality."

It is notable that this research was conducted using a VPN-based Internet search methodology. This approach allowed researchers to probe international differences in internet search algorithm function with low financial and administrative costs. However, national VPN access varies, such that it may be banned, obstructed, or otherwise unavailable in many locations (43) and thus may not provide an exhaustive international assessment. Nevertheless, this method provided them with access to 58 nations spanning six continents, with sufficient variability in national gender inequality to permit a valid test of our hypothesis.


Noise co-founder Amit Khatri joins Orbital, the Gadgets 360 podcast, for a special episode. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.
Affiliate links may be automatically generated - see our ethics statement for details.
Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Gender bias, Ethical AI
Binance Reportedly Services Users in Iran Despite US Sanctions: Report
Honor X40i With MediaTek Dimensity 700 SoC, 50-Megapixel Main Camera Launched: Price, Specifications
Facebook Gadgets360 Twitter Share Tweet Snapchat LinkedIn Reddit Comment google-newsGoogle News

Advertisement

Follow Us
© Copyright Red Pixels Ventures Limited 2024. All rights reserved.
Trending Products »
Latest Tech News »