Google apologises after Gemini AI generates images of Nazis as people of colour

The company has paused the tool after it was found to be creating historically inaccurate images.
By Sam Haysom  on 
A close-up of a smartphone shows a finger about to touch the Gemini app.
Credit: Jonathan Raa/NurPhoto via Getty Images

Google has paused its Gemini AI tool (formerly Bard)'s ability to generate images of people. The company also issued an apology after the tool was found to be generating historically inaccurate illustrations, including depictions of Nazi soldiers as people of colour.

As reported by The Verge, a number of different prompts led to the bot responding with historical inaccuracies. People of colour were reportedly shown in illustrations offered for queries about German soldiers in 1943, as well as requests to show U.S. Senators in the 1800s.

"We're already working to address recent issues with Gemini's image generation feature," said Google on X. "While we do this, we're going to pause the image generation of people and will re-release an improved version soon."

Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

In an earlier statement, Google had confirmed that Gemini's AI image generation generates a wide range of people.

"That's generally a good thing because people around the world use it," Google said. "But it's missing the mark here."

AI image generators have been found to perpetuate racist stereotypes, and one of Google's AI principles is to "avoid creating or reinforcing unfair bias." But as Jack Krawczyk, who works on Gemini, pointed out on X, "historical contexts have more nuance to them."

"As part of our AI principles we design our image generation capabilities to reflect our global user base, and we take representation and bias seriously," Krawzyk wrote. "We will continue to do this for open ended prompts."

Mashable Image
Sam Haysom

Sam Haysom is the Deputy UK Editor for Mashable. He covers entertainment and online culture, and writes horror fiction in his spare time.


Recommended For You
Google's AI model just got faster with Gemini 1.5 Flash
Gemini 1.5 Pro

You can play 'Tic-Tac-Toe' with your face: 5 wild AI features coming to Gemini-powered Chromebooks
Google rep playing Tic-Tac-Toe with his face

Gemini Nano can detect scam calls for you
Google Gemini Nano


Google pulls 'Dear Sydney' Gemini AI ad after online backlash
Gemini Ai is seen on a phone

Trending on Mashable
NYT Connections today: See hints and answers for August 2
A phone displaying the New York Times game 'Connections.'


NYT Connections today: See hints and answers for August 3
A phone displaying the New York Times game 'Connections.'


Android users, beware! Text message stealing malware is targeting smartphones to gain access to users' data
Android logo on smartphone
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!