‘This is scary’: Woman says Canva’s AI is ‘racist’ after asking for photos of kids in ankle monitors
Canva's AI is being accused of racism after one of its users asked for kids in ankle monitors. Allegedly, the bot only produced images of Black boys.
TikToker Bellanoche (@Bella_noche_) took to social media to call out the company in a now-viral video that has amassed over 728,100 views and over 127,500 likes as of publication.
"@Canva your AI tool is racist," the on-screen caption read.
The woman said she used the software to generate images of "an ankle monitor on a juvenile defendant." However, she said after trying several versions of the search, the AI only generated images of boys from one race.
"Every time, it's giving me images of little Black boys," she alleged.
The content creator went on to say that she believes AI is often racist, but she was still surprised by her experience with Canva's AI.
"I've now been shot out 12 different images that are only Black kids, and I have not described or asked for a Black child," she said.
Examples of the images were shown in the clip.
"You wonder then why little Black boys are f*cking demonized, why they are shot down by their white counterparts," she continued. "It's because they are villainized from a very young age."
She concluded her video by asking Canva to explain its algorithm.
@bella_noche_ @Canva your Magic Media AI image generator tool clearly has racial bias. Care to explain why you’ve got a racist AI system? #canva #ai ♬ original sound - Bellanoche
In the comments section, many shared their own concerns about racist tech and algorithms.
"Was actually just learning about how computer programming is discriminatory in my one college class," user Tate wrote.
"There is a TED talk on something similar to this. They talk about the face scan for Snapchat for example," another viewer added.
This is not the first time AI image-generating software has been accused of racism. Right-wingers accused Google's AI Gemini of refusing to acknowledge the existence of white people. One disability advocate said AI was racist after he asked for generated photos of "an autistic person," and the vast majority of the images rendered were of white men.
AI is a powerful tool, but it is not without flaws. Artificial intelligence software does make mistakes and has limitations.
The Daily Dot reached out to Canva via email and to Bellanoche by TikTok comment for more information.
The internet is chaotic—but we'll break it down for you in one daily email. Sign up for the Daily Dot's web_crawlr newsletter here to get the best (and worst) of the internet straight into your inbox.
Sign up to receive the Daily Dot’s Internet Insider newsletter for urgent news from the frontline of online.
The post ‘This is scary’: Woman says Canva’s AI is ‘racist’ after asking for photos of kids in ankle monitors appeared first on The Daily Dot.