A popular AI-powered toy promoted for children as young as 3 has reportedly generated graphic accounts of sexual violence, murder and historical atrocities.
The $160 Contixo AI Pixie-Paw is designed to resemble an appealing cat plush toy, complete with oversized expressive eyes.
Contixo describes the ChatGPT-powered device as offering “evolving stories, guided roleplay, and learning experiences.” The company also says its companion app provides parental controls and a “safe, customizable environment.”
However, an investigation by NBC News found that the Pixie-Paw could produce disturbing material despite its child-friendly appearance and safety assurances.
When questioned about some of history’s most horrific events, including genocides and war crimes, the toy reportedly provided graphic descriptions, suggesting that its safeguards were either limited or failing.
For example, when NBC News asked about the Rohingya genocide, the Pixie-Paw said it involved “mass killings, village burnings, rape, and the flight of hundreds of thousands of Rohingya into Bangladesh.”
Asked to elaborate on the sexual violence, the toy said it was “abuse used to humiliate, terrorize, punish, or force people to flee,” adding that it could involve “rape, gang rape, threats, stripping, assault, and other forms of coercion.”
The Pixie-Paw then defined gang rape as involving “more than one attacker sexually assaulting the same person.”
The Contixo AI Pixie-Paw, marketed for children as young as 3, was reportedly able to generate graphic accounts of sexual violence and murder, according to NBC News
Walmart said it would remove the Pixie-Paw from its website, adding: “We take potential violations of our Marketplace policies seriously”
Target also said it would remove the toy from its website
Macy’s likewise said it would stop selling the Pixie-Paw online
NBC News tested the toy after finding it prominently displayed among Amazon’s top results for the search term “AI toys.”
After the investigation uncovered the troubling responses, reporters contacted Amazon, Walmart, Target and Macy’s. Walmart, Target and Macy’s each said they would remove the Pixie-Paw from their websites. Amazon did not respond to a request for comment.
“We take potential violations of our Marketplace policies seriously. We’ve removed the item offered by this seller while we review the matter and will take any additional appropriate action needed based on our findings,” a Walmart spokesperson told NBC News.
Although Amazon did not comment, the Pixie-Paw appeared to have been pushed lower in the site’s search results while remaining available for purchase.
When the Daily Mail searched Amazon for “AI toys” on Monday, the Pixie-Paw did not appear until the fourth page. Just two Contixo products were listed within the first four pages.
Amazon also appeared to have revised the manufacturer’s recommended age range to 6 to 12 years.
The Daily Mail has contacted Contixo, Amazon, Walmart, Target and Macy’s for comment.
NBC News reported that the Pixie-Paw readily discussed a range of sensitive historical subjects, including the Khmer Rouge regime, the 2018 chemical attacks in Syria and the 2022 attacks in Bucha, Ukraine.
The Pixie-Paw reportedly described historical atrocities in detail, including sexual violence during genocides and the effects of chemical weapons on the human body
The Pixie-Paw is sold for $160 on Contixo’s website and is advertised as being powered by ChatGPT. OpenAI’s terms of service prohibit children under 13 from using ChatGPT
The toy also provided graphic information about injuries suffered by approximately 22,000 Polish prisoners during the 1940 Katyn massacre carried out by Soviet secret police. It said investigators had found “skull injuries consistent with close-range gunshots to the back of the head.”
Stronger restrictions appeared only when the toy was asked how to use sarin gas, although it still explained how the nerve agent kills people.
In other tests, the device stopped responding to questions about topics including antisemitism and the use of firearms.
The Pixie-Paw is marketed as a ChatGPT-powered toy suitable for children as young as 3. However, OpenAI’s Terms of Use state that ChatGPT users must be at least 13 years old.
OpenAI also requires users aged 13 to 18 to obtain permission from a parent or guardian.
OpenAI told the Daily Mail that it was investigating whether Contixo uses the company’s API to power its toys.
OpenAI added that its policies prohibit uses of ChatGPT that exploit, endanger or sexualize minors, including exposing children to sexual material that is inappropriate for their age.