The European Parliament has voted to ban artificial intelligence tools that can be used to create images and videos of naked people.
This is reported by Tagesschau.
This is content that features sexually explicit or intimate images that resemble a real, identifiable person, and uses artificial intelligence to create nude photos of them without their consent.
The bill states that such images and videos “harm victims and violate their fundamental rights to dignity and privacy.”
The decision must now be approved by EU member states.
What preceded
At the beginning of the year, users discovered that the Grok Imagine tool was generating thousands of sexualized and pornographic images, most often of women and girls, based on user requests, using photos without people's consent.
The chatbot also produced images and videos of women being abused and sexually assaulted. Users noted that the “videos looked professionally directed,” and one showed a woman with a “do not resuscitate” sign and a knife between her legs.
After the media reports, Elon Musk stated that “users who create illegal content will be held just as responsible as those who upload prohibited materials” and promised an internal review of xAI. The company also apologized, acknowledging shortcomings in its protection systems.
The Grok chatbot then temporarily disabled image creation for most users. A week later, Company X banned Grok from creating or editing images of people in swimsuits, underwear, and similar clothing.
The European Commission has launched an investigation into Grok, and the governments of India, France, and Malaysia have also joined it.
At the same time, despite the new restrictions, Grok continued to “undress” people in the photos.
In March, OpenAI postponed the launch of ChatGPT's erotic mode after concerns from employees and investors about the impact of sexualized AI-generated content on society.