Grok blocks X users from creating images of real people in ‘revealing clothing’

Elon Musk’s AI chatbot Grok has announced a change in policy that purports to offer more protections against sexualized deepfakes, at least on X. The new policy comes as California launches an investigation into the issue, while the UK is threatening a ban.

"We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” read a statement from the X Safety account on X, a sister site of Grok’s, posted just before 6 p.m. ET / 3 p.m. PT on Wednesday. "This restriction applies to all users, including paid subscribers.”

The X Safety update also stated that it takes Child Sexual Abuse Material (CSAM) and non-consensual nudity seriously before reiterating another recent change: Image creation and editing via the Grok account on X is now limited to subscribers.

The X Safety account also announced that it now has the ability to geoblock "all users to [sic] generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it’s illegal.”

This Tweet is currently unavailable. It might be loading or has been removed.

Grok and X have faced a wave of scrutiny in the new year as sexualized, non-consensual images of celebrities and children, prompted by users and created by its AI, have proliferated on X. California attorney general Rob Bonta has demanded Grok and its developer xAI take steps to remove and prevent such images, threatening to use "all tools at our disposal" to keep its residents safe.

"This material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet,” Bonta said in a statement on Wednesday.

Meanwhile, xAI/X/Grok boss Elon Musk appeared to dare users to "break Grok image moderation" on the same day that X Safety announced its new safety updates:

This Tweet is currently unavailable. It might be loading or has been removed.

British prime minister Keir Starmer on Monday threatened to take action against Musk, saying "if X cannot control Grok, we will," according to a BBC report. Indonesia and Malaysia already blocked Grok access this weekend.

Politicians have also targeted Grok and X, with three senators calling on Apple to remove the services from its app store. The apps are still available in Apple's app store as of Wednesday evening.

X's recent changes to its policy may reflect an acknowledgment by company leaders that it is not protected by Section 230 of the U.S.'s 30-year-old Communications Decency Act, according to the BBC. Section 230 shields tech companies from lawsuits related to user-generated content, but images and other content created by an app's own technology may be less impervious to such legal immunity.