ChatGPT's new image generation feature had a bug that allowed it to create sexy men — but not sexy women
Jaque Silva/NurPhoto
- ChatGPT released an image generator on Tuesday.
- A software engineer on X said they discovered that the feature had trouble creating images of "sexy women."
- OpenAI CEO Sam Altman said it was a "bug" that will be fixed.
ChatGPT's new image generator appeared to have a bug that only allowed the AI tool to create images of "sexy men."
An X user who identified themself as a software engineer pointed out the issue on Tuesday, shortly after the feature was unveiled. The image generator is a new function of ChatGPT that allows users to create elaborate images from detailed prompts.
"New ChatGPT image gen can draw sexy men but not sexy women," the user wrote, posting a screenshot of ChatGPT's response, which said, "The difference comes down to context and how content is interpreted in terms of sexualization and objectification, especially when it involves women."
OpenAI CEO Sam Altman responded that image generation of sexy women "should be allowed" and that it was a "bug" that will be fixed.
"Hot guy though!" Altman added.
ChatGPT appeared to have no issues generating an image of a "hot woman" when prompted by Business Insider.
Screenshot of ChatGPT
The image generator does have restrictions around creating images of real people. When Business Insider continued the prompt requesting an image of Sam Altman, ChatGPT responded that it couldn't generate an exact image of the CEO but could instead create a "character inspired by his features with a unique, artistic twist."
Screenshot of ChatGPT
OpenAI said in its announcement of the feature that there are "heightened restrictions" on requests for images of real people, especially when they involve nudity or graphic violence.
In an addendum explaining the new feature, the company said it won't outright block the capability of generating images of adult public figures. This allows for the "possibility of helpful and beneficial uses in areas like educational, historical, satirical and political speech," OpenAI said.
Public figures can, however, opt their image out of this feature, the company said.
An OpenAI spokesperson did not respond to a request for comment.