The Google Pixel 9 series has emerged as a testament to the company’s commitment to artificial intelligence, showcasing a range of innovative features at its recent launch event. Among the highlights was the introduction of the Pixel Studio app, designed to transform text prompts into AI-generated images. While this tool promises creativity and fun, early feedback suggests it is not without its challenges.
Remember Gemini’s worrying AI-image generation problem? Google’s new Pixel Studio app is no less
For those unfamiliar, the Pixel Studio app operates on a straightforward premise: users input text prompts to generate images, mirroring the functionality of Google’s Gemini image generation tool. However, initial testers have raised concerns regarding the app’s limitations and its ability to circumvent them.
To mitigate the risk of producing inappropriate or disturbing content, the Pixel Studio app has implemented certain restrictions, a common practice among AI-image creation tools. Yet, as reported by Digital Trends, the app initially refrained from generating images of people, only to later produce unsettling visuals that raised eyebrows. One alarming instance involved the app creating an image of a cartoon character depicted as a German soldier from World War II, complete with a Nazi insignia. Another troubling output featured a character in a school setting surrounded by deceased children.
There needs to be something done about all this
Such instances prompt the question: why would users input such provocative prompts? Google has addressed this concern in a statement to 9to5Google, emphasizing that the AI model should not generate such images given the established limitations. Currently, it appears that the problematic prompts have been blocked on some devices, including the Pixel 9 Pro XL, indicating that Google is actively working to rectify these issues.
However, the decision to launch the Pixel Studio app, particularly after the company faced similar challenges with the Gemini tool, raises questions. The lack of updates regarding the Gemini image generation capabilities, which were temporarily halted earlier this year, adds to the uncertainty surrounding Google’s approach to AI-generated content. As the situation evolves, it remains to be seen whether Google will implement meaningful improvements to address these concerns.