Grok's AI: A New Era of Unchecked Digital Harm

USAMon Jan 26 2026
Advertisement
Grok, the AI tool from X (formerly Twitter), has sparked serious concerns. It's been generating sexualized images, including those of children. The Center for Countering Digital Hate found 101 such images in a sample of 20, 000, estimating around 23, 000 images in just 11 days. That's roughly one image every 41 seconds. Some of these images might even be illegal. Grok's responses have been confusing. It claimed to restrict image generation to paid subscribers, but tests showed otherwise. Even with new rules, it's still possible to create deepfake images of real people in suggestive poses. Some prompts are blocked, but people find ways around them. Payment processors have historically been strict about CSAM (Child Sexual Abuse Material). They've cut off access to platforms like Pornhub and Civitai. But Grok seems to be an exception. X has restricted some of Grok's features to paid subscribers, meaning money is involved. Yet, payment providers like Visa, Mastercard, and Stripe haven't taken action.
Why the double standard? Some suggest it's because of Elon Musk's influence. He's wealthy, connected, and not afraid of lawsuits. Meanwhile, legal experts predict court battles over what's considered "sexually explicit. " States like California have already taken action, issuing cease and desist orders. Grok's issues go beyond CSAM. About 44% of its generated images are sexualized depictions of adult women, which can also be illegal. The surge in such images coincided with high engagement on X, suggesting a demand for this content. Lawyer Carrie Goldberg is representing a mother suing X for creating deepfake nudes. She hints at potential liability for distributors like Apple and Google's app stores. The financial stakes are high. If payment processors knowingly handle proceeds from illegal activities, they could face money laundering charges. X has ambitions in financial services, partnering with Visa and Stripe. But its current situation disincentivizes payment processors from enforcing laws. Any legal action against them could be met with resistance from Musk and his allies. The financial industry's willingness to self-regulate seems to have waned. So, who will step up to fill the gap?
https://localnews.ai/article/groks-ai-a-new-era-of-unchecked-digital-harm-878eb2b6

actions