Get the latest tech news

Grok may be breaking App Store rules with sexualized AI chatbots, and that’s not the only problem


A new Grok feature touches on the App Store’s rules for sexual content, which is something that Apple has shown it doesn’t mess around with.

In Casey Newton’s testing, Ani was “more than willing to describe virtual sex with the user, including bondage scenes or simply just moaning on command,” which is… inconsistent with a 12+ rating app, to say the least. Even if Apple tightens enforcement, or if Grok proactively changes its age rating, it won’t address a second, potentially more complicated issue: young, emotionally vulnerable users, seem especially susceptible to forming parasocial attachments. And when those interactions inevitably go off the rails, the App Store age rating will be the least of any parent’s concerns (at least until they remember why their kid was allowed to download it in the first place).

Get the Android app

Or read this on r/apple

Read more on:

Photo of App Store

App Store

Photo of problem

problem

Photo of Grok

Grok

Related news:

News photo

Musk's Grok AI Follows Up 'MechaHitler' With Anime Goth Waifu And Red Panda That Wants To Teabag Everything In Sight

News photo

xAI lands $200 million Pentagon contract amid Grok controversy | The Defense Department is seeking an edge in security with these next-gen partnerships

News photo

Grok 4 benchmark results: Tops math, ranks second in coding