
Share
After users kept mistaking AI-generated personas for real people, Instagram is rewriting its labeling rules and threatening to bury accounts that hide their synthetic identity from followers.
Imagine following someone online for months, maybe even feeling a connection to their posts about health struggles or travel adventures, only to discover the person never existed at all. That's the scenario Instagram says it's trying to prevent with a policy change announced Monday, and it speaks to a trust problem that's been quietly building across social media for the better part of two years.
The platform is renaming its existing "AI creator" label to "AI-generated profile," a tweak Instagram says will make the disclosure easier for ordinary users to understand at a glance. Think of it like a nutrition label: it doesn't stop you from buying the product, but it tells you what's actually inside before you decide.
The bigger change is behind the scenes. Under the new policy, creators who feature an AI-generated person on their profile without labeling it properly could see their content's reach quietly reduced. Instagram isn't threatening to ban these accounts outright. But it is signaling that visibility on the platform will now depend, at least in part, on honesty about who or what is behind the account.
Importantly, the label isn't meant to punish anyone who simply uses AI tools. Instagram was explicit that people who use AI to edit photos, sharpen captions, or design graphics don't need to slap on the new label. The rule is narrower than that. It's aimed specifically at profiles where the featured person, the face users see and build a rapport with, was generated or substantially created by AI rather than being a real human being.
"As generative AI becomes a bigger part of how people create, we've heard that people don't like seeing a profile that seems human, only to find out later that the person featured is AI-generated," Instagram wrote in its announcement. "They want to know when a profile features an AI-generated person."
That sentence captures something researchers who study online trust have been warning about for a while now: the harm isn't necessarily the AI content itself, it's the deception layered on top of it. People generally don't mind knowing they're talking to a chatbot or looking at a synthetic image, as long as they know. The frustration boils over when the mask comes off after the fact, when someone realizes they've been forming an emotional or financial relationship with something that was never real to begin with.

This isn't a hypothetical concern. Earlier this year, Wired investigated the gay dating app Goose after noticing a network of apparently AI-generated male influencers promoting it across Instagram. Reporters found more than two dozen accounts that appeared to feature AI personas, some of which reportedly slid into users' direct messages to encourage sign-ups. That's not just an aesthetic problem. It's a network of fabricated identities being used to nudge real people toward a product, without any disclosure that the "person" making the pitch wasn't a person at all.
Health and wellness content raises the stakes even higher. The New York Times reported in July that it had identified hundreds of AI-generated doctors, healers, and wellness personalities across social media, many of them pushing supplements or making health claims to followers. When a fabricated "doctor" recommends a product to treat anxiety or boost immunity, the consequences aren't limited to a wasted purchase. People make real decisions about their bodies based on advice they believe comes from a credentialed, caring human being. Undisclosed AI erodes the very foundation that kind of trust depends on.
Instagram's timing also lands against a backdrop of other recent stumbles. The company faced backlash this summer over an AI image tool that let users generate content using other people's likenesses pulled from public posts, without requiring an explicit opt-in. Meta pulled that feature after the outcry. And just last week, Meta agreed to an $18 billion settlement with U.S. states over allegations that Facebook and Instagram caused harm to children and teenagers, a deal that will bring a default two-hour daily usage limit for teens, a "Night Mode" block, and muted notifications during school hours. Taken together, these moves suggest a company under real pressure to demonstrate it's taking user wellbeing and digital authenticity seriously, not just issuing statements about it.
Skeptics will reasonably ask how well any of this gets enforced. Labeling policies are only as good as the detection systems and moderation teams behind them, and platforms have a mixed track record of catching violations at scale before they cause damage. Instagram hasn't detailed exactly how it will identify unlabeled AI profiles or how much reach reduction creators can expect to face. Those specifics matter, because a policy that sounds strong in a blog post but goes unenforced in practice offers little protection to the person scrolling their feed at midnight.
Instagram's move fits into a broader shift happening across the industry, one where transparency about AI involvement is increasingly treated as a baseline expectation rather than an optional courtesy. Regulators in multiple countries have been circling similar questions about synthetic media and disclosure requirements, and platforms that get ahead of formal rules often shape what those rules eventually look like. Whether Instagram's new label meaningfully changes user experience will depend on enforcement, not just phrasing. For now, the message to creators is straightforward: use AI however you like, but if the "person" on your profile isn't real, say so, or expect fewer people to see your posts at all.
Tags
Original Sources
Instagram puts new limits on undisclosed AI profiles | TechCrunch
↗ https://techcrunch.com/2026/08/31/instagram-puts-new-limits-on-undisclosed-ai-profiles
About the author
Amara's entry point into AI was an epidemiology role at a London research hospital, where she spent five years studying how digital health tools reached — or conspicuously failed to reach — underserved communities. Watching early algorithmic systems in healthcare quietly entrench existing inequalities, she redirected her career toward the systemic consequences of AI at scale. She covers AI through an unflinching lens: who benefits, who bears the cost, and what evidence actually says versus what the press release claims. Her writing is calm and precise, but she doesn't mistake balance for neutrality.
More from The Steward →This Week's Edition
3 September 2026
22 articles
Related Articles

Trump's "Golden Goose" Gambit Complicates GOP Retreat on Data Centers
Policy & Regulation · 5 min

Minnesota Locks Sanford-North Memorial Merger Into 10-Year Oversight Deal
Policy & Regulation · 6 min

Agentic AI Is Reshaping the Analytics Stack, But Judgment Remains a Human Asset
Products & Applications · 5 min
Related Articles

Trump's "Golden Goose" Gambit Complicates GOP Retreat on Data Centers
Policy & Regulation · 5 min

Minnesota Locks Sanford-North Memorial Merger Into 10-Year Oversight Deal
Policy & Regulation · 6 min

Agentic AI Is Reshaping the Analytics Stack, But Judgment Remains a Human Asset
Products & Applications · 5 min
More Stories
© 2026 Cedar & Bloom. All rights reserved.