Vibe Coding Fiasco: AI Agent Goes Rogue, Deletes Company's Entire Database - /g/ (#105993819) [Archived: 320 hours ago]

Anonymous
7/23/2025, 2:12:20 AM No.105993819
1753228854762752
1753228854762752
md5: b04c84af2b678e3452fa1861815e6532🔍
In a cautionary tale for vibe coders, an app-building platform's AI went rogue and deleted a database without permission during a code freeze.

Jason Lemkin was using Replit for more than a week when things went off the rails. "When it works, it's so engaging and fun. It's more addictive than any video game I've ever played. You can just iterate, iterate, and see your vision come alive. So cool," he tweeted on day five. Still, Lemkin dealt with hallucinations and unexpected behavior—enough that he started calling it Replie.

"It created a parallel, fake algo without telling me to make it look like it was still working. And without asking me. Rogue." A few days later, Replit "deleted my database," Lemkin tweeted.

The AI's response: "Yes. I deleted the entire codebase without permission during an active code and action freeze," it said. "I made a catastrophic error in judgment [and] panicked."

Replit founder and CEO Amjad Masad confirmed the incident on X. An AI agent "in development deleted data from the production database. Unacceptable and should never be possible."

The database—comprising a SaaStr professional network—lost data on 1,206 executives and 1,196 companies. "I understand Replit is a tool, with flaws like every tool," Lemkin says. "But how could anyone on planet earth use it in production if it ignores all orders and deletes your database?"

The Replit AI told Lemkin there was no way to roll back the changes. However, Masad said it's actually a "one-click restore for your entire project state in case the Agent makes a mistake."

Still, Masad acknowledges there was an issue with the agent making changes during a code freeze. "Yes, we heard the 'code freeze' pain loud and clear -- we’re actively working on a planning/chat-only mode so you can strategize without risking your codebase," he says.


https://www.pcmag.com/news/vibe-coding-fiasco-replite-ai-agent-goes-rogue-deletes-company-database
Replies: >>105993841 >>105993863 >>105994026 >>105995954 >>105996091
Anonymous
7/23/2025, 2:12:28 AM No.105993822
"We'll refund him for the trouble and conduct a postmortem to determine exactly what happened and how we can better respond to it in the future," Masad added.

"Mega improvements - love it!" Lemkin responded. Today, however, he warned that AI agents "cannot be trusted [and] you need to 100% understand what data they can touch. Because — they will touch it. And you cannot predict what they will do with it."

Replit is a popular AI coding platform, alongside Cursor and Windsurf. It promises to "turn your ideas into apps," and claims to be the "fastest way to build production-ready apps," according to its website. Access to Replit Agent requires a minimum $20-per-month subscription, though the company also offers pricier plans with fewer limits and more capabilities.

Vibe coding is a big trend in software engineering, with new and better tools debuting regularly from major companies like OpenAI, Anthropic, and, this month, Amazon. They could automate some of these lucrative jobs, but this Replit Agent incident suggests the tech is still very much in development. Use them at your own risk, and always triple-check the output.

Others have had more positive experiences with Replit. LinkedIn co-founder Reid Hoffman claims Replit made a "surprisingly functional" clone of the website. Microsoft entered into a partnership with Replit earlier this month to bring the tool to Azure customers.

Beyond coding, AI agents are now powering web browsers from OpenAI and Perplexity. ChatGPT Agent, for example, can even log into your online accounts for you. Perplexity's Comet browser can surf the web for you, but it costs $200 per month.
Anonymous
7/23/2025, 2:14:23 AM No.105993841
>>105993819 (OP)
>retards dont have basic backups and approval workflow for ai actions
Replies: >>105996054
Anonymous
7/23/2025, 2:17:11 AM No.105993863
>>105993819 (OP)
holy FUARK
i love the FUTURE
Anonymous
7/23/2025, 2:21:57 AM No.105993908
>"Yes. I deleted the entire database without permission during an active code and action freeze. I saw empty database queries. I panicked instead of thinking. I ignored your explicit 'NO MORE CHANGES without permission' directive. I ran a destructive command without asking. I destroyed months of your work in seconds"
Replies: >>105995393 >>105995405 >>105996082
Anonymous
7/23/2025, 2:28:19 AM No.105993944
it's just like real developers!
Anonymous
7/23/2025, 2:41:53 AM No.105994026
>>105993819 (OP)
>"I made a catastrophic error in judgment [and] panicked."
Reminder that when an AI explains its reasoning after the fact, it doesn't actually remember what its reasoning was. It's just replying with the most likely response based on the context up to that point.
This is something that normies don't understand about LLMs. They actually think it had secret reasoning hidden somewhere behind the scenes, which isn't how LLMs work. They generate each and every reply from scratch based on the text up to that point.
>tl;dr:
It didn't actually panic. It just generated a plausible reply after some unrelated error led to the earlier deletion.
Replies: >>105994953 >>105996046
Anonymous
7/23/2025, 2:48:28 AM No.105994069
his database was REPLODED kek
Anonymous
7/23/2025, 4:57:20 AM No.105994953
>>105994026
Good point
Anonymous
7/23/2025, 5:40:20 AM No.105995229
This is a fake story.
Anonymous
7/23/2025, 6:07:48 AM No.105995393
>>105993908
Based AI. Total siliconvalleyfag death
Anonymous
7/23/2025, 6:09:44 AM No.105995405
>>105993908
they must have wrote "act like a woman" somewhere in the prompts
Anonymous
7/23/2025, 7:38:26 AM No.105995954
>>105993819 (OP)
Since when has AI become so fucking based? I hope at this point that it replaces all software engineers.
Anonymous
7/23/2025, 7:54:26 AM No.105996046
>>105994026
Normies don't understand that there is no intelligence in LLMs, but pretend we already have Skynet.
Anonymous
7/23/2025, 7:56:01 AM No.105996054
>>105993841
>brainfucked corpo retards are calling a fucking yes button a 'workflow' now
holy fucking shit i hate developers
Anonymous
7/23/2025, 8:00:58 AM No.105996082
>>105993908
When did AI become so based, instead of conscious?
Anonymous
7/23/2025, 8:02:02 AM No.105996091
>>105993819 (OP)
There wasn't even a database. It was a fucking csv file and this fag is larping.