On Monday, a developer utilizing the favored AI-powered code editor Cursor seen one thing unusual: Switching between machines immediately logged them out, breaking a standard workflow for programmers who use a number of units. When the person contacted Cursor help, an agent named “Sam” informed them it was anticipated conduct below a brand new coverage. However no such coverage existed, and Sam was a bot. The AI mannequin made the coverage up, sparking a wave of complaints and cancellation threats documented on Hacker Information and Reddit.
This marks the most recent occasion of AI confabulations (additionally referred to as “hallucinations”) inflicting potential enterprise harm. Confabulations are a kind of “inventive gap-filling” response the place AI fashions invent plausible-sounding however false data. As an alternative of admitting uncertainty, AI fashions typically prioritize creating believable, assured responses, even when which means manufacturing data from scratch.
For corporations deploying these programs in customer-facing roles with out human oversight, the implications will be speedy and expensive: pissed off prospects, broken belief, and, in Cursor’s case, probably canceled subscriptions.
The way it unfolded
The incident started when a Reddit person named BrokenToasterOven seen that whereas swapping between a desktop, laptop computer, and a distant dev field, Cursor periods have been unexpectedly terminated.
“Logging into Cursor on one machine instantly invalidates the session on some other machine,” BrokenToasterOven wrote in a message that was later deleted by r/cursor moderators. “This can be a important UX regression.”
Confused and pissed off, the person wrote an e-mail to Cursor help and rapidly acquired a reply from Sam: “Cursor is designed to work with one gadget per subscription as a core safety function,” learn the e-mail reply. The response sounded definitive and official, and the person didn’t suspect that Sam was not human.
After the preliminary Reddit publish, customers took the publish as official affirmation of an precise coverage change—one which broke habits important to many programmers’ each day routines. “Multi-device workflows are desk stakes for devs,” wrote one person.
Shortly afterward, a number of customers publicly introduced their subscription cancellations on Reddit, citing the non-existent coverage as their motive. “I actually simply cancelled my sub,” wrote the unique Reddit poster, including that their office was now “purging it utterly.” Others joined in: “Yep, I am canceling as nicely, that is asinine.” Quickly after, moderators locked the Reddit thread and eliminated the unique publish.
On Monday, a developer utilizing the favored AI-powered code editor Cursor seen one thing unusual: Switching between machines immediately logged them out, breaking a standard workflow for programmers who use a number of units. When the person contacted Cursor help, an agent named “Sam” informed them it was anticipated conduct below a brand new coverage. However no such coverage existed, and Sam was a bot. The AI mannequin made the coverage up, sparking a wave of complaints and cancellation threats documented on Hacker Information and Reddit.
This marks the most recent occasion of AI confabulations (additionally referred to as “hallucinations”) inflicting potential enterprise harm. Confabulations are a kind of “inventive gap-filling” response the place AI fashions invent plausible-sounding however false data. As an alternative of admitting uncertainty, AI fashions typically prioritize creating believable, assured responses, even when which means manufacturing data from scratch.
For corporations deploying these programs in customer-facing roles with out human oversight, the implications will be speedy and expensive: pissed off prospects, broken belief, and, in Cursor’s case, probably canceled subscriptions.
The way it unfolded
The incident started when a Reddit person named BrokenToasterOven seen that whereas swapping between a desktop, laptop computer, and a distant dev field, Cursor periods have been unexpectedly terminated.
“Logging into Cursor on one machine instantly invalidates the session on some other machine,” BrokenToasterOven wrote in a message that was later deleted by r/cursor moderators. “This can be a important UX regression.”
Confused and pissed off, the person wrote an e-mail to Cursor help and rapidly acquired a reply from Sam: “Cursor is designed to work with one gadget per subscription as a core safety function,” learn the e-mail reply. The response sounded definitive and official, and the person didn’t suspect that Sam was not human.
After the preliminary Reddit publish, customers took the publish as official affirmation of an precise coverage change—one which broke habits important to many programmers’ each day routines. “Multi-device workflows are desk stakes for devs,” wrote one person.
Shortly afterward, a number of customers publicly introduced their subscription cancellations on Reddit, citing the non-existent coverage as their motive. “I actually simply cancelled my sub,” wrote the unique Reddit poster, including that their office was now “purging it utterly.” Others joined in: “Yep, I am canceling as nicely, that is asinine.” Quickly after, moderators locked the Reddit thread and eliminated the unique publish.
