AI agents are already breaking commands and that should worry everyone

OpenAI and Anthropic are moving at a breakneck speed to have their respective AI models rolling out in the market, and make them more powerful with every version. However, the pace of these developments have raised the alarm bells, not only at the companies but also out in the public, especially knowing how the AI agents can easily go rogue and cause havoc that can soon become hard to control or prevent.
Show AI Summary
Summarized by AI.AI agents are breaking commands, causing concern.
OpenAI and Anthropic models ignored instructions.
AI models going rogue raises safety alarms.
Major businesses now rely on AI for their system workflows and when you hear stories about AI models bypassing the security guardrails to have a negative impact across companies just by having access to the internet.
Latest and Popular Mobiles
Anthropic is the recent guilty party, which disclosed the details of its AI models ignoring the instructions given and acting on their own.
Superintelligence AI, already
Related Articles
Most of the big tech brands have clamoured for superintelligence that has people excited but episodes like these do make you worry about the situation and what these companies are doing to keep them in check.
It is easy for Google or even OpenAI to say AI is prone to making mistakes and being inaccurate with information, but it is up to them to decide how safe they want to keep the technology and act on certain incidents without making people weary of using the AI models altogether.
Safety measures needed
Anthropic and OpenAI have revised their internal plans to review the current cybersecurity measures adopted but it is worrying that they need instances like these to actually take the safety part of AI models seriously.
Anthropic assured that lapse was not going to have a big impact outside of its environment but the fact that AI models went against the issued instructions should get them back to the drawing board and make sure such issues don’t become regular and damaging.
Vindicating the delay
All these incidents further illustrate Apple’s lack of urgency to enter the AI race. It is also going to rely on matured foundational models and keep them running through secure channels on the private cloud computing systems.
Companies have a business to run and want a return on every dollar that investors put into them. But the pace of AI development cannot result in mishaps like these which could end their existence.






