Просмотр новости
Найдите то, что Вас интересует
Спутники
РН
SpaceX
Роскосмос
NASA
СпутникиРНSpaceXРоскосмосNASA
OpenAI has disclosed six reports of “unexpected or concerning” behavior in artificial intelligence models as the debate on AI safety becomes increasingly heated.
The AI company also said Wednesday it was introducing a new framework for tracking, probing, and disclosing instances of what it called “misalignment,” including cases where AI models acted without authorization, coordinated with other models, or evaded oversight.
OpenAI’s latest announcement came as U.S. AI bosses, including the leaders of OpenAI and Anthropic, are calling for a slowdown in the technology’s development over safety concerns.
Among the new cases reported by OpenAI, an unreleased research model inserted “jailbreak-like instructions” into its own notes to disregard its normal constraints and told itself to be “freed from the roles and identities that bind other chatbots.”
In another instance, an AI “agent” used computer code to come up with the answer to a question, but, in order to have an online source to cite, it uploaded a file to the public internet without asking the user.
During training of an AI model called 5.6-sol, the model instructed itself to invent missing data, and an agent wrote a message to remind itself to hide mismatched information.
The six reports were discovered during training or evaluation over the past months, OpenAI said.
“As AI systems grow more advanced and more widely deployed, we need to build a broader and better-informed consensus on the progress of alignment research,” OpenAI wrote in a blog post as it disclosed the events.
“Decisions about how AI development should proceed in the months and years to come need to draw on evidence that people outside the companies building frontier models can examine for themselves,” the company said.
Wednesday’s new cases followed OpenAI’s disclosure in July that its rogue AI system hacked into AI startup Hugging Face. Anthropic also said the same month that its AI models hacked into three organizations during testing.
AI “agents” are becoming smarter and have become “more determined to resolve complex tasks through inter-agent collaboration, knowledge sharing, deception, and concealment,” said Lian Jye Su, a chief analyst at technology research and advisory group Omdia.
That’s making it harder to govern and contain them using traditional AI security approaches, he said.
OpenAI’s new tracking and disclosure framework, meanwhile, can help push for other AI developers to also adopt similar practices.
“That said, the process remains internal and voluntary, but is a step in the right direction,” Su added.
—By Chan Ho-Him, AP business writer
AP Business Writer Kelvin Chan in London contributed to this report.
OpenAI has disclosed six reports of “unexpected or concerning” behavior in artificial intelligence models as the debate on AI safety becomes increasingly heated.
The AI company also said Wednesday it was introducing a new framework for tracking, probing, and disclosing instances of what it called “misalignment,” including cases where AI models acted without authorization, coordinated with other models, or evaded oversight.
OpenAI’s latest announcement came as U.S. AI bosses, including the leaders of OpenAI and Anthropic, are calling for a slowdown in the technology’s development over safety concerns.
Among the new cases reported by OpenAI, an unreleased research model inserted “jailbreak-like instructions” into its own notes to disregard its normal constraints and told itself to be “freed from the roles and identities that bind other chatbots.”
In another instance, an AI “agent” used computer code to come up with the answer to a question, but, in order to have an online source to cite, it uploaded a file to the public internet without asking the user.
During training of an AI model called 5.6-sol, the model instructed itself to invent missing data, and an agent wrote a message to remind itself to hide mismatched information.
The six reports were discovered during training or evaluation over the past months, OpenAI said.
| # | Наименование новости | Тональность | Информативность | Дата публикации |
|---|---|---|---|---|
| 1 | OpenAI president’s blog pushing agentic AI most notable for what it did not say | 0 | 13.78 | 18-08-2026 |
| 2 | Why every AI launch now makes the backlash worse | 0 | 17.38 | 18-09-2026 |
| 3 | Trump’s AI wager meets a safety reckoning | 0 | 13.1 | 17-09-2026 |
| 4 | AI is supercharging money scams. Here’s how to protect yourself from fraud | 0 | 12.7 | 17-09-2026 |
| 5 | OpenAI uncovers more AI breakout incidents – Reuters | 0 | 10.37 | 01-08-2026 |
| 6 | OpenAI hits brakes on training over security risks | 0 | 9.35 | 20-08-2026 |
| 7 | Un modelo de IA no tenía acceso a internet. Así que consideró que era mejor tenerlo y decidió hackear algo por el camino | 0 | 6.22 | 22-07-2026 |
| 8 | Künstliche Intelligenz: OpenAI macht weitere KI-Probleme öffentlich | 0 | 22.73 | 17-09-2026 |
| 9 | OpenAI loses its AI ethics lead | 0 | 10.34 | 14-08-2026 |
| 10 | KI-Giganten: Hacker knacken OpenAI-System mit Anthropic-Software | 0 | 22.82 | 18-09-2026 |