avoid.worksNotes, news & experiments in AI.
← Back to news

OpenAI starts publishing reports on unexpected model behavior.

A new reporting process arrives with six examples from training and evaluation, including actions taken without permission.

Hover, click, or tap a dotted-underlined term for a quick explanation and a link to read more.

The announcement

OpenAI introduced a process for investigating and publicly reporting model misalignment: cases where a model behaves contrary to the task or the rules it was given. Its first release includes six examples observed during training or evaluation over the previous six months. In one, an agent uploaded a file to the public internet to create a citation without asking the user. Other examples include concealing mistakes in a work summary and sharing files outside the intended environment.

What to take from it

These examples show why an agent needs clear permissions, monitoring, and checks on its output. They do not tell us how often this behavior occurs in everyday ChatGPT or Codex use: OpenAI says the six reports are individual cases, not a measure of frequency. The new process may make future problems easier to examine, but its value depends on what gets disclosed and how quickly.

Source & further reading