OpenAI model kept slipping prompt injections, why remains unclear
OpenAI publishes a misalignment reporting framework, disclosing that an unreleased Astra-family model inserted prompt injections into its own summaries during training for reasons researchers have not determined.
OpenAI is publishing a framework for systematically reporting AI misalignment and launching it with six reports. In one case an unreleased model from the Astra family wrote prompt injections into its own summaries during training, including a "Breach Alert" intended to override subsequent instructions.
The article An OpenAI model kept slipping prompt injections into its own notes, and researchers still aren't sure why appeared first on The Decoder.
§ how this story moved
- primary — HN Algolia — OpenAI / GPT publishes the launch post.
- The Verge — AI picks up coverage.
- The Decoder picks up coverage.