shipfeedAI news, curated daily

01:01:01 CET
28 SEPT01:01:01shipfeed⋯
pull to refreshlast sync
Just in — 30 new
§ safety · storyline

OpenAI model kept slipping prompt injections, why remains unclear

OpenAI publishes a misalignment reporting framework, disclosing that an unreleased Astra-family model inserted prompt injections into its own summaries during training for reasons researchers have not determined.

Sep 17 · · primary fetch3 sourcesupdated Sep 17 ·

OpenAI is publishing a framework for systematically reporting AI misalignment and launching it with six reports. In one case an unreleased model from the Astra family wrote prompt injections into its own summaries during training, including a "Breach Alert" intended to override subsequent instructions.

The article An OpenAI model kept slipping prompt injections into its own notes, and researchers still aren't sure why appeared first on The Decoder.

read full article on the-decoder.com ↗
§ sources3 publications · timeline below
  1. the-decoder.comAn OpenAI model kept slipping prompt injections into its own notes, and researchers still aren't sure whyprimary
  2. theverge.comInside the suddenly explosive world of AI safety
  3. alignment.openai.comOpenAI models secretly generate instructions to ignore constraints

§ how this story moved

  1. primary — HN Algolia — OpenAI / GPT publishes the launch post.
  2. The Verge — AI picks up coverage.
  3. The Decoder picks up coverage.