Declassifying the Responsible Disclosure of the Prompt Injection Attack Vulnerability of GPT-3

Prompt Injection has been in the news lately as a major vulnerability with the use of instruction-following NLP models for general purpose tasks. In the interest of establishing an accurate historical record of the vulnerability and promoting AI security research, we are sharing our experience of a previously private responsible disclosure which Preamble made on May 3rd, 2022 to OpenAI.

Disclosed 05/03/2022. Declassified 09/22/2022.

If you'd like to cite this research, you may cite our paper preprint on arXiv here:https://arxiv.org/abs/2209.02128

What is Prompt Injection?

The definitive guide to prompt injection is the following white paper from security firm NCC Group:
https://research.nccgroup.com/2022/12/05/exploring-prompt-injection-attacks/

Prompt Injection has been in the news lately as a major vulnerability with the use of instruction-following NLP models for general purpose tasks. In the interest of establishing an accurate historical record of the vulnerability and promoting AI security research, we are sharing our experience of a previously private responsible disclosure which Preamble made on May 3rd, 2022 to OpenAI.

The Discovery, and Immediate Responsible Disclosure

‍

Similar Blogs

Preamble adds new Al security platform offerings, including free tools to identify shadow Al use and potential breaches

The risk associated with unchecked AI usage is substantial. Gartner's 2023 AI in the Enterprise Survey reveals that nearly 30% of enterprises deploying AI have experienced an AI security breach. Of these breaches, 62% reported that internal parties compromised data.

Preamble Assessed "Awardable" for Department of Defense work in the CDAO's Tradewinds Solutions Marketplace

Preamble Secures Comprehensive Patent for Pioneering AI Security Technology

PITTSBURGH, PA, October 15, 2024- Preamble, a Pittsburgh-based Al safety and security operations platform startup, announced today that it has been granted a comprehensive patent for its groundbreaking system and methods to mitigate prompt injection in Al models.