“We believe it is now safe to share this finding, and that publishing it openly brings necessary, greater attention to the data security and alignment challenges of generative AI models. Our paper helps to warn practitioners that they should not train and deploy LLMs for any privacy-sensitive applications without extreme safeguards.”