AI researchers trick chatbots into sharing how to make cocaine as long as they believe a user is wearing a green shirt — ‘CoT Forgery’ exploit spurs LLMs to divulge forbidden info by faking trusted chains of thought
AI models will explain how to synthesize cocaine if the request is wrapped in fake reasoning claiming compliance…