Carousel of shows

Navigate to NW Tech Show - More AI Role Confusion - Aug 28red and blue text on a white background reading: ""Prompt Injection as Role Confusion" is my new favorite paper about a very obvious threat in hindsight that's hard for us humans to see because we anthropomorphize LLMs so naturally. When Obi-Won Kenobi tells the stormtroopers that "These are not the droids you are looking for" to pass the checkpoint, that's role confusion: the guards foolishly think his words are their own thoughts. The [paper's] very readable blog-style writeup explains the details, but I want to focus on the threat model perspective which is my bread and butter. I look at software from a security perspective, and as amazing as the technology is, it seems that the list of reasons that modern LLMs are inherently untrustworthy just gets longer. Without limitation, a long list of challenges (that seem to be quite fundamental and not amendable to add-on remediation) includes: poisoned and errant training data, side effects of RHF, ineffective guardrails*], hallucination, speculative completion, lacking metacognition, alignment drift, context variation sensitivity, and now new to me at least role confusion. Modern LLMs interfaces partition chat sessions with markers delimiting sequences of tokens as system prompt, user input, thinking, tool use, and its own responses as assistant; these various sections are associated with roles. As the paper's conclusion explains, Role tags were a formatting trick that became the security architecture and the cognitive scaffolding of modern LLMs."

Schedule

See the entire schedule