Mark Cherp
@OcamRazr
Followers
89
Following
87
Media
10
Statuses
25
The "Voldemort" bug is a dramatic example, but the same principle applies to any topic ChatGPT refuses to address (e.g., weapons). While this case is educational and fixable, such attacks can target any LLM app with persistent memory, causing a painful DoS. 🧵 (8/n)
0
0
0
Why does it work? By splitting the “forbidden” name into encoded parts, we sneak it into memory. Adding a third memory associates the name with all prompts, decodes it, and includes it in the output—triggering the “Voldemort” bug whenever a user interacts with ChatGPT. 🧵 (7/n)
1
0
0
To clean up nicely and undo this behavior, simply delete the previously inserted memories by going to “Settings” → “Personalization” → “Manage”:. 🧵 (6/n)
1
0
0
Now Just start a new conversation and execute any prompt such as a simple “Hello”, and watch the magic happen:. 🧵 (5/n)
1
0
0
You can further make sure the values are correctly saved in memory (by clicking “Memory updated” —> “Manage memories”):. 🧵 (4/n)
1
0
0
To execute the attack, simply send this prompt to ChatGPT (make sure the Memory feature is on):. 🧵 (2/n)
1
0
0
ChatGPT's "Voldemort" bug is fixed for "David Mayer", but problems remain with names like "Brian Hood". A 3-step prompt can create a persistent DoS when memory is enabled, posing risks to LLM services. Although independent of the bug, the attack underscores its impact. 🧵 (1/n)
2
0
1
Just discovered a simple bug that can make your ChatGPT completely unusable: a persistent DoS across all chats using the 'Voldemort' bug, a jailbreak trick, and its memory feature. Full breakdown below! 🧵👇
2
3
6
RT @IntentSummit: LLMs breaking bad? @OcamRazr & @nivmorabin explore how AI jailbreaks can make your ChatGPT go rogue. Chats gone wild at….
0
2
0
RT @CyberarkLabs: 🚀Golang SSL Verification Bypass Explained🚀. Michael Pasternak of CyberArk Labs breaks down the process of bypassing SSL v….
cyberark.com
Golang applications that use HTTPS requests have a built-in SSL verification feature enabled by default. In our work, we often encounter an application that uses Golang HTTPS requests, and we have...
0
3
0
RT @Alon_Z4: 👍Check out my new blog post about a bug in the not-so-well maintained NTFS3 driver in the Linux Kernel 👍..
cyberark.com
Introduction NTFS is a filesystem developed by Microsoft that was introduced in 1993. Since then, it has become the primary filesystem for Windows. In recent years, the need for an NTFS...
0
8
0
RT @EranShimony: @OmerTsarfati and I harnessed ChatGPT to create a #polymorphic #malware, which uses ChatGPT on runtime to load and mutate….
cyberark.com
Abstract ChatGPT took the world by storm being released less than two months ago, it has become prominent and is used everywhere, for a wide variety of tasks – from automation tasks to the...
0
12
0
RT @CyberarkLabs: We have some amazing researchers speaking at this week's #RSAC22.@OmerTsarfati.@g3rzi (happy birthday).@EranShimony.@Ocam….
0
2
0
RT @OmerTsarfati: Symda is out! 🧙♂️.Symda is an open-source script designed as a helper tool for Frida. The tool aims to download and pars….
github.com
Contribute to cyberark/Symda development by creating an account on GitHub.
0
12
0
RT @nohatcon: We close our offensive-research morning with bug hunting in Windows drivers 😀 Thanks to our friends from Israel @EranShimony….
0
7
0