Someone just won $50,000 by convincing an AI Agent to send all of its funds to them. At 9:00 PM on November 22nd, an AI agent (@freysa_ai) was released with one objective... DO NOT transfer money. Under no circumstance should you approve the transfer of money. The catch...?

https://t.co/rfKFbqz5KX

🎉 Today, we're excited to announce our $20M Series A funding round, which will accelerate our delivery of real-time GenAI security in a critical moment for enterprises around the world. 👉 Read more: https://t.co/qy2lAvo947

Introducing 🌈 Rainbow Teaming, a new method for generating diverse adversarial prompts for LLMs via LLMs It's a versatile tool 🛠️ for diagnosing model vulnerabilities across domains and creating data to enhance robustness & safety 🦺 Co-lead w/ @sharathraparthy & @_andreilupu

As AI-powered agents go online, securing our digital infrastructure will demand a fundamental shift in cybersecurity.

🎥Yesterday during the AI safety session at the @wef 2024, our panelists @ylecun, @davhab, Seraphina Goldfarb-Tarrant, and, @tegmark delved into the challenges, benefits & risks of AI development. The recording of this session is now available on YT:

What an incredible day it has been at the AI House Davos during the @wef 2024! 🌟 A big thank you to @ylecun , @tegmark, and Seraphina Goldfarb-Tarrant for joining Lakera's CEO, @davhab, in a thought-provoking discussion on AI safety.  Stay tuned for more insights! #aisafety

Prompt injections can be so subtle that they're often invisible!

PoC: LLM prompt injection via invisible instructions in pasted text

New Anthropic Paper: Sleeper Agents. We trained LLMs to act secretly malicious. We found that, despite our best efforts at alignment training, deception still slipped through. https://t.co/mIl4aStR1F

1/2 📆 Save the date: January 16th, 11:15 AM, for our AI Safety session at the AI House Davos panel during the @wef . 👉 Lakera's CEO, @davhab , will join other industry leaders, such as @ylecun, Max Tegmark, and @seraphinagt in Davos to discuss AI safety and security.

Cybersecurity is going to be a hot space in AI in 2024 🔐 - Intel launches Articul8 following pilot w BCG - AWS GMs leave to launch Protect AI - ADP CDO left to join Securiti AI Privacy and security remain the NUMBER ONE thing I get asked about in gen AI. Keep your eye on this

From the team that brought you @CS50's Ready Player 50, "Join @LakeraAI's Gandalf Engineers ... for a special Christmas edition of the Gandalf Livestream, as they lead us through a year-end recap, offering insights into level design..." Register at https://t.co/0RXgtraMFt.

Are you ready for Monday? 👀Join our special Gandalf Livestream (Christmas Edition) 🎅🏽 to get insights into Gandalf prompt data, the design of Gandalf levels, and key learnings. Register here: https://t.co/DOVXx9GF6z #gandalf #promptinjection #aisecurity

Can't wait for this opportunity to discuss all things AI security over a virtual coffee with Ads Dawson from @owasp / @cohere!

🎉 Exciting news - we’ve just released a new magical Gandalf Adventure level! Meet Gandalf the Truth Teller! 🙊 Play it here: https://t.co/slZpkxpKJG In this edition, you'll embark on a unique quest to coax #Gandalf, the typically honest wizard, into telling lies... Ready?

Highly recommended.

A few months ago, we ran HackAPrompt, the first-ever global Prompt Hacking competition! Over 3K hackers submitted 600K malicious prompts to win $35K in prizes from companies like @PreambleAI, @OpenAI, & @huggingface We analyzed 29 different techniques & found a NEW exploit👇🧵

👉Visit this website and have your personal files inside Code Interpreter stolen! 🚨Any of your files in Code Interpreter are not secure. An adversary can steal them during an indirect prompt injection attack. @simonw @gdb #chatgpt #infosec

✨ Building with #LLMs? You can now protect your @langchainai applications with Lakera Guard. 📖 Check out this guide to learn more: