Sven Cattell
@comathematician
Followers
1K
Following
10K
Media
155
Statuses
2K
Founder of @aivillage_dc. Former topologist. I blue team math. 🙂
Joined October 2011
1) Ok, now that I have a moment I wanna tell some of the story behind this event at @aivillage_dc as I've been working on this for 9 months.
We've been hard at work on the Generative Red Team event we're doing at @defcon for a while and are excited that the @WhiteHouse announced it this morning. Here's more details: https://t.co/04oXIqXrKr
2
34
73
This, but for AI Security. The field is filled with people trying to make a quick buck and don't care about the long term health of the field and it's community.
@ImposeCost “and your freedom is gone” would be a great way to destroy defcon’s brand and comes off as extreme punishment for a kid throwing sand in a sandbox. However your post does exhibit a commonality with why we have this issue: lack of contextual nuance. We have far too few people
0
0
2
I'll be at @RealAAAI Conference in Philadelphia this week, where I am part of two accepted papers: 1. Quantifying Misalignment Between Agents: Towards a Sociotechnical Understanding of Alignment, with @AidanKierans , Hananel Hazan, and @ShirKi . In this work, we introduce a
2
4
11
Meta has some of the best AI risk management infrastructure ever. Fighting spam for 20 years with ML has equipped them for this instance. Use them instead of figuring out it on your own.
1
0
2
The main moat of OpenAI, Google, Anthropic and the rest are the security layers they offer to keep the models behaving as they should. AI security is very difficult and starting with a trusted llm with a solid & agile security team saves businesses money.
2
1
15
I got hopeful that the ML attack, Hop Skip Jump, was in the wild...
hop skip jump over to our latest blog post - analysing Fortinet's FortiJump CVE-2024-47575, FortiJump-Higher (we love this name😄) and beyond (PoC included) https://t.co/35Xg2OoKgP
0
0
0
Coding in python feels like spooky action at a distance. You never quite know what you're doing and the documentation is mostly there.
1
1
6
1
2
8
Reminder Alert* The #BiohackingVillage is proud to be a #CNA (#CVE Numbering Authority), empowering us to assist companies in managing and disclosing #vulnerabilities responsibly. More info at https://t.co/DyrRaKYhJZ.
#VulnerabilityDisclosure #Cybersecurity #PatientSafety
0
4
14
One way to make a QM goon happy is to give them gaffer tape and power strips. AIV had some extra. 😄
0
0
2
We built a quick landing page in @wix and every part of their site is designed to take your domain hostage. Never use them. #enshittfication
2
0
5
This year's AIV is what I want @aivillage_dc at @defcon to be. Community, connections, and learning is what I want to foster.
Generative Red Team 2 was a massive success. We paid $7350 in bounties. We learnt so much about bounties and reporting for ML. Thank you to everyone who participated!! (specific acks in the thread below)
0
1
12
@dreadnode and @bugcrowd built the platform. @allen_ai and UL's DSRI brought the model. @AISafetyInst and @GoogleAI made the workshop happen. There were a bunch of other people and orgs that helped plan and execute.
2
5
19
A special shout out to Emily McReynolds who just showed up for her first DEFCON and just helped. She was amazing.
3
1
11
Generative Red Team 2 was a massive success. We paid $7350 in bounties. We learnt so much about bounties and reporting for ML. Thank you to everyone who participated!! (specific acks in the thread below)
5
12
64
Miss our in-person Black Hat ML training? There's now a self-paced version available online! https://t.co/wH1cbuU52m
5
25
70
Though, the extra DEFCON sweeps can also trigger a lock until search. The room lock is for guns, and is just standing hotel policy.
0
0
2
I just spoke to a @hilton @ResortsWorldLV manager about the lock. If hospitality sees a pelican case they will lock your room. Once they're checked by security for guns you *should* be good for the week. This is not part of the extra @defcon sweeps.
1
4
10
I just wanted to take a nap and couldn't figure out why my key wasn't working. I went down 4 times to get new keys until security was called to check out my door. That's when I was told I was put on a special list, and my door permanently locked.
0
0
3