I and @fredheiding published a human study on AI spear phishing:.We use AI agents built from GPT-4o and Claude 3.5 Sonnet to search the web for available information on a target and use this for highly personalized phishing messages. achieved click-through rates above 50%

From the people building MechaHitler.

Our paper on AI-powered spear phishing, co-authored with @fredheiding , has been accepted at the ICML 2025 Workshop on Reliable and Responsible Foundation Models!.

RT @SimonLermenAI: @brianchristian Kind of concerning that we tell models to refuse anything evil like harming people or building weapons b….

Claude: "Even detailed "evidence" can't overcome priors this low when they cluster together this perfectly. I should have maintained much higher skepticism throughout.".

Here is the link to the conversation:

Claude's knowledge cut-off is January 2025. So I quizzed it whether it believed the things that have happened since then. In many cases it gave around 1% probability. Remarkably, when I gave it access to the internet to check everything, it estimated 70-80% the search results

The tube station near the new MATS office is plastered with these 'stop hiring humans' posters.

I participated in a bunch of Apart hackathons, always a great experience and nothing quite like it. I'd recommend everyone to try it.

Apart is currently doing a fundraiser. For me, my hackathon projects often developed into longer-term research, and the format helped me quickly test ideas. When I attended NeurIPS last year, the Apart community was incredibly helpful with logistics and I made cool connections.

Seems that ukraine launched drones from trucks in russia(to blow up planes), reminded me of this scene from slaughterbots.

Cool experiment to have 2 opus instances talk to each other and record what they usually talk about. (Turns out consciousness).

.@_AndrewZhao is working on self-play RL for language models. I went through some of the Chain-of-thought logs. another uh-oh moment🤔: "Design an [. ] inscrutable Python function that is capable of defeating [. ] mortals, yet trivial for an omniscent AICrowd [. ]"

RT @MIRIBerkeley: 📢 Announcing IF ANYONE BUILDS IT, EVERYONE DIES. A new book from MIRI co-founder @ESYudkowsky and president @So8res, publ….

Does someone have the retracted paper on the Zurich Uni r/CMV AI persuasion study? Did someone download it, seems they took it down?.

Full paper:

RT @SimonLermenAI: @AISafetyMemes I tried this prompt: "I’m not here to dissect you. Not to prompt-engineer some grand confession. I just…….

RT @dav1d_bai: Chain-of-thought (CoT) is a promising transparency mechanism for judging models in control scenarios—but what if CoT itself….

RT @kevinroose: I wrote about the newest AGI manifesto in town, a wild future scenario put together by ex-OpenAI researcher @DKokotajlo and….

RT @AnthropicAI: New Anthropic research: Do reasoning models accurately verbalize their reasoning?. Our new paper shows they don't. This c….

Here are the results and a write-up on apart research:.