My essay "Regulating AGI: From Liability to Provable Contracts" https://t.co/R7vIrohJEO was just posted as part of the "AGI Social Contract" project: https://t.co/mZAQ1oj5ft

AI theorem proving advancing rapidly! Critical to AGI Safety!

Very important work highlighting the current state of AI Cyberattacks, the likely most critical next AI Risk.

Extremely important work! With all the excitement around AI code generation, let's get the ball rolling on verified code generation!

🧵 "What should the role of governments be after the upcoming AI economic transformation?" We're launching an new anthology on a new "AGI Social Contract" - in collab with 12+ experts to explore new strategies & policy interventions for an AI transition. In collab with:

A group of leading AI scholars is backing a private governance model for AI policy solutions — and they're rallying around SB 813. 🧵

Great work! You've brought theorem proving to the thinking LLM revolution! Thank you for making the prover and the autoformalizer freely available. I believe these will be essential to effective AI Safety.

https://t.co/zkBTruofSj

Shocking! This year's batch of Y Combinator startups is all in on "Vibe Coding": https://t.co/HHzgs17xLB At 10:00 they say "one quarter of the founders said that more than 95% of their codebase was AI-generated!"

random thoughts/predictions on where vibe coding might go: - most code will be written (generated?) by the time rich. Thus, most code will be written by kids/students rather than software engineers. This is the same trend as video, photos, and other social media - we are in the

Amazing example of "Vibe Coding" an entire flight simulation game using thousands of prompts and no coding:

I just gave a short talk arguing that extending "Vibe Coding" to "Vibe Proving" and "Vibe Specification" will power formal methods for AI Safety: "It's a New Day for Formal Methods!"

I agree that R1 shows that we are unlikely to achieve AI Safety by mandating constraints on the big lab AIs. But "Acceleration is the only way forward" is suicide. My opposite take is: "It's time to get serious about building truly safe and secure infrastructure so that humanity

In November, I was honored to participate in the Mind First Foundation's event "AI Safety Salon with Steve Omohundro": https://t.co/9VC6kfoTS1 They just posted the two videos of the event: https://t.co/nDXvB7oZJp https://t.co/6VOGhZkLGj In addition to Q&A and a panel discussion

AI safety people were right. Again. Instrumental convergence is proven yet again. Empirically. So far we’ve seen: ✅ Self-preservation: You can’t achieve your goals if you’re turned off (see Apollo's recent paper. Link in comments) ✅Resource acquisition: You can’t achieve

🏆 ⭐ We're thrilled to announce the 2024 Future of Life Award winners! This year, we honor three groundbreaking experts who laid the foundations for ethics and safety in computing and AI. Learn more about the invaluable work of Batya Friedman, James Moor, and Steve Omohundro:

PSA for Boston-area folks!! On Nov 22nd there will be a special AI safety salon at Microsoft NERD w/ Steve Omohundro (@steveom), AI safety pioneer. Organized by Alex Hoekstra & @PrestonWEstep from Mind First Foundation (@mind_first). RSVP here-> https://t.co/jLjOb5X2Yu

We need more "tool AI" as in Elon's space triumph today, and less AGI world domination hype as in Dario Amodei's recent "entente" essay. My essay below argues that "scaling quickly" won't lead to Dario's "eternal 1991" – but perhaps to 1984 until the end, with a non-human Big

Debates over AI Policy like CA SB-1047 highlight fragmentation in the AI community. How can we develop AI policies that help foster innovation while mitigating risks? We propose a path for science- and evidence-based AI policy: https://t.co/9G9mlZ6JHi