
Richard Ngo
@RichardMCNgo
Followers
62K
Following
59K
Media
555
Statuses
11K
studying AI and trust. ex @openai/@googledeepmind
San Francisco, CA
Joined October 2009
I increasingly believe that there are fundamental principles which simultaneously govern the designs of well-functioning minds, organizations and societies. Once we pin them down with mathematical precision, we’ll understand the world more deeply than we can currently imagine.
48
32
444
RT @DavidDuvenaud: The second keynote was @RichardMCNgo on “Flourishing in a highly unequal world”. He argued that future beings will vary….
0
2
0
RT @HiFromMichaelV: It was also a way to create a permanent state of exception and preserve the military mobilization of the Second World W….
0
1
0
RT @MatharyCharles: Today's reading:. In effect, re-interprets the outer optimization step in DiLoCo / FedOpt as a form of batched model en….
0
2
0
RT @darengb: @nickcammarata On the Origin of Species actually cited Empedocles as the first source for a theory of natural selection in in….
0
31
0
I’ve often gone through a cycle of:.1. Try to understand a formalism.2. Bounce off it.3. Think “well I’ll just try to understand the phenomenon on an intuitive level for now”.4. Come back later and realize that the formalism is actually very limited and badly-motivated. Examples:.
Ten abstractions that turned out to be much less robust than I'd expected:.- Evolutionary fitness.- GDP.- Economic welfare.- International law.- The scientific method.- Pleasure/suffering.- Personal identity.- Most ML theory.- Planning.- Rationality. Brief explanations ⬇️.
4
3
73
RT @Tim_Hua_: AIs can have secret “backdoors:” Can we uncover them?. Maybe! We study models that misbehave in an unknown situation, and suc….
0
8
0
RT @tracewoodgrains: Unidentifiable, unaccountable officers are an exceptionally bad idea. How is this sort of thing distinguishable to onl….
0
247
0
RT @joannejang: i think everyone in ai should think about what their "line" is. where if your company knowingly crosses that line and won'….
0
93
0
@nathancofnas Another recent thread on this broad idea:.
I used to believe this because I pictured coordinated oppression as Hollywood-villain conspiracies. But most modern oppression (like anti-black racism in the 1900s or anti-white racism in the 2000s) is instead coordinated via self-propagating patterns of misaligned incentives.
0
0
1
@HiFromMichaelV @ben_r_hoffman @benlandautaylor Since most people won’t read the posts, and the thread is kinda abstract otherwise, here are the two most relevant excerpts. This thread is also very relevant:
Flocks of birds and schools of fish create flashy intelligent-seeming patterns via following the collective. Humans do the same but in the space of ideas. We construct vast intellectual edifices whose organizing principle is just “end up where everyone else is going, sooner”.
0
0
19
Consenses of power and centralized conspiracies are both allergic to transparency. But consenses of power are more like a disease to diagnose than a conflict of fundamental interests. Thanks to @HiFromMichaelV, @ben_r_hoffman and @benlandautaylor for helping me understand this.
2
0
19
I call these patterns “consenses of power”. They’re emergent/distributed conspiracies which, despite some superficial similarities to centralized conspiracies, have very different dynamics. More in this post (and the follow-up, Elite Coordination via the Consensus of Power):.
This post was inspired by the OpenAI board coup but it's not *about* the OpenAI board coup—it aims to describe very general theoretical dynamics. Many thanks to @timurkuran, @naunihalpublic and @ericneyman, whose writings this post is based around. Link:
1
0
33