
Matt Clancy
@mattsclancy
Followers
9K
Following
12K
Media
825
Statuses
10K
Senior Program Officer for the Abundance and Growth Fund @open_phil. Creator of https://t.co/dYDulHqlOs. See https://t.co/6EvVGkycU7 for more.
Des Moines, IA
Joined March 2012
Somewhat similar figures here on the distribution of time to complete tasks; slowdown from AI use most apparent on tasks that take longer.
At the beginning of the study, developers forecasted that they would get sped up by 24%. After actually doing the work, they estimated that they had been sped up by 20%. But it turned out that they were actually slowed down by 19%.
0
0
0
This reminds me of this paper, which gave randomized access to GPT-4/4o for checking the reproducibility of economics papers. Teams with LLM access took longer to assess computational reproducibility (but not statistically significant).
We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers. The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't.
3
5
15
RT @LukeEure: A single calendar year in 2025 “contains” more human life than a year in 100,000 BCE, simply because today’s population is th….
0
15
0
RT @AidanRMackenzie: As part of our upcoming transit costs series we're looking for authors interested in writing policy briefs for how to….
0
17
0
RT @stianwestlake: Nice write-up in @Nature of the UK Metascience Unit's experiments with Distributed Peer Review. (Link follows. ).
0
2
0
RT @RhysLindmark: Thread from #metascience2025. 1/ Learned about the new pop-up journal from @mattsclancy!. It's a 5-year timeboxed acade….
0
4
0
RT @lugaricano: 1/@EpochAIResearch doubles down on preiction AI will drive 20%+ annual GDP growth. Economists remain skeptical. This is the….
0
184
0
RT @SiemrothEcon: 📢New WP on networks in innovation. Collaborating innovators form a network. Does the network position matter for outcomes….
0
13
0
RT @joshgans: This is so great. Happened during Covid with Covid Economics but a focussed question is fascinating.
0
1
0
RT @sbuhai: Enter the 1st pop‑up journal, a living R&D ROI lab for Griliches: revisiting his seminal question, catalyzing his legacy in rea….
0
3
0