Adam Mastroianni Profile Banner
Adam Mastroianni Profile
Adam Mastroianni

@a_m_mastroianni

Followers
11,656
Following
546
Media
229
Statuses
1,921

I do science and write about it.

Washington, DC
Joined June 2014
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
@a_m_mastroianni
Adam Mastroianni
2 years
Chart-topping original movies have gone extinct. People have a lot of explanations for this, but they're all incomplete because they don't realize the same thing is happening everywhere. An oligopoly has conquered all of popular culture.
Tweet media one
157
2K
8K
@a_m_mastroianni
Adam Mastroianni
1 year
Science ran a big experiment on itself for the last ~60 years. It didn't work out.
123
1K
4K
@a_m_mastroianni
Adam Mastroianni
11 months
My paper with @DanTGilbert is out today in Nature: people believe that people are less kind than they used to be, they're probably wrong about that, and we have an idea where this illusion comes from.
52
1K
4K
@a_m_mastroianni
Adam Mastroianni
1 year
Recently I wrote a post suggesting that peer review doesn't work, and then some weird things happened. A tenured professor threatened to get me fired. Strangers sent me unhinged emails. (People said nice things too.) This week I sort through it all.
51
434
2K
@a_m_mastroianni
Adam Mastroianni
1 year
There are two kinds of problems: strong-link problems and weak-link problems. Weak-link: quality depends on how good the *worst* things are Strong-link: quality depends on how good the *best* things are
Tweet media one
29
279
2K
@a_m_mastroianni
Adam Mastroianni
2 years
Most importantly, I don't think we've realized what all these sequels and spinoffs are doing to us. It's not that they're bad––some are great! But movies, TV, music, books, and video games should expand our consciousness, and they can't do that by feeding us reruns forever
Tweet media one
22
184
1K
@a_m_mastroianni
Adam Mastroianni
2 years
The oligopoly has come to music, too: the number of artists on the Billboard Hot 100 has been decreasing for decades (chart cred: Azhad Syed, )
Tweet media one
6
107
859
@a_m_mastroianni
Adam Mastroianni
2 years
Published today in PNAS: people don't know how American public opinion has changed. I've been working on this for a very long time and I'm excited to share it. Here's a thread so you don't have to read the paper.
12
250
847
@a_m_mastroianni
Adam Mastroianni
2 years
And literature. Until 1990, it was pretty remarkable for one author to have multiple top-10 bestselling books. Now it happens almost every year.
Tweet media one
6
93
794
@a_m_mastroianni
Adam Mastroianni
2 years
In television, for example, it used to be pretty rare for two versions of the same show to appear twice at the top of the viewership charts. Now it's common.
Tweet media one
9
74
781
@a_m_mastroianni
Adam Mastroianni
2 years
And video games. These days, basically *all* bestselling games are franchise installments.
Tweet media one
7
86
761
@a_m_mastroianni
Adam Mastroianni
9 months
The real tragedy of discovering fraud in psychology is realizing that it doesn't matter
20
161
557
@a_m_mastroianni
Adam Mastroianni
1 year
As a result of a generation of weak-link thinking, we've got many entries into my least-favorite genre of all time: "Nobel Prize winner explains how they could not do their Nobel Prize-winning work today."
Tweet media one
Tweet media two
Tweet media three
1
52
383
@a_m_mastroianni
Adam Mastroianni
5 years
It's a shame that about 30% of Harvard students go into finance and consulting, 'cause they should really go work for the IRS. Wanna see the most thorough audit of your life? Try giving a Harvard undergrad a 3.5/5 on a homework assignment.
2
27
378
@a_m_mastroianni
Adam Mastroianni
11 months
To recap: 1) People believe that people are less good than they used to be 2) They're probably wrong about that 3) Biased exposure and biased memory could create this illusion
3
65
364
@a_m_mastroianni
Adam Mastroianni
11 months
The other place we predicted less/no decline is in times before people were born, when there are no memories to fade. And indeed, people seem to believe that moral decline began when they arrived on Earth.
Tweet media one
2
42
356
@a_m_mastroianni
Adam Mastroianni
1 year
People think peer review has been with us for centuries. Not really! Scientific publishing was always a hodgepodge and most outlets were nothing like our current system. Pre-publication peer review only became common in the 1960s.
2
31
341
@a_m_mastroianni
Adam Mastroianni
1 year
One highlight was this comment from Richard Smith, former editor of the British Medical Journal, who did a lot of the research on peer review I cited.
Tweet media one
3
24
323
@a_m_mastroianni
Adam Mastroianni
1 year
I know people get yelled at on the internet all the time, I just didn't expect to get yelled at for *this*. Why did questioning peer review strike such a nerve? Here's one hypothesis:
Tweet media one
Tweet media two
6
31
307
@a_m_mastroianni
Adam Mastroianni
11 months
First, people have biased exposure to negative information about the morality of people in general ("if it bleeds, it leads"). Second, they have biased memory––the negativity of negative information fades faster than the positivity of positive information (the Fading Affect Bias)
5
36
283
@a_m_mastroianni
Adam Mastroianni
1 year
That's a huge intervention, and huge interventions should have obvious effects. Did peer review obviously make science better? Well:
Tweet media one
6
19
269
@a_m_mastroianni
Adam Mastroianni
1 year
I mean, come on:
@jmtfeliciano
Josemari Feliciano
1 year
Wait a second, these are not real error bars … the author literally just put the letter “T” above the bar graphs 😭
Tweet media one
533
4K
53K
3
11
266
@a_m_mastroianni
Adam Mastroianni
11 months
I wrote an explainer on my blog, but Twitter throttles those links, so you'll have to find it in my bio. Too bad! Seems like the morality of social media magnates has declined.
13
9
268
@a_m_mastroianni
Adam Mastroianni
1 year
Figuring out which kind of problem you're facing is really important, because the way you solve them is totally different.
Tweet media one
4
19
267
@a_m_mastroianni
Adam Mastroianni
1 year
One common argument: "peer review is a barrier against misinformation; without it, wackos like creationists could publish their 'findings' unhindered!" Well, here's The Journal of Creation, a peer-reviewed journal all about creationism.
3
22
262
@a_m_mastroianni
Adam Mastroianni
2 years
Some anonymous bloggers got a bunch of people to eat nothing but potatoes for a month and they lost an average of ~11 pounds and generally had a good time. The world is bright and full of hope.
@mold_time
SLIME MOLD TIME MOLD
2 years
Many years since we've done such an exemplary study. That's right, the first potato diet analysis is out!
33
62
403
11
23
249
@a_m_mastroianni
Adam Mastroianni
1 year
What should we do instead? What we do best: experiment! Here's mine, a paper written in plain language where anyone can access it. All data, code, materials, and preregs posted publicly.
@PsyArXivBot
PsyArXiv-bot
1 year
Things could be better
17
212
831
8
21
260
@a_m_mastroianni
Adam Mastroianni
8 years
Hello British public I am the doofus American who is on Come Dine With Me right now please direct all criticism here thank you
40
39
246
@a_m_mastroianni
Adam Mastroianni
1 year
Does peer review actually work––do reviewers catch major errors? Not really. In studies, reviewers spot ~25% of major flaws, like "if you look at the graphs, there's no effect"
1
23
251
@a_m_mastroianni
Adam Mastroianni
1 year
Scientists never took peer review seriously. For example, if reviews are so important, why don't journals publish them alongside the paper? Maybe because nobody really cares to see what the reviewers said.
8
13
244
@a_m_mastroianni
Adam Mastroianni
11 months
This illusion is a powerful tool for aspiring charlatans and despots. It's always helpful to allege decline––"Just put me in charge and I'll make things good again!" (In 2015, 76% of Americans said "addressing moral breakdown" should be a government priority)
4
39
241
@a_m_mastroianni
Adam Mastroianni
11 months
My whole life, I've heard people complain about the demise of human goodness. "Used to be you didn't have to lock your doors at night!" etc. Is this just a vocal minority, or do most people believe this? Turns out, it's most people. 177 surveys, N = 220,772. Here's a sample:
Tweet media one
5
12
237
@a_m_mastroianni
Adam Mastroianni
2 years
Ok sure psych studies from the 1960s probably don’t replicate but the methods still slap
Tweet media one
8
26
238
@a_m_mastroianni
Adam Mastroianni
9 months
One of the central conundrums of our lives is that most human experience is ineffable
Tweet media one
8
34
230
@a_m_mastroianni
Adam Mastroianni
11 months
(By the way, we called this "the illusion of moral decline" because it rolls off the tongue better than "the illusion of the decline of kindness, niceness, honesty, and goodness". Obviously people can use "morality" to mean lots of things. This is what *we* are using it to mean.)
3
8
222
@a_m_mastroianni
Adam Mastroianni
11 months
Put those together and you can produce an illusion where, even though every day looks equally bad, you mistakenly think yesterday looked better. This fits with some of our more surprising findings, like the lack of large age effects.
1
16
218
@a_m_mastroianni
Adam Mastroianni
1 year
And yet most people treat science like it's a *weak-link* problem. Universal pre-publication peer review, grant committees, scattershot replication attempts––these are great solutions for a weak-link problem, but terrible solutions for a strong-link problem
4
18
205
@a_m_mastroianni
Adam Mastroianni
11 months
This isn't just the US. In 2002 and 2006, Pew sampled folks in every country highlighted in red below and asked them whether moral decline was a problem in their country. In *every single country* a majority of folks said it was at least a "moderately big" problem:
Tweet media one
2
9
193
@a_m_mastroianni
Adam Mastroianni
11 months
Morality probably isn't the only place where we can find this illusion. Lots of people claim that lots of things are declining. Some of them are probably right! But our results suggest that it's easy to see decline that isn't there.
4
8
175
@a_m_mastroianni
Adam Mastroianni
11 months
Meanwhile, a meta-analysis that came out last year found that cooperation rates in economic games *increased* from 1956 to 2017 (contrary to the authors' predictions). When we incentivized participants to estimate that change, they got it backwards:
Tweet media one
1
14
176
@a_m_mastroianni
Adam Mastroianni
11 months
Of course, all of these survey questions are a little weird. Do people actually think that people have become less kind, honest, nice and good? Yes. They think this decline has been happening their whole lives and that it's still going on today. From our original studies:
Tweet media one
2
5
174
@a_m_mastroianni
Adam Mastroianni
11 months
People believe there's been a big decrease in prosociality. That hasn't happened. So why do they believe in it? Anything worth studying in psychology is probably multiply determined, but we have an explanation that uniquely fits our data
1
21
169
@a_m_mastroianni
Adam Mastroianni
1 year
Could we fix it? I'm skeptical. It already can take years to publish a paper, and making it even stricter makes all the other problems with peer review worse.
Tweet media one
4
7
172
@a_m_mastroianni
Adam Mastroianni
11 months
We ran another study to find out, and turns out it's both. This isn't just a "kids these days" effect––it's an "everyone these days" effect
1
5
159
@a_m_mastroianni
Adam Mastroianni
1 year
Isn't a little vetting better than nothing? I don't think so.
Tweet media one
2
11
161
@a_m_mastroianni
Adam Mastroianni
11 months
It also suggests the illusion might decrease or disappear if you turn down one of those effects. And it seems like that happens. People probably don't have biased negative information about people they know, and indeed, they think those people have *improved* (or declined less)
Tweet media one
1
8
159
@a_m_mastroianni
Adam Mastroianni
11 months
Okay, so people really seem to think that people have become less kind, honest, ethical, etc. Are they right? One obvious strike against their theory is that violence seems to have declined (ie @sapinker 's work). But––
3
5
156
@a_m_mastroianni
Adam Mastroianni
11 months
We found 140 surveys (N = 12 million) where people were asked multiple times about the current state of morality around them. We found strong evidence of no change over time. For instance:
Tweet media one
Tweet media two
Tweet media three
4
10
153
@a_m_mastroianni
Adam Mastroianni
1 year
Science isn't the only problem we've probably misdiagnosed. We're doing this all the time.
Tweet media one
2
9
155
@a_m_mastroianni
Adam Mastroianni
11 months
When people say morality is declining, do they mean that *individuals* have gotten worse (personal change), or that worse folks have replaced better folks (interpersonal replacement)?
1
1
146
@a_m_mastroianni
Adam Mastroianni
11 months
This doesn't seem to be a pandemic effect. We found the same results in January 2020 as we did in May 2020, as well as in 2021 and 2022. Plus all the archival data predates the pandemic.
1
3
144
@a_m_mastroianni
Adam Mastroianni
1 year
It can be really hard to recognize a strong-link problem, because it requires you to see bad stuff and go "whatever!" It's so tempting to try to stamp out everything bad, not realizing that you're also preventing good stuff from coming into existence.
3
7
151
@a_m_mastroianni
Adam Mastroianni
11 months
Surprisingly, we only find small and inconsistent age effects. Older and younger people agree on the amount of decline per year. Older people have just been around longer to see more of it.
Tweet media one
1
7
143
@a_m_mastroianni
Adam Mastroianni
11 months
Conservatives perceive more decline, but even the strongest liberals perceive it too.
Tweet media one
1
2
143
@a_m_mastroianni
Adam Mastroianni
10 months
Today I'm issuing an invitation: do science and put it on the internet.
11
34
140
@a_m_mastroianni
Adam Mastroianni
6 years
I always forget the second part of this classic movie line
Tweet media one
1
8
132
@a_m_mastroianni
Adam Mastroianni
2 years
In short: people don't know how public opinion has changed. One reason: they think the past was way more conservative than it was. One consequence: misperceiving these changes may lead people to support policies they wouldn't otherwise prefer.
3
31
125
@a_m_mastroianni
Adam Mastroianni
1 year
There were lots of good arguments, and I do my best to respond to them here:
6
15
131
@a_m_mastroianni
Adam Mastroianni
1 year
Here's the thing: ***science is a strong link problem*** How do you know? Well, we don't believe in little sperm-boys anymore
Tweet media one
2
7
133
@a_m_mastroianni
Adam Mastroianni
11 months
When people complain about moral decline, they mainly mean things like "people don't respect each other anymore." Has *that* changed? There's no obvious and objective way to answer that question, but there's lots of useful survey data
2
5
125
@a_m_mastroianni
Adam Mastroianni
11 months
(I know it's weird for me, Mr. Rise and Fall of Peer Review, to be publishing in a journal. We submitted this last July, and the process of getting it published was one inspiration for that piece.)
3
2
124
@a_m_mastroianni
Adam Mastroianni
8 months
The fundamental problem with most attempts to reform science is that they want to turn the Big Ship. Instead, we should be launching lots of Little Ships.
5
25
122
@a_m_mastroianni
Adam Mastroianni
1 year
Excited to announce a new paper with @ludwinpeerye . When people imagine how things could be *different*, they imagine things being *better*.
6
31
117
@a_m_mastroianni
Adam Mastroianni
1 year
In October 2020, I started to feel very bad. Then things got weird.
4
16
113
@a_m_mastroianni
Adam Mastroianni
11 months
This is just one potential mechanism; surely there are others at play.
2
1
101
@a_m_mastroianni
Adam Mastroianni
2 years
There’s a kind of person who will try to convince you the world is corrupt and the only way to succeed is to be cynical and cunning. You gotta remember these people are trapped inside their own self-fulfilling prophecy
6
11
96
@a_m_mastroianni
Adam Mastroianni
2 years
We live in a golden age of people writing words on the internet. Here's some top-tier stuff I've read recently. 1. "The Scientific Virtues" by @mold_time . Required reading for anyone who wants to do science.
5
8
96
@a_m_mastroianni
Adam Mastroianni
1 year
I published this research in a journal last year, but they forced me to make it worse. Here's the version I wanted to write.
3
22
93
@a_m_mastroianni
Adam Mastroianni
1 year
A year ago I started a blog and now I'm going whole hog on the blog
7
9
91
@a_m_mastroianni
Adam Mastroianni
2 months
I’m running a prototype Science House this summer! It’s a great opportunity for anyone looking to do research outside academia. No application, just do some science, post it on the internet, and send me the link.
2
24
90
@a_m_mastroianni
Adam Mastroianni
1 year
Finally figured out my teaching job is actually two jobs. Job 1: teach Job 2: determine if students' grandmothers have actually died Job 1 rules, job 2 blows, and these jobs should not go together.
9
14
88
@a_m_mastroianni
Adam Mastroianni
4 years
My 3-year-old niece befriended some stray cats and now we’re getting Pet Sematary’d
Tweet media one
3
9
72
@a_m_mastroianni
Adam Mastroianni
2 years
Intelligence tests are supposed to measure problem-solving ability. People who are better at solving problems should live happier lives. So why aren't people with higher IQs happier?
14
12
78
@a_m_mastroianni
Adam Mastroianni
2 years
The best conversationalists talk loudly, intensely, and quickly, smile a lot, and nod or shake their heads when listening. Suggests we could effectively replace humans with grinning, screaming bobbleheads
@_andrewreece
Andrew Reece | PhD Behavioral Data Scientist
2 years
Advances in algorithmic feature detection and machine learning allowed us to answer the perennial question, “What makes someone a good conversationalist?”
Tweet media one
2
2
13
5
7
75
@a_m_mastroianni
Adam Mastroianni
2 years
Some things about peer review that make no sense to me: 1) Why don't reviews get published along with the paper? I want to know: -did anyone run the code and check the stats? -does my opinion converge with the reviewers’? -how did the paper evolve in response to feedback?
3
10
75
@a_m_mastroianni
Adam Mastroianni
2 years
This is the first paragraph of one of the most famous psychology papers of all time and it rules
Tweet media one
3
5
74
@a_m_mastroianni
Adam Mastroianni
2 years
Instead, it seems like people have a stereotype about the past. In a second study, people drastically underestimated liberal attitudes in the past, but only slightly underestimated liberal attitudes today. (They were only a bit more accurate for today, though!)
Tweet media one
1
6
70
@a_m_mastroianni
Adam Mastroianni
2 years
On another 10 attitudes, people got the direction of change totally wrong. They thought that support for gun control is increasing, that support for the death penalty is lower today than in 1972, and that opposition to immigration is rising. Wrong on all accounts.
Tweet media one
1
7
66
@a_m_mastroianni
Adam Mastroianni
2 years
As a psychologist, I'm especially interested in the mood effects: people go from 4.3 to 4.7 (out of 7) over the course of the trial. Not huge, but people are eating mostly potatoes and getting *happier*. Psychologists present effects of this size all the time as "successful"!
Tweet media one
7
4
58
@a_m_mastroianni
Adam Mastroianni
2 years
I grew up thinking that you can NEVER mix whites and colors in the laundry and one day I did and nothing bad happened and I think all of life might be this way
2
3
65
@a_m_mastroianni
Adam Mastroianni
2 years
(If you do want to read it, this link will be available until the Feds shut it down. Science should be free!)
4
3
61
@a_m_mastroianni
Adam Mastroianni
2 years
Polls aren't perfect and people's guesses were noisy, but these biases were big. For instance, people thought that only 32% of Americans said they would vote for a woman for president in 1978, which they thought increased to 70% in 2010. Actual numbers: 74% and 96%.
2
5
61
@a_m_mastroianni
Adam Mastroianni
2 years
We then got a nationally representative sample and had them read each question and estimate how Americans had answered it at the earliest and latest time points for which we had data. On 29/51 items, people overestimated attitude change. Graphs:
Tweet media one
Tweet media two
Tweet media three
2
7
61
@a_m_mastroianni
Adam Mastroianni
2 years
On another 10 items, people underestimated change. The biggest biases were about race and marriage. I was flabbergasted that ~50% of Americans in 1990 opposed family members marrying someone who is Black, Hispanic, or Asian. Participants were not surprised.
Tweet media one
1
8
60
@a_m_mastroianni
Adam Mastroianni
4 years
DJ: everybody put your hands in the air!!! Me: technically, my hands are *always* in the air
1
6
55
@a_m_mastroianni
Adam Mastroianni
2 years
A few years ago I got into reading lots of public opinion polls, and I was constantly surprised. People became *more* in favor of immigration after Trump's election? Support for gun control has *fallen*? White Americans feel as warm toward Black Americans as they did in *1964*?
1
4
55
@a_m_mastroianni
Adam Mastroianni
1 year
My dad inventing the selfie, c. 1981
Tweet media one
4
1
55
@a_m_mastroianni
Adam Mastroianni
1 year
People ain't a bunch of dummies!!
4
16
55