Hey academics on Twitter:
Have you ever been scooped?
Do you worry about getting scooped?
My job market paper estimates the consequences of getting scooped in science using cool data from structural biology.
Let’s do a thread!
After six years of a PhD, it sucks to end this way. It’s been a profound experience and I feel like I’m slipping out the back door. Anyone else wishing for more closure?
Congrats on a well-deserved Nobel Prize for
@metrics52
, a fantastic advisor, scholar, and teacher. Rock on, Josh!
(screenshots courtesy of his sneaky metrics TA in March 2020)
Econ PhD advice thread:
@carolyn_sms
and I co-wrote our job market papers, so we often get asked about the pros and cons of co-authoring with grad school peers. Now that we both have survived the market, I wanted to tweet out a few reflections on our experience.
Reminds me of the time I was typing up my third-year paper at a Cambridge coffee shop. Larry Katz walked in and asked me what I was working on. I read the abstract and he immediately pulled out the paperwork to officially accept it for publication at the QJE.
The secret is getting out, so let me make it
#EconTwitter
official: This summer I am joining the Kellogg Strategy group as a new Assistant Professor. We’ve been dancing around each other for a couple years and the stars finally aligned. I’m excited for the new challenge!
I knew Matt Gay in 2014 when he was a soccer player at Utah Valley Univ. He had never played a down of football. In 2022, he just kicked the game-winning field goal for the LA Rams in the playoffs.
The most shocking thing Yusuke Narita said as my 1st-year metrics TA:
“Let’s start with a simple example to help build intuition. Consider a measure space with the following sigma-algebra…”
I'm very grateful to announce that I will be joining
@BYUecon
as an Assistant Professor of Economics starting Fall 2021. I'm also excited to spend the next year as a post-doc at the
@KelloggSchool
Strategy group. Good times ahead! Some thoughts and thanks below...
This is a healthy exercise. I failed two final exams at MIT during my first year and had to retake them. One in micro and one in macro. A bit embarrassing, but in no way derailed my overall progress. Failure is part of the process!
Flex your lowest academic low score.
To remind us that almost everyone fails at some point in life but it isn't the end of the road. Just a memory in the end.
Mine was 27/100 in Engineering Math 2, just a year after I'd scored 99 in 12th boards. Much needed kick in my butt.
So yeah, nobody likes getting scooped. It sucks!
Here’s the good news: The evidence we present suggests that scooped projects are still very likely to get published and cited. Also, getting scooped is not a death knell for a fledgling career. Yay!
Somehow I was added to a paper revision email chain of psychologists who think I am Ryan Hill, psychologist at Baylor, not Ryan Hill the economist at BYU. Should I make some edits to the manuscript?
I recommend learning scraping techniques on python to any applied economist. I use these tricks for almost every project I work on. Great way to get new data that no one has looked at before.
We're about to submit a paper to an economics journal in which we cite 29 economics papers, 4 sociology papers, and 44 (!) life science papers. Are we doing this right??
But maybe some bad news?
Our next paper considers the efficiency and welfare of scientific racing. We look at objective quality metrics in the PDB and present evidence that racing is associated with lower quality science. Tradeoffs will be discussed!
Ok this thread is for all you Stata junkies out there that use reshape regularly.
Sometimes I have to do “unbalanced” reshapes, which is a task that is super inefficient using the standard reshape command.
So here's a hack you might find useful!
1/
Today is my last day as a post-doc at
@NorthwesternU
. I didn’t set foot on campus this year, but it’s been a great experience nonetheless thanks to mentorship from
@bfjo
and collaboration with
@dashunwang
and
@yian_yin
. Tomorrow I’m a professor!
Another way to describe the citation result is that scooped papers get 42% of the total citations to both projects. That’s way bigger than the 0% that we usually assume in theoretical models of racing. It’s not winner-take-all, but maybe winner-take-much.
Why does Google Maps estimate travel time based on *current* traffic conditions all along the route? If I’m driving through downtown Chicago in 6 hours (after rush hour), why estimate based on current traffic instead of forecast traffic for the time I’m driving through?
I’ve been reflecting this past year since the job market on my decision to stick with academia over industry. One thing I think I can add to the conversation is my experience as a first-gen PhD having watched the ups and downs of my Dad’s (crazy!) career in industry. 1/N
While I don't completely agree with the sentiment, I think the median person - even perhaps the median econ grad student - would be more impactful, richer, and happier in industry than in academia
Dear RCT subject:
Thank you for participating in my study. You achieved the Maximum Influence Perturbation and are therefore in my Most Influential Set. Merry Christmas!
(ps Thanks for the AER)
So what do we find? Scooped projects are 2.5% less likely to be published, are 18% less likely to appear in a top journal, and receive 28% fewer citations.
Bummer! But are these effects “big” or “small”?
The paper is called:
Scooped! Estimating Rewards for Priority in Science
It’s co-authored with my awesome classmate
@carolyn_sms
, who is a fantastic collaborator. Look for her on the econ market next year!
Paper link:
Goodreads is interesting because the highest rated books are almost all fantasy sequels. Extreme positive selection from (1) serious genre readers and (2) people who liked the first book enough to read the sequels
Very excited to present for the first time at NBER SI tomorrow (7/14) in the innovation session. The paper is my JMP about getting scooped! (joint with
@carolyn_sms
)
You can tune in at 2:10 pm ET on the public livestream (I’ll add the link tomorrow morning when it is posted).
Here is some free advertising for
@evernote
. I use it constantly to organize my research notes, so I thought I would highlight some features. As an example, I’ll show you my lit review workflow because I think it's pretty slick...
The effect of getting scooped varies by pre-existing reputation. This plot shows the citation shares in “mismatched” races between high- and low-reputation teams. Getting scooped has bigger effects if you’re from a low-ranked university or have very little publishing experience.
JMCs: Remember to spend the day before interviews mapping out your zoom schedule. You might even want to do a practice walk-through so you don't forget to log-in for that one random interview on Microsoft Teams
If you are refereeing a resubmission in which the authors sufficiently addressed all of your comments, are you expected to provide any additional report to the authors, or can you just send a thumbs up letter to the editor and skip the report?
Lastly, we look at the effect on careers, and find that in this setting the costs are small, even for novice scientists. Getting scooped lowers citations to future work, but has minimal, if any, effect on publication rates over then next 5 years.
Respondents think there is a 27% chance of getting scooped between project completion and publication, much higher than the 3-8% chance in our data. They guess that they will only get 26% of the total citations if scooped, much lower than the 42% we find.
Waiting for Martin Hackmann, Jim Heckman, Brent Hickman, Bruce Hockman, and Robert Huckman to write an Econ paper together. How can we make this happen?
The longer I study innovation, the less I trust patent citations as a good measure of
1) quality of ideas
2) knowledge spillovers
They are useful in some cases, but anyone using citations as an outcome needs to think deeply about Evgenii’s great paper:
Does knowledge float "in the air" as Marshall (1920) suggested?
I show that knowledge does not flow through ether, it flows through pipes of business relations.
A revised WP and 🧵 on secrecy, the decline in trade secret sharing, and the role of China and IT in this decline.
I’ll chime in here with my ugrad math experience. I decided late to pursue an Econ PhD, so I basically had to cram a math major into 4 semesters. In hindsight, it was “worth it” in the sense I got into MIT, but it was an extremely challenging and risky move. YMMV
Shout-out to my 4 classmates who spent 2 hours this afternoon helping me re-work my job talk for Monday's internal seminar.
Couldn't do it without these folks!
First, dissertation research is way, way more enjoyable with a friend. Your JMP journey will have a lot of ups and downs. It’s much easier to brainstorm through problems, encourage, and hold each other accountable as a team.
Homeownership is one of the few ways to make leveraged investments that build generational wealth he mutters to himself as the sewer line backs up into the laundry room for the third time this month
@toddrjones
I think it just depends on what the candidate’s goals were. I think it’s a bummer when someone was really hoping for an academic placement and doesn’t get it. The good options in industry are a nice consolation though. If that was the goal all along, good for them!
Can we start a letter-writing campaign to convince Carl Shapiro and Hal Varian to write a new edition of Information Rules?
It's incredibly prescient about the evolving digital economy (in 1999!), but a new version could cover so many great examples from the past 25 years.
BTW, we became friends when we were arbitrarily chosen to co-organize the labor lunch. So I will also take this opportunity to plug the incidental benefits of department service!
The fall of the Galactic Empire and subsequent demilitarization of the New Republic shifted formal infantry employment into informal mercenary markets. In this paper, we use this supply shock of bounty hunters to estimate the wage elasticity of
One reason that JMP culture is moving away from strict single-authorship is because the rest of the field has shifted away from single-authorship (49% in 2000 vs. 23% in 2017 in my data). Solo-authorship is not very efficient given the high returns to scale of research teams.
I would not recommend getting strep throat at anytime. But if at all possible, avoid getting it during a global pandemic when your wife is 39 weeks pregnant.
Two thoughts on virtual academic conferences.
1) The networking benefits of in-person cannot be replicated online. I think this is by far the biggest cost of online.
2) The diversity of speakers you can get is much better. I see huge benefits for cross-discipline interaction.
@DKThomp
Need to be careful interpreting this. Respondents were asked to pick ONE source they trusted. Largely the plot reflects media concentration on the right and not left
Six months ago, I swear I couldn't even flatpick a major scale. So let me plug my instructor, Patrick Boyer. He teaches from Nashville over zoom, and his lessons have been a highlight of my locked-down life. Check the link below or DM me for details if you're looking for lessons!
Economists have long characterized the reward system for innovation (patents, academic papers, etc.) as winner-take-all races. This extreme allocation of credit affects how we think about R&D investment, innovation strategy, and the pace and direction of science.
Publishing is fun, but
@econimate
covering your paper? that's a thrill 😎
This is a fun summary of our work on competition in science using data from structural biology (it is also
@carolyn_sms
's JMP!)
Estimating the cost of getting scooped is tricky!
The key data problem is selective abandonment. If I get scooped, I may decide to drop the project altogether, or change the paper such that it no longer resembles the original paper.
This is an incredible visualization of how rejection is a part of academic life. The problem is that we RARELY see these examples as young researchers. If more people were candid about rejection like
@JohnHolbein1
, academia would be a much healthier space!
But there is almost no empirical evidence about the actual allocation of rewards in these races.
What is the effect of getting scooped?
In a close race, how much more credit do we give the “priority” (ie first) publication in terms of journal placement, citations, etc.?
My take: The unfair admissions system at Ivy+ schools are a relatively minor distortion (few people affected) that helps fund a massive research infrastructure that has extremely broad benefits.
Here’s what we do:
1) Link identical projects by different teams using the amino acid sequence that defines the proteins
2) Find cases where the two teams independently deposited around the same time
3) Compare outcomes of winning and scooped projects
Have you ever dreamt of settling the moon and establishing an anarcho-syndicatist utopia??
Have we got a book for you!
The
#EconTwitter
sci-fi book club will meet in December to discuss Ursula K LeGuin's classic novel "The Dispossessed". Details below!
The great thing about eTOC notifications from Econ journals is they remind you about your favorite working papers from 5 years ago. Bit of nostalgia in your inbox
I just cold-connected with a biologist on LinkedIn by cramming a research question into the 300 character request note so I didn't have to pay for LinkedIn's premium mail option. Just like the old collect-call trick I hear about from the 90s. 😎