
Adam Rodman
@AdamRodmanMD
Followers
18K
Following
15K
Media
1K
Statuses
15K
Physician, educator, historian, author, podcaster, researcher @BIDMC_IM @HarvardMed, host of #histmed podcast @BedsideRounds, AE @NEJM_AI, studies 🤖+🧠. 🖖🚲
Joined March 2010
It's time for me to channel my inner @tony_breu -- which means it's Tweetorial time!. So let's talk about azotemia (elevated blood urea nitrogen) after an upper gastrointestinal bleed!
14
223
488
Huge update to our preprint today on the superhuman performance of reasoning models in medical diagnosis!. TL;DR – they don't just surpass humans in meaningful benchmarks, but in actual medical care from unstructured clinical data: . A 🧵⬇️:.
Preprint out today that tests o1-preview's medical reasoning experiments against a baseline of 100s of clinicians. In this case the title says it all: . Superhuman performance of a large language model on the reasoning tasks of a physician. Link: A 🧵⬇️.
16
107
562
They're called discharge summaries for a reason, not "discharge copy-pasted-crappy-progress-note-that-lists-every-little-thing-that-happened-during-a-hospitalization.".
10
39
398
Why are medical podcasts like @thecurbsiders, @BehindTheKnife, @emcrit, and @AFPpodcast so popular for learning? And who is making them? And can they be trusted?. We listened to (and coded) the top 100 podcasts on the Apple podcasts US medicine chart to find out!. A 🧵⬇️
14
106
371
It’s time for another #histmed Tweetorial -- this time I'm going to talk about the pesky definition of a fever, and where the 98.6 F average body temp came from! . Full disclosure: will use C AND F for temp, but no K or R.
9
122
331
The quality improvement movement hasn't improved healthcare quality, especially when taking into account the massive amount of money and manpower we spent collecting and analyzing quality metrics. A new paradigm is necessary.
19
26
324
Our first RCT on using an LLM on diagnostic reasoning is out! . And the results are 🔥🌶️. adding ChatGPT did NOT improve diagnostic accuracy or reasoning, and the AI alone outperformed ALL the humans. What does this mean? A 🧵⬇️.
A small randomized trial of generative #AI for diagnosis again (as seen in a few previous studies) shows higher performance for #AI than physicians + AI. May indicate that physicians need to be trained on how to incorporate AI.
14
89
303
The other day, I walked in to one of my severely demented patients with her hair beautifully done in a complex braid. One of our aides had washed and braided it for her. Such simple, little acts show so much humanity.
One of the greatest honors in our profession is witnessing the beautiful acts of kindness nurses do for patients every day:.- sweet conversations about children and families.- relieving shame of the body and its functions.- respect for and relief of pain.
6
32
282
Almost exactly a year ago, I had a modestly controversial tweet about routine daily physical exams -- and about how we should probably spend more time actually talking to our patients daily rather than pretending to examine then.
The reason to do a physical exam (or pieces of a physical exam) is because it helps you make decisions about caring for the patient. If you want to connect with them, maybe spend that time talking to them, instead of pretending to listen to their heart and lungs?.
10
55
281
There is a lot of buzz about our new paper in Nature Medicine on the effects of LLMs (GPT-4) on physician management reasoning! I had TONS of fun working on this -- but what it MEANS requires some unpacking. A 🧵⬇️.
A randomized trial of GPT-4 vs 92 physicians with or without this #AI LLM for performance on patient care tasks. AI improved physician performance, on par with AI alone (based on 5 clinical vignettes) @NatureMedicine @AdamRodmanMD @jonc101x
8
93
286
Our new study in @JAMAInternalMed looking at the reasoning abilities of GPT-4 compared with human physicians just came out. Big picture: AI displays (much) better reasoning than humans, makes diagnoses similarly, but hallucinates considerably more. A 🧵to put in context ⬇️.
How good is #AI at clinical reasoning? An early, simulated assessment.“An LLM was better than physicians in processing.medical data and clinical reasoning using recognizable frameworks as measured by R-IDEA”
8
76
245
For anyone bemoaning the "good old days", an experiment in which 10 healthy medical students were made to drink blood to figure out the volume necessary to produce melena. TL;DR 50-80 mL @mondhiry . (-- 1939!).
15
38
232
Can GPT-4 solve really hard medical cases and come up with a good list of differential diagnoses? . @zahirkanjee @byrondcrowe and my study is out in @JAMA_current , and the short answer is, “Yes.” . But what does this all mean? 🧵⬇️
In this study, a generative artificial intelligence (AI) model provided the correct diagnosis in its differential in 64% of challenging cases and as its top diagnosis in 39%.
19
74
231
Hey everybody. I'm putting @BedsideRounds on hiatus for the time being. As a hospitalist (an inpatient internal medicine doctor) in Massachusetts, I expect the next several weeks will be some of the busiest of my life. Good luck to everyone. We're all in this together.
18
8
198
Okay, I think it's time to be a party pooper here. It's very hard to prove a negative -- but unless someone has a primary source that proves otherwise, I'm pretty sure this is a myth (that lasix is named because it "lasts six hours") A brief 🧵.
14
32
185
Incredibly honored to be recognized as @bidhospitalists teacher of the year by my amazing residents @BIDMC_IM! I'm glad you guys appreciated my pressured ranting and late night deep dive emails (instead of just thinking I'm a crazy person) 😀
24
4
166
My (preaching to the choir) 🔥 take: digital educational skills -- whether teaching on #MedTwitter, podcasting, or making videos -- are essential #meded skills for the 21st century. And we can teach these to future educators. A Tweetorial🧵:.
6
36
119
#spoileralert: a lot of things. And if you’re interested in that, I produce an entire podcast of medical history and how modern medicine came to be called @BedsideRounds. You can even get CME credit if you're a member of @ACPinternists!
6
13
123
Well, this was not expected! @BedsideRounds is now written up in the @bmj_latest as one of "five podcasts every medical student should listen to!" Thanks to Anna-Lucia Koerling (the author, who I'm not sure is on Twitter) -- I'm glad you enjoy, and incredibly honored!.
8
6
118
This past Tuesday, I was honored to help plan and participate in what I think is the first ever clinicopathologic conference (CPC) with an artificial intelligence (Dr. GPT-4) discussant @BIDMC_IM. It was… eerie. to say the least. These were my experiences: 🧵⬇️.
📢Who do you think reigns supreme for today's Clinicopathology Conference (#CPC) ?. Dr. @stephcabral_ vs Dr. Kevin He vs Dr. @AdamRodmanMD vs ChatGPT.
8
42
120
This is that happens when you ask me to lecture about anything I want 😂. Coming Tuesday @BIDMC_IM! Putting all the reading I've done over the past two years to explore the McKeown thesis into some clinical context. Hope to see all my residents there!
7
6
116
Another wonderful piece by @VPrasadMDMPH. For those applicants who had high school or college jobs bagging groceries, working as a waiter, &c, PUT IT ON ERAS!. I know you don't believe me now, but food service has far more relevance to practicing medicine than pipetting in a lab.
7
15
109
How should we feel about the incoming deluge of AI-generated text in our electronic health records? . (if you don’t want to read, the answer is, “not good”). 🧵 from my piece with @arjunmanrai and @LiamGMcCoy ⬇️.
Concerns about the potential adverse impact of LLMs on electronic health records. @NEJM today, by @LiamGMcCoy @arjunmanrai .@AdamRodmanMD .
10
35
106
If you couldn't make it. I'll be live tweeting the @BIDMC_Education conference on AI, clinical reasoning, and the future of medical education! @iMedEducation
1
16
106
About a month ago, I commissioned @sukritibanthiya to draw this AMAZING image to celebrate six years of @BedsideRounds (and to finally provide some swag) -- and it turned out better than I could have ever imagined!. And now I've set up a @TeePublic store:
13
16
104
@GavinPrestonMD "Hi, my name is Adam Rodman and I'll be your doctor. You can call me Adam if you'd like. How would you like me to call you?" - every patient I meet for the first time. Asking someone how they'd like to be referred to is a mark of respect, not the other way around.
6
8
99
So excited to speak on what I think is one of the most exciting innovations in medical education in the last decade @BIDMC_Academy with @tony_breu and @ShreyaTrivediMD! . One of the things I find so wonderful is how much the format has evolved over the past year. A brief 🧵👇
4
19
100
Many of us already listen to amazing medical podcasts like @TheCurbsiders, @CPSolvers, @NephJC_Podcast, @medrants #AnnalsonCall in our own time . -- but will medical podcasting be integral to medical education?
9
30
92
Do large language models have a probabilistic understanding of disease states? And what does this mean for the future of diagnosis and clinical reasoning?. I explore this with Thomas Buckley, @arjunmanrai, and @dr_dmorgan in our new paper in @JAMANetworkOpen. A brief 🧵⬇️
8
27
95
If you couldn't attend my grand rounds at @WUDeptMedicine, it has been uploaded to YouTube! (. Again -- thank you so much for having me (and to @MohitHarshMD for a way-too-gracious introduction).
7
16
93
Are there better colors to use in a modern powerpoint? @JenniferSpicer4 pointed me to this modern research on PPT presentations -- it's actually remarkably similar to research in the 1970s showing black on white is the most readable! (and blue among the least)
2
14
93
I am giving my most expansive grand rounds for the first time ever tomorrow at @BIDMC_Medicine -- Medicine Without Disease: AI, Diagnosis, and the Future of Medicine. I haven't given a historical talk in almost a year.
5
12
95
@jbcarmody @drwangmd So I don't know the actual answer (the idea of "panels" that are reimbursed at certain rates seems to be a post-WW2 phenomenon), but the tests (or their precursors) on the Chem7/BMP/&c were developed by Otto Folin c1909; phos and mag levels were developed until the 1920s.
3
0
81
Do you make Tweetorials, infographics, medical podcasts, or streaming videos for medical education?. Or have you ever wanted to try?. You're a digital educator -- and we have exciting news! This year's @iMedEducation #DigitalEducation2022 conference has a teaching competition!
3
24
87
We don't let long haul truckers do it. We don't let pilots do it. Remind me how we work for an "evidence-based" field again?.
I worked an unexpected overnight last night. This 🧵 is an exhausted, muddy-headed takedown of the historic but continued saddling of medical trainees with ridiculous work hours. There will be no data and I will appeal to emotion a lot. Here we go!. #MedTwitter . 1/.
2
12
81
@MElashwal97 @CNemehMD @samsfeelinggood Oh man -- I'm probably going to make a lot of people mad :). But I think the folk belief exists because there's some truth to it (see, eg, this fascinating RCT: .
11
7
80
Very exciting news! @ShreyaTrivediMD and I co-founded @iMedEducation @BIDMC_Medicine earlier this year, dedicated to the advocacy and study of all types of digital education, and we are hosting a (virtual) national conference on January 22nd. We want you to come!. A brief 🧵⬇️
6
16
75
I am SO excited to give @BIDMC_IM Gen Med grand rounds tomorrow! . ➡️What does it mean to make a diagnosis?.➡️Why do collect data from our patients the way that we do?.➡️Why do we call it "data"? .➡️Why are we so miserable with the EMR?.➡️Will computers replace us?
12
1
81
Hey guys! @tony_breu and I are looking professorly for our live podcast on the history of syphilis! Room 114 -- come and join us! #IM2019 #Curb19
4
2
77
@reverendofdoubt When I'm working on a solo service, I tell my discharging patients that they have to ask me three questions before I'll leave their room. Always get some interesting questions 😀.
4
3
80
I am going to force my poor residents to play a Dungeons and Dragons roleplaying session to learn about myths in hospital medicine (maybe I can call it Wards and Wizards??). Any ideas for classes for the game for their characters?. @cjchiu @BrighamSK
15
4
78
Well, now that angry tweet is a point-counterpoint-rebuttal series in @JHospMedicine! . The first piece is by me and @ShaneWarnockMD, and I cut right to the point: Routine daily physical exams in hospitalized patients are a waste of time. 🧵⬇️. or .
8
18
81
Should we mourn CMS ditching the review of systems documentation requirements? Or celebrate? Or something else?. @Gurpreet2015 and I I think is a HUGE opportunity for medical educators to better teach history taking -- and clinical reasoning. A 🧵⬇️
5
20
77
So thankful to @BIDMC_Medicine for inviting me for super esoteric topics for gen med grand rounds! (and to @_JosephLi for an over-gracious introduction!)
6
5
76
Today @AvrahamCooperMD and my essay on AI/LLMs and medical education comes out in @NEJM , about the challenges our field faces and what we should do about it. I wanted to give some context for this essay, and talk about some of the things we can be doing NOW. A brief 🧵⬇️.
Medical educators have a crucial role in shaping the inevitable integration of AI into the healthcare. @AdamRodmanMD and I wrote about it in NEJM ⬇️.
1
26
76
And that is how you end up with this guide to a national scientific conference in 2006 and the advice that @jbcarmody references to only use this at national meetings
4
4
75
While neck deep in stats papers from the 1940s, I just realized that receiver operator characteristic curves are thus named because they were developed for radar receiver operators looking for aircraft in WW2. How did I not realize that until now?! @adamcifu.
5
2
69