
Stephen Pfohl
@stephenpfohl
Followers
1K
Following
2K
Media
9
Statuses
270
Research Scientist at Google Research. Researching #fairness #transparency #causality #healthcare #healthequity
Joined March 2009
Also want to thank the editorial team (@NatureMedicine, @LorenzoRighett7) and reviewers (@MMccradden and anonymous reviewers) for their constructive feedback and support for the work.
0
0
5
This work represents the contributions of many amazing collaborators from @GoogleAI @GoogleDeepMind @MIT @UAlberta, including @hcolelewis @thekaransinghal @DrNealResearch @dr_nyamewaa @adoubleva @weballergy @AziziShekoofeh @negar_rz @LiamGMcCoy @HardyShakerman and many more!.
1
0
8
For a extended summary of key takeaways, check out my prior post about the preprint version of the work:
Excited to share new work on surfacing health equity-related biases in LLMs. We design rubrics covering 6 dimensions of bias, release EquityMedQA, a collection of 7 adversarial datasets, and conduct a large-scale human evaluation study with Med-PaLM 2.
1
1
4
Excited to announce that our paper, “A toolbox surfacing health equity harms and biases in large language models” is now published with @NatureMedicine:
Identifying a complex panel of bias dimensions to be evaluated, a framework is proposed to assess how prone large language models are to biased reasoning, with possible consequences on equity-related harms.
1
9
58
RT @zakkohane: Red teaming LLM’s w @TristanNaumann @MSFTResearch @stephenpfohl @GoogleResearch #SAIL2024 #AI detecting threats across t….
0
7
0
RT @SAILhealth: As our attendees settle in the @hyattregencypr, we get ready for a deep dive into medical AI with @TristanNaumann and @step….
0
4
0
RT @thekaransinghal: Excited to share our newest work! 📝 Evaluation of LLMs is hard, especially for health equity. We provide a multifacete….
0
26
0
This work represents the contributions of many amazing collaborators from @GoogleAI, @GoogleDeepMind, @MIT, @UAlberta, including @hcolelewis @thekaransinghal @DrNealResearch @dr_nyamewaa @adoubleva @weballergy @AziziShekoofeh @negar_rz @LiamGMcCoy @HardyShakerman and many more!.
0
2
6