Rotem Dror
@DrorRotem
Followers
325
Following
544
Media
3
Statuses
199
Asst. Prof. of Natural Language Processing @UofHaifa
Joined November 2018
Tomorrow morning (9AM🌅) I'll be giving a keynote talk at LAW (linguistic annotation workshop) at #ACL2025 on annotations in the era of LLMs - see you there!!🌟🌟.
0
3
17
RT @NitCal: The Alternative Annotator Test (alt-test) is a new statistical procedure proposed in our ACL 2025 paper! 🇦🇹🇦🇹 @DrorRotem @roir….
arxiv.org
The "LLM-as-an-annotator" and "LLM-as-a-judge" paradigms employ Large Language Models (LLMs) as annotators, judges, and evaluators in tasks traditionally performed by humans. LLM annotations are...
0
1
0
RT @NitCal: Everyone uses LLMs to annotate data or evaluate models in their research. But how can we convince others (readers, collaborato….
0
19
0
RT @MikeE_3_14: 🔥הסקירות ממשיכות לזרום ל-X🔥.🧵.המאמר היומי של מייק: 25.06.25.The Alternative Annotator Test for LLM-as-a-Judge: How to Stati….
0
7
0
RT @NitCal: Preferences drive modern LLM research and development: from model alignment to evaluation. But how well do we understand them?….
0
17
0
This is your chance to uncover revolutionary research, forge invaluable connections, and become part of the AI innovation wave. Conference dates: May 25-27, 2025 📷 Information and registration:
lnkd.in
This link will take you to a page that’s not on LinkedIn
0
0
0
Keynote speakers: . Hod Lipson, Mechanical Engineering, Columbia University, USA .Prof. Mor Naaman, Information, Cornell Tech, USA .Prof. Tanya Berger-Wolf, Computer Science & Engineering, Ohio State University, USA.
1
0
0
Explore AI's transformative power across diverse fields, including robotics, biomedicine, environmental science, social sciences, and the humanities.
1
0
0
Witness cutting-edge research by the University of Haifa's brightest minds, including pioneering work by our researchers and graduate students. Be inspired by world-renowned keynote speakers and gain practical knowledge from leading industry talks.
1
0
0
Join us at the University of Haifa for the HiAI Conference, a dynamic event at the forefront of Artificial Intelligence. Immerse yourself in groundbreaking discoveries, gain exclusive insights into the latest advancements, and navigate the future of AI with leading experts.
1
0
1
RT @NitCal: In our new preprint, @roireichart ,@DrorRotem and I propose a new statistical procedure:.The Alternative Annotator Test (alt-te….
arxiv.org
The "LLM-as-an-annotator" and "LLM-as-a-judge" paradigms employ Large Language Models (LLMs) as annotators, judges, and evaluators in tasks traditionally performed by humans. LLM annotations are...
0
3
0
RT @roireichart: Check out our new pre-print on statistically sound methodology to verify the quality of LLM-as-a-judge annotation. @NitCal….
0
2
0
A few months ago I told you that I'm working on something awesome and I need some datasets. well here is the first output of that effort and I sincerely think it's amazing 🤩 check it out! @NitCal @roireichart #llm-as-a-judge, #nlpevaluation.
Do you use LLM-as-a-judge or LLM annotations in your research?. There’s a growing trend of replacing human annotators with LLMs in research—they're fast, cheap, and require less effort. But can we trust them?🤔.Well, we need a rigorous procedure to answer this. 🚨New preprint👇
0
7
23
RT @NitCal: Do you think LLMs could win a Nobel Prize one day? 🤔. Can NLP predict heroin addiction outcomes, uncover suicide risks, or simu….
0
8
0
For a new and exciting research about data we need your help! 🤓📑💻.If your dataset meets these criteria, we would love to cite your research and analyze the data - exciting results are guaranteed:).#DataScience #NLP #vision @DMLRJournal.
I am looking for NLP/CV datasets that:.1. include annotator IDs.2. have multiple annotators per item.3. feature interesting tasks (including generation). Any suggestions?.
2
3
11
RT @NitCal: I am looking for NLP/CV datasets that:.1. include annotator IDs.2. have multiple annotators per item.3. feature interesting tas….
0
3
0
RT @hengjinlp: Keynote speech is supposed to be technically sound and enlightening. For students who feel discouraged / unwelcome by any sp….
0
7
0
RT @moranmiz: Excited to have presented our TACL paper about the sensitivity of LLMs to prompt paraphrases at #ACL2024! 📊✨. @guymkaplan, @m….
0
4
0
RT @lotemi_peled: Submission deadline extended- August 23rd! Looking forward to reading your works.
0
2
0