GenBench
@GenBench
Followers
452
Following
102
Media
72
Statuses
193
State-of-the-art generalisation testing in NLP. Tag us for a RT of your NLP generalisation paper tweet!
Joined April 2022
The GenBench workshop is back! Do you work on generalisation (benchmarking) in #NLProc? Submit to the 2nd edition ( co-located with #EMNLP2024. We have a regular track and a ✨collaborative benchmarking task (CBT)✨ that's fully LLM-focused this year (1/6).
1
12
22
That's a wrap! We (@glnmario, @christos_c, @_dieuwke_, @vernadankers, @khuyagbaatar_b, @a_kazemnejad & @ryandcotterell) thank all presenters, authors, reviewers and attendees!! The keynotes, the cats 😻, the posters, the talks and the lively panel: it was fantastic👏 🔥
0
7
48
RT @najoungkim: so proud of @HayleyRossLing for getting a best paper award at @GenBench this year!! 🎉🪅🎉 I'm sure @TeaAnd_OrCoffee would be….
0
6
0
0
2
0
Congratulations!.
so proud of @HayleyRossLing for getting a best paper award at @GenBench this year!! 🎉🪅🎉 I'm sure @TeaAnd_OrCoffee would be too :) check out our paper and share if you think homemade cats are cats!
0
0
3
Come listen to the hot takes of our panelist in the Brickell room! Do we still need generalisation evaluation? 🧐 #GenBench2024 #EMNLP2024
0
3
15
Did you miss the GenBench poster session? Don't worry we've got you, here are (nearly all) posters! 😉 #GenBench2024 #EMNLP2024 Next up: keynote by Sameer Singh at 3!
0
2
13
Last spotlight presentation:. MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models. Unfortunately the authors couldn't make it, the work is kindly presented by their colleague Hengyi Wang 🙏
0
1
1
Continuing with Bastian Bunzeck, presenting. The SlayQA benchmark of social reasoning: testing gender-inclusive generalization with neopronouns.
1
1
3
Next presenter is Jiwoo Lee, presenting. MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models.
1
0
0
Second up, Maxim Kurkim presenting. OmniDialog: A Multimodal Benchmark for Generalization Across Text, Visual, and Audio Modalities.
1
0
1
Spotlight time! Mirella Bueno on. MLissard: Multilingual Long and Simple Sequential Reasoning Benchmarks.
1
1
3
