Shubhra K. Karmaker ("Santu")
@karmake2
Followers
248
Following
169
Media
15
Statuses
143
Assistant Professor of Computer Science at Auburn University. Communication Chair of ACL Rolling Reviews (ARR)
Auburn, AL
Joined October 2014
Do you like https://t.co/L8ThvgOKpJ? If yes, how about a similar ranking platform for LLMs? Check out our latest work on the LLM Ranking based on their psychological biases. https://t.co/tk58kIWv50
@ReviewAcl #LLM #NLP @emnlpmeeting @aclmeeting
Do large language models think like humans? Are they also prone to human-like cognitive biases? We just launched a new ranking system of LLMs based on their ability to resist cognitive biases with a large-scale study of 2.8M+ responses across 8 well-known biases.
0
1
4
Job Posting: Postdoc Position Available https://t.co/7gbdK8J6fQ
@ReviewAcl @emnlpmeeting @naaclmeeting @aclmeeting #NLP #postdoc #UCF
0
2
1
We are glad to share our latest NAACL 2025 paper, "LLMs as Meta-Reviewers' Assistants: A Case Study". Read the full paper at: https://t.co/jSdGEgsOFj (1/2)
1
1
1
🚨 We are hiring! 🚨 We are looking for two new members to join our communication team and help support the ARR initiative. If you’re interested, please fill out the following form:
docs.google.com
0
4
9
Our latest paper introduces the pre-evaluation of sentence encoders, similar to pertaining language models!! Pre-evaluation performs evaluation without a specific downstream task, that's why we call it taskless evaluation as well. @ReviewAcl
A big thanks to @eduardo_nlp for his collaboration and significant contributions to this work. Our paper introduces ALIGN-SIM, a novel task-free framework for evaluating and interpreting sentence embeddings based on various semantic similarity alignment criteria. 2/2
0
0
6
🚨 Attention authors! The CFP has been updated for the December cycle. Be sure to double-check the latest requirements: https://t.co/wSE9cYUOdR 📝 We have also updated the author checklist to help you avoid common issues:
0
5
21
The Bangla LLaMA (BongLLaMA) is here.
We are excited to collaborate with BangaLLM to introduce BongLLaMA, the first ever and, of course, the state-of-the-art Bangla LLM (Based on Meta LLaMA). Try it out. @ReviewAcl #EMNLP #ACL #NLP #BanglaAI
@UCFComputerSci
https://t.co/pspbIHYmAR
0
0
6
UCF CS has Ph.D. openings for Fall 2025. Consider applying to @UCFComputerSci @ReviewAcl
https://t.co/ntDJUZVbqz
linkedin.com
Sign in or join now to see posts like this one and more.
0
3
13
Auburn CSSE is a very collegial department. Please consider applying: @AuburnEngineers
https://t.co/PElQ2qqWsu
@ReviewAcl #facultyhiring #AIFaculty #TTFaculty
0
0
5
Please try SEM-F1 and let us know if you see a better correlation with human judgments too!
We are happy to release our text summarization metric, Sem-F1, for public use. https://t.co/BQ6MYrJ2KY Sem-F1 achieves a 25% higher correlation with human judgments than Bertscore on the Overlap Summarization task. Benchmarking paper coming soon. @ReviewAcl
0
0
2
Here goes the Ph.D. # 4 from my lab, Congratulations Naman Bansal @ImBNaman ! Naman joined @Google as a software engineer last month. @AuburnEngineers
1
0
8
I am thrilled as well.
We are thrilled that @karmake2 has joined #UCFCS for Fall 2024! He is one of the 17 new faculty members at @ucfcecs this semester. Join us in welcoming him and learn more about his research and expertise: https://t.co/yfd3vm3eUH
2
0
20
I am starting a new chapter of my career by joining UCF Artificial Intelligence Initiative (Aii) – AII as an assistant professor. @UCFComputerSci @UCFCECS
6
4
45
Suparna is fighting TNBC and needs our support to cover medical expenses. Please consider donating and sharing her GoFundMe. Every little bit helps. Let's stand with her during this tough time. 🙏
gofundme.com
My name is Towfiq and I am writing this crowdfunding post for my frien… M M Towfiqur Rahman needs your support for Stand with Suparna Nandy During Tough Times
6
3
3
Today 11 AM, I will be presenting our paper on state reconciliation for @ansible (infrastructure-as-code) at Acerola in the @FSEconf . In collaboration with @karmake2 and his students. This work benefitted from discussions at a @dagstuhl seminar that I attended in 2023.
Excited to present and discuss five of our papers during the week of @FSEconf . Come join these presentations and discussions. Presented papers are related to #DevOps , infrastructure-as-code, and scientific software. I am also open for collabs!
1
1
10
Freshly baked Ph.D. in Town. Ph.D. #3 from my Lab. Congratulations to Asst. Prof. Dr. @SouvikaSarkar for passing her Ph.D. final defense. I am both happy and sad about it; happy because she will join as an assistant professor @WichitaState, and sad because she will leave soon.
0
2
11
@TUDarmstadt @Tanmoy_Chak @karmake2 @somakaditya @iitdelhi @lcs2lab The second lecture by @karmake2 (@AuburnU) was entitled »Democratizing AI through Controlled Narrative Generation and Conversational Alignment«. You can find out more about Santu here: https://t.co/17YyDwuWW5
We are very excited to welcome Dr. Shubhra K. Karmaker @karmake2 as guest faculty for the next three months at @UKPLab! After holding positions at @MIT, @IllinoisCS, @MSFTResearch & @YahooResearch, Santu is now Assistant Professor at @AuburnU & Communication Chair of @ReviewACL.
1
1
5