Shivalika Singh
@singhshiviii
Followers
1K
Following
8K
Media
74
Statuses
2K
Research Engineer @Cohere_Labs @cohere | @huggingface fellow 🤗 | “Research means that you don't know, but are willing to find out” ✨
Lucknow, India
Joined January 2021
LMArena is widely used for model evaluation, but is it measuring true progress? 🔮. In our work, "The Leaderboard Illusion", we reveal:.🔒 Private testing.📊 Data access asymmetries.⚠️ Overfitting risks.🚫 Silent deprecations. Despite best intentions, arena policies favor a few!
9
41
192
RT @mrdanieldsouza: 🚨New Recipe just dropped! 🚨 . "LLMonade 🍋" ➡️ squeeze max performance from your multilingual LLMs at inference time !👀🔥….
0
6
0
RT @_akhaliq: When Life Gives You Samples. The Benefits of Scaling up Inference Compute for Multilingual LLMs
0
29
0
RT @ammar__khairi: 🚀 Want better LLM performance without extra training or special reward models?.Happy to share my work with @Cohere_labs….
0
20
0
RT @Cohere_Labs: In just 3 years, we’ve published 95 papers through Cohere Labs — with contributions and collaboration from over 60 institu….
0
9
0
RT @MLStreetTalk: There are a limited number of spaces left for our first physical event in London on 14th July. Act quickly if you'd like….
0
6
0
RT @Cohere_Labs: Let's get studious. 🏫. This July join the Cohere Labs Open Science Community for ML Summer School. You'll be part of a glo….
0
44
0
RT @jackclarkSF: @amir @steph_palazzolo Worth reading this research which showed it has already been turned into cheat-slop and that meta w….
0
7
0
RT @mrdanieldsouza: 🚨 Wait, adding simple markers 📌during training unlocks outsized gains at inference time?! 🤔 🚨. Thrilled to share our la….
0
17
0
RT @ahmetustun89: Can we train models for better inference-time control instead of over-complex prompt engineering❓. Turns out the key is i….
0
8
0
RT @Cohere_Labs: 🤹 How do we move away from complicated and brittle prompt engineering at inference for under-represented tasks?🤔. 🧠 Our la….
0
13
0
RT @sarahookr: Thanks @_akhaliq for the spotlight on our work. I really believe strongly in this wider direction — of taking the pressure o….
0
10
0
RT @dianaabagyan: 🚨New pretraining paper on multilingual tokenizers 🚨. Super excited to share my work with @Cohere_Labs: One Tokenizer To R….
0
33
0
RT @Cohere_Labs: 3 years ago, we were an empty lab 🫙. @beyzaermis was the first research scientist to make the jump and join a lab with no….
0
4
0
RT @Cohere_Labs: Global MMLU is revolutionizing multilingual AI. 🌍. Recognized by Stanford HAI and adopted by top labs, it's the benchmark….
0
14
0
RT @cohere: We’re proud to partner with the governments of Canada and the UK to accelerate adoption of secure AI solutions in the public se….
0
53
0
RT @Cohere_Labs: How can we make language models more flexible to adapt to new languages after pretraining? 🌏. 🧠 Our latest work investigat….
0
20
0
RT @Cohere_Labs: . and our more recent work on leaderboard reliability led by @singhshiviii @YiyangNan @W4ngatang.@mrdanieldsouza @sayas….
0
1
0
RT @BrainYoung_com: The post highlights "The Leaderboard Illusion," a study by Shivalika Singh and collaborators from institutions like MIT….
0
2
0