really wish more talks in CS/ML were like this (surely seminars, maybe confs?). It's quite obv that over a uniform sample of accepted Neurips papers, Pr[results will be insightful] << Pr[hearing about the "behind the scenes" of the project will be insightful] (for me personally).

RT @NitCal: 🥳🥳.Happy to share that we have three papers accepted to EMNLP 2025 🇨🇳 (2 main, 1 findings)! . What makes this special is that a….

+100 for this (surprisingly short) take! "writing the paper" is not something that happens at the END of a research project. it's an integral part of it. personally, blindly offloading that part to an LLM would be the surest way to hurt the quality of my research.

RT @AFarfuri: 🪻

RT @sh_reya: new blogpost on writing in the ~glorious~ age of LLMs

new work by @pybeebee shows that LLMs still struggle to faithfully express their uncertainty in words, but cool to see that meta cognitive inspired prompting can go a long way. looking forward to seeing more positive results on this fundamental problem!.

RT @JoshBreiner: מצב המשטרה: השתמשה בצ'ט GPT שהמציא עבורה חוק חדש על מנת לנצח בהליך להחרמת פלאפון בדיון בבית משפט השלום בחדרה. השופט היה המ….

RT @yoavgo: we write too much. more than we can read, and many small incremental things. i think there should be some mechanism to restrict….

RT @doodlestein: @sama the single biggest thing you could do for safety/alignment is to put a massive emphasis in the RL feedback loop on b….

This was a great 30-minute conceptual read. It neatly ties together classic RL, LLMs of the past few years, and where agents are headed next. Honestly, I find the future of agents interacting w the world with less human mediation ("experiencing") both exciting and terrifying.

[[ for kicks, I asked chatGPT to rewrite my tweet in MAVERICK style. very useful in truly bringing home the message of how obnoxious this response style truly is!!! 💅💅 ]]

tbc, I’m not saying the benchmark is useless. If you're optimizing purely for likability, it’s probably useful to know that the average user enjoys this kind of overly enthusiastic fluff. but it can't be taken seriously as a measure of utility for general-purpose LLMs.

with the battles being public, it’s now glaringly obvious that completely unfactual responses can easily win, so long as they’re delivered in an aggressively upbeat tone and cheerfully long-winded style.

my completely personal take: Llama-4 blatantly gaming the Chatbot Arena evals (beyond being a neat example of Goodhart’s law in action!) is an important moment for the NLP community ⏩.

RT @stanfordnlp: .@percyliang & @tatsu_hashimoto start the 2nd offering of CS336 Language Modeling from Scratch at @stanfordnlp. The class….

RT @zorikgekhman: 🚨 It's often claimed that LLMs know more facts than they show in their outputs, but what does this actually mean, and how….

RT @srush_nlp: Simons Institute Workshop: "Future of LLMs and Transformers": 21 talks Monday - Friday next week. h….

For practitioners, CISC is a minimal change to SC that you should just try out 💪 For those interested in confidence/self verification, our work provides lots of interesting insights. Check out the paper and amir's thread for details!.

Excited for this work to be out 😀 . Self consistency is great but v expensive (especially when you care about those last few acc points). We show: switching to a *weighted* majority vote (weights = confidence scores derived by the model itself) is way more sample efficient! 1/n.

RT @rm_rafailov: We have a new position paper on "inference time compute" and what we have been working on in the last few months! We prese….