Labeling preferences online for LLM alignment improves DPO vs using static prefs. We show we can use online prefs to train a reward model and label *even more* preferences to train the LLM. D2PO: discriminator-guided DPO. Work w/ @natolambert @scottniekum @tanyaagoyal @gregd_nlp

RT @LiyanTang4: Introducing ChartMuseum🖼️, testing visual reasoning with diverse real-world charts!. ✍🏻Entirely human-written questions by….

RT @thomlake: Interested in how alignment changes the response distribution defined by LLMs? Come check out my poster at 2 PM at #NAACL2025….

RT @gregd_nlp: Check out Ramya et al.'s work on understanding discourse similarities in LLM-generated text! We see this as an important ste….

RT @ManyaWadhwa1: Evaluating language model responses on open-ended tasks is hard! 🤔. We introduce EvalAgent, a framework that identifies n….

RT @gregd_nlp: Check out Manya's work on evaluation for open-ended tasks! The criteria from EvalAgent can be plugged into LLM-as-a-judge or….

RT @SriramPad05: Are LMs sensitive to suspicious coincidences? Our paper finds that, when given access to knowledge of the hypothesis space….

RT @AnirudhKhatry: 🚀Introducing CRUST-Bench, a dataset for C-to-Rust transpilation for full codebases 🛠️.A dataset of 100 real-world C repo….

RT @gregd_nlp: New work led by @LiyanTang4 with a strong new model for chart understanding! Check out the blog post, model, and playground!….

RT @gregd_nlp: Check out Anirudh's work on a new benchmark for C-to-Rust transpilation! 100 realistic-scale C projects, plus target Rust in….

RT @madiator: Happy to announce Bespoke-Minichart-7B!. This was a tough cookie to crack, and involved a lot of data curation and modeling w….

RT @tanishqkumar07: trained a nanoGPT? feeling behind before o4-mini?. 🚨🚨i'm open-sourcing beyond-nanoGPT, an internal codebase to help peo….

RT @jacspringer: Training with more data = better LLMs, right? 🚨. False! Scaling language models by adding more pre-training data can decre….

RT @jessyjli: 🌟Job ad🌟 We (@gregd_nlp, @mattlease and I) are hiring a postdoc fellow within the CosmicAI Institute, to do galactic work wit….

RT @ZayneSprague: Interesting perspective, thanks for sharing! As one of the authors of the “CoT mainly helps on math/logic paper”, I agree….

RT @xiye_nlp: 🔔 I'm recruiting multiple fully funded MSc/PhD students @UAlberta for Fall 2025! Join my lab working on NLP, especially reaso….

RT @ManyaWadhwa1: I'll be presenting this work at #EMNLP2024 🌴on Tuesday, 4-5:30pm, Poster Session C in Jasmine Hall ! . Stop by or reach o….

RT @RyoKamoi: We will present our survey on self-correction of LLMs (TACL) at #EMNLP2024 in person!. Oral: Nov 12 (Tue) 11:00- (Language Mo….

RT @gregd_nlp: I won't be at #EMNLP2024, but my students & collaborators are presenting:.🔍 Detecting factual errors from LLMs @LiyanTang4….

RT @LiyanTang4: Great to see an independent measurement of MiniCheck in hallucination detection!. Repo: Model: http….

RT @gregd_nlp: At COLM w/.@ManyaWadhwa1: work on 🧑‍⚖️ using NL explanations in evaluation.@prasann_singhal: work on (1) 📈 length correlatio….