What happens when an LLM is asked to use information that contradicts its knowledge? We explore knowledge conflict in a new preprint📑.TLDR: Performance drops, and this could affect the overall performance of LLMs in model-based evaluation.📑🧵⬇️ 1/8.#NLProc #LLM #AIResearch

Tokenization is most likely the reason whenever I had a bug in my model 🫠.

RT @BafnaNiyati: 📢When LLMs solve tasks with a mid-to-low resource input/target language, their output quality is poor. We know that. But c….

RT @ChengleiSi: Are AI scientists already better than human researchers?. We recruited 43 PhD students to spend 3 months executing research….

RT @nouhadziri: 📢 Can LLMs really reason outside the box in math? Or are they just remixing familiar strategies? . Remember DeepSeek R1, o1….

RT @chrome1996: Have you noticed….🔍 Aligned LLM generations feel less diverse?.🎯 Base models are decoding-sensitive?.🤔 Generations get more….

RT @mdredze: Our new paper explores knowledge conflict in LLMs. It also issues a word of warning to those using LLMs as a Judge: the model….

🛠️ Interested in how your LLM behaves under this circumstance? We released the code to generate the diagnostic data for your own LLM. @mdredze @loadingfan .8/8.

🔗 Takeaways for practitioners.1. Check for knowledge conflict before prompting. 2. Add further explanation to guide the model in following the context. 3. Monitor hallucinations even when context is supplied. 7/8.

📏 Implications:. ⚡When using an LLM as a judge, its parametric knowledge could lead to incorrect judgment :( . ⚡ Retrieval systems need mechanisms to detect and resolve contradictions, not just shove text into the prompt. 6/8.

🧠 Key finding #3:. “Just give them more explanation?” Providing rationales helps—it pushes models to lean more on the context—but it still can’t fully silence the stubborn parametric knowledge. 5/8.

⚖️ Key finding #2:. Unsurprisingly, LLMs prefer their own memories. Even when we explicitly instruct them to rely on the provided document, traces of the “wrong” internal belief keep leaking into answers. 4/8.

⚠️ Key finding #1:. If the task doesn’t require external knowledge (e.g., pure copy), conflict barely matters. However, as soon as knowledge is needed, accuracy tanks when context and memory disagree. 3/8.

🛠️ We create diagnostic data that….- Agrees/Contradicts with the model’s knowledge.- Contradictions with different levels of plausibility.- Tasks requiring different levels of knowledge .2/8

👉 📑

RT @BafnaNiyati: We know speech LID systems flunk on accented speech. But why? And what to do about it?🤔Our work (I….

RT @tpimentelms: A string may get 17 times less probability if tokenised as two symbols (e.g., ⟨he, llo⟩) than as one (e.g., ⟨hello⟩)—by an….

RT @alex_gill_nlp: 𝐖𝐡𝐚𝐭 𝐇𝐚𝐬 𝐁𝐞𝐞𝐧 𝐋𝐨𝐬𝐭 𝐖𝐢𝐭𝐡 𝐒𝐲𝐧𝐭𝐡𝐞𝐭𝐢𝐜 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧?. I'm happy to announce that the preprint release of my first project is on….

RT @fangcong_y10593: Solving complex problems with CoT requires combining different skills. We can do this by:.🧩Modify the CoT data format….

RT @krisgligoric: I'm excited to announce that I’ll be joining the Computer Science department at @JohnsHopkins as an Assistant Professor t….