We introduce CodeARC, a new benchmark for evaluating LLMs’ inductive reasoning. Agents must synthesize functions from I/O examples—no natural language, just reasoning. 📄 💻 🌐 #LLM #Reasoning #LLM4Code #ARC

Presented our work on how to design a PL for LLM code gen at @llm4code yesterday! If you're interested, please checkout our X account @moonbitlang and play with MoonBit at

@llm4code 2024 gets a full house! Join us at room Luis de Freitas Branco! #icse24

Had a great time presenting our work “MetaReflection: Learning Instructions for Language Agents using Past Reflections” .At @emnlpmeeting. PS: I am also a prospective PhD student & would love to chat if your lab is exploring LLM agents learning from failures or LLM4code.

Introducing Nova, a series of foundation models for binary/assembly code. We have also released fine-tuned models for binary code decompilation. #LLM #LLM4Code #BinaryAnalysis #Security @NanJiang719, Chengxiao Wang, Kevin Liu, @XiangzheX, Xiangyu Zhang, Petr Babkin.

Nice view from Luis de Freitas Branco, where @llm4code 2024 will happen in an hour 🚀 #icse24

We’re thrilled to share that RepairBench has been accepted into @llm4code at @ICSEconf ! 🎉. In RepairBench, we provide a standardized, execution-based evaluation of all frontier models for program repair, with new models being added almost weekly.

Starting the @llm4code workshop at @ICSEConf, with opening remarks by @LingmingZhang . we'll be talking about applications of Large Language Models in Software Engineering. You can still attend ! :-)

Very excited to share the 1st @llm4code workshop has attracted 170+ registrations! . If you’re at @ICSEconf and interested in LLMs, pls join us on April 20, we have 24 presentations and two keynotes on Code Llama (@b_roziere) and StarCoder2 (@LoubnaBenAllal1)! #icse24 #llm4code

Last week, I enjoyed a visit to Japan, where I participated in the FM+SE #Shonan seminar & gave a talk about our #LLM4Code studies in @AISE_TUDelft at the FM+SE Summit 2024 Tokyo!. Big thanks to Prof. Ahmed Hassan, Jack Jiang & Kamei Yasutaka for organizing this incredible event

#ICSE Come and talk with us @BytedanceTalk at the open space at @ICSEconf about LLM4Code, agents and anything related to coding and development!

@katzy_jonathan presenting our #FORGE24 paper on “An Exploratory Investigation into Code License Infringements in Large Language Model Training Datasets”!. Talk to him if U are interested in the data used for training a wide range of #llm4code and their implications!.@ConfForge

🚨 Preprint Alert: Empirical study of the perception and usage of LLMs in an academic software engineering project. Accepted at #LLM4Code workshop co-located with #ICSE 2024. Provides insights into the role of LLMs for SE in an academic setting.

Truly exciting keynote at @llm4code on SWE-Bench and SWE-Agent. AI software engineer is in action. #SoftwareEngineering #debugging

Now hearing about industry study on using AI assisted programming at #icse2024 workshop LLM4Code

🗞️Résoudre les problèmes subsistants liés à l’utilisation d’#IA générative pour concevoir des logiciels, améliorer à la fois la productivité & la fiabilité de ces assistants de développement : c’est l’objectif du défi Inria LLM4Code. En savoir ➕⤵️.

And last in this session also very insightful paper on best practices to test driven dev using LLMS at #icse2024 LLM4Code workshop

Super interesting case studies with different audience acceptance of rapid prototyping using LLM chatbots at #icse2024 LLM4Code workshop

## MoonBit: The AI-Friendly Programming Language of the Future 🌕🤖. **#LLM4Code 2024** will see the unveiling of MoonBit, a revolutionary programming language designed for the AI era! 🤯. **Key features:**. * **End-to-end workflow:** Focus on expressing ideas, not tools. AI will