llm.c gang w/ @karpathy, Erik, and Arun: aka "avengers" and since Andrej's yesterday talk the "4 pandas team" lol 😂

Hilbert curve schedule:

Warp tiling:

Few visuals i'm really proud of - H100 model:

Blog post:

New in-depth blog post time: "Inside NVIDIA GPUs: Anatomy of high performance matmul kernels". If you want to deeply understand how one writes state of the art matmul kernels in CUDA read along. (Remember matmul is the single most important operation that transformers execute

Amazing blogpost from @gordic_aleksa explaining internals of vLLM😍

for your awareness: @vllm_project, @woosuk_k, @KaichaoYou, @zhuohan123, @mgoin_, @simon_mo_ :)

Blog post:

New in-depth blog post - "Inside vLLM: Anatomy of a High-Throughput LLM Inference System". Probably the most in depth explanation of how LLM inference engines and vLLM in particular work! Took me a while to get this level of understanding of the codebase and then to write up

this is how you position yourself as a research authority

A few weeks ago, I was thrilled for a buddy at @windsurf_ai when the @OpenAI acquisition was announced. I joked in our group chat that he'd be picking up the tab on the next boy's trip. Now, with Google���s acquihire, the news is devastating. Here’s what I’ve gathered: - The

some things just never change eh?

really cool product launch by @MishaLaskin and the team at @reflection_ai! we're currently more bottlenecked by code understanding than code generation

This is a really great point and something I totally forgot about. I've been often thinking there may be future optimization algorithms that may deviate from SGD or be something of a hybrid approach. However if you keep stacking parameters local minima are less of an enemy

🫡

fixed!

formatting on mobile is broken will fix asap

https://t.co/nPPNw62lmy <- blog here or on Medium (where my older blogs live):

started a new blog on my new website, the first one after the flash attn blog i wrote back in 2023! title --> neocambria - humans in the post-ASI world i've been thinking about these ideas for many years, finally found time to sit down and write them all down in a cohesive way.

There are two kinds of people in this world: those who count 1, 2, 3 - and those who count 1, 3, 4