pun
@trenchie
Followers
2K
Following
676
Media
12
Statuses
481
dropped another small kernel for flash-attention 2. Missing some features (i.e. no persistent kernel launch, no jagged sequences, no causal masking), but the core concepts of the algorithm (while using the full power of tensor cores and TMAs) is covered in ~500 lines of code for.
4
2
20
people who don't take the 2 seconds to write out a full variable names need therapy.
1
0
2
Tsinghua Smarter than MIT, Stanford, CMU.
1
0
10
Does anyone have an H100 bare-metal node that I could use to debug kernels? I am not planning on using the compute on it. I just need to run Nsight Compute a few times a day.
0
0
1
what a scam, no one is playing games with me.
Unemployed people are so puppy coded like oh you slept all day while I was at work and now you're happy l'm home to play games with you? Mm ok.
0
0
6
RT @ChangJonathanC: while we wait for gpt-5 to drop. Here is a flex attention tutorial for building a < 1000 LoC vllm from scratch. https://….
jonathanc.net
PyTorch FlexAttention tutorial: Building a minimal vLLM-style inference engine from scratch with paged attention
0
37
0
i am 11.
11% of all young people are considered NEET—meaning not in employment, education, or training, per FORTUNE.
0
0
2
wtf.
Something we discovered by accident: what happens if we start Genie 3 from a video and a completely unrelated prompt? Turns out the model really, really wants to make it work, to the point where it emulates itself. The prompt in this one is about a trex on a tropical island.
0
0
1
RT @peterboghossian: One deliverable from Peter Thiel’s talk: . If it’s forbidden to be spoken about, it’s likely true. .
0
671
0
there is no philosophy behind oxytocin, dopamine, and the myriads of other random shit that gets released in your brain during random events. all you can quantify is how much overall joy or pleasure it gives you and at what cost. we are animals.
Sex > Philosophy. This is what philosophers have been hiding all along. - Letter from friend to Machiavelli
0
0
3
so pretty.
📢 Incredibly excited to announce I signed with a publisher!. My retro tycoon game 'Car Park Capital' will be published by @micro_prose!.The one behind classics like Transport Tycoon and Civilization. Go watch the trailer!. Thanks for the support so far! 🙏
0
0
0
the most common red flag of poor thinking is scaling complexity of ideas without scaling quality of ideas.
1
0
1
jensen.ilya.lee kuan yew.deng xiao ping.
“Greatness does not come out of intelligence, it comes from character. Character is not formed out of smart people: it is formed out of people who have suffered.”. — Nvidia CEO, Jensen Huang
0
0
1
