lowvram
@lowvram
Followers
678
Following
5K
Media
93
Statuses
1K
too dumb for research, too smart for langchain. senior dev @ nameless megacorp, I wrap llms for a living
Joined April 2024
Generate videos in just a few seconds. Try Grok Imagine, free for a limited time.
363
650
3K
friends don’t let friends use vllm’s dynamic fp8 on ampere. it is a gpu crime.
1
0
2
Former catgirl here - Riley is not cheating, catgirls can just do that.
I've been around the aim community for 5 years now. rileycs is NOT cheating, and here's why. I talk about the rock clip and address common arguments for the first 8 minutes and the rest is about how aiming has developed as a skill in the past few years.
2
0
6
this has tpot acting like r/MyBoyfriendIsAI when they lost 4o.
Claude 3.5 Sonnet (old and new) being terminated in 2 months with no prior notice. What the fuck, @AnthropicAI ??. What’s the justification for this? These models are way cheaper to run than Opus. Don’t you know that this is going to backfire?
0
0
6
idk if this is hubris or naivety or both - but I firmly believe I could learn anything. Like there is nothing i (or anyone w/o a bad disability, really) could not master, given the determination.
0
0
0
WA state DOT will close every major highway around Seattle for an entire weekend and then tweet “ooopsie!!! we’re so sowwy we fucked up all commerce and events for the whole summer weekend!! but have u tried taking the twain??!! :3”.
2
0
6
that feeling of writing a beautiful, clear, detailed spec for the coding agent, then hitting “enter” and laying back in ur chair, stretching, sipping ur coffee, and watching ur will be done, ur whims become reality.
1
0
4
someone at GitHub published the blog post too early 🫣.
archive.is
archived 7 Aug 2025 03:53:08 UTC
9
23
286
q for my smart mutuals - why would you *not* use MLA, if training a new model from scratch, post-whale? Is it not a strictly-better, free lunch? It’s made out to be magical, I’m curious if there’s a reason OAI (or anyone) would not adopt it.
3
0
15
Hermes parser (and default qwen prompt) expects to see xml tags <tool_call> surrounding the calls, and then newline-separated json objects (not an array). But the guides decoding forces it to be a json array, no tags? Unless the order this is applied is not what I expect?.
0
0
1
vllm does actually seem to handle qwen tool calls properly? it uses the “Hermes” parser to extract tool calls from the llm output. But it also uses a guided decoding schema which seems to violate the format the Hermes parser expect? I might just be going crazy.
1
0
2
you joke but this is literally my dog’s food bowl
0
0
3
I know o3s geoguessing ability is well known by now, we already knew this. But seeing it in practice is just mind blowing.
0
0
4
was watching a YouTuber I like, they were in their backyard grilling. Took a screenshot, asked o3 “where is this?” In 1min it gave me the street they live on. It was spot on. Based on the vegetation and the style of roof of the neighbor. Jeeze.
4
0
14