RT @vpj: Wrote an annotated Triton implementation of Flash Attention 2. (Links in reply). This is based on the flash attention implementati….

RT @kai_fall:

Generate videos in just a few seconds. Try Grok Imagine, free for a limited time.

Letting co-pilot comment on my pull request and then replying to those comments and resolving them makes me feel like a Schizophreniac . But honestly, some of the suggestions are legit useful, so I’m just gonna keep doing that.

RT @janetacarr: docker is supposed to solve the "works on my machine" problem. but often I find that it just adds another layer to the "wor….

I mean, it’s your app.

Going to save this and reply to chat gpt posts on LinkedIn.

RT @HSVSphere: > I made <thing> from scratch in Python!.>look inside.>import <thing>

RT @chrislevan24: this.

Being dumb off to a great start. Apparently there's a thing called Predicates on core data. Like a poor man's SQL. Entire chain of thought wasted 👍.

I need to let a LLM "talk" to swift core data. Need a language both the DB and the LLM talks so the obvious solution is SQL. SQL won't work on a key value store though. I wonder how hard would it be to write a SQL like driver for core data. #DoingdumbShitTillImNotDumbAnymore.

RT @tekbog: CS grads on suicide watch.

RT @deedydas: OpenAI o3 is 2727 on Codeforces which is equivalent to the #175 best human competitive coder on the planet. This is an absol….

RT @martinmbauer: No it isn’t. That’s the whole point.

How to remove .env from git

RT @northstardoll:

“Oh thanks. Didn’t notice that”.

Pip package: Docs: Github:

Pretty easy to get started so give it a try!

Now Our visualization library Inspectus can visualize values related to tokens in LLM outputs. This demo shows some outputs from using entropyx (by @_xjdr) on Llama 3. Had fun making this. (jk I didn’t). 🔗👇