Davis Yoshida
@davis_yoshida
Followers
391
Following
3K
Media
93
Statuses
1K
Moved to SF for work! If a mutual (you perhaps) wants to get coffee they should DM me.
0
0
7
Just writing some markdown in nvim and copilot attacks me out of nowhere
0
0
14
The problem is we need some sort of pareto surface where the axes of interest are:. - Hours needed to learn tool.- Hours spent on specific implementation.- Latency or whatever the metric of interest is. I'm pretty sure the relevant datapoints are impossible to collect.
@gallabytes I think there’s 2 separate questions. 1. Is it easier to write inefficient Pytorch code than inefficient Jax code?. 2. Is it easier to write efficient Jax code than it is to write efficient Pytorch code?. Imo, the answer to the first one is yes. For example, the huggingface.
0
0
2
It's simultaneously relieving and frustrating when the bug you spent hours thinking was yours turns out to be a library bug.
0
0
3
I'll always cherish the brief time I was ahead of neal wu on the advent leaderboard (I assume he was sleepy or something).
0
0
4
I was going to say it doesn't support vmap yet, but I just tested and it (accidentally) does. Ty for the magic @sharadvikram.
@hr0nix @epiqueras1 This got me to finally upload this: It's super WIP, but it does a block-sparse forward using Pallas. I still need to add the backwards kernels though.
1
0
6
ternary parameters are 1-bit?.this 8.5B model is "7B"?. come on guys.
2
0
10
It's a good thing JAX wasn't around in the 90s Schmidhuber would have gotten out of control.
@0xmaddie_ Here's MLPs in MLPs in MLPs in about 40 LoC of JAX + qax. You could swap the MLP for any other Flax module though.
0
0
3
Recalling when I peaked.
I once comprehended conv_general_dilated its entirety for 30 whole milliseconds.
0
0
3
it turns out that `sign` isn't supported either, but fortunately I can just do x/|x| since I already dropped support for 0.
1
0
3
when you forget to measure a secondary outcome in your phase three trial.
the weird thing about having gotten used to my weekly semaglutide injection is now i'm like "huh, you know what? maybe i *could* shoot up heroin".
0
0
2
RT @alexfmckinney: I am looking / on the market for a new ML Engineer / Researcher remote (EU times) role! 👨🔬.You can find my resume here….
0
28
0
