
ZILIANG Peng 🏴☠️
@cyberpengk
Followers
3K
Following
50K
Media
3K
Statuses
40K
AI means love. Robotics. Graphics. Economics. Physics. and random topics.
Promised Land
Joined July 2009
It is super early days for GPU hacking. And it's not just GPUs.
The latest MLX has a CUDA back-end! To get started:. pip install "mlx[cuda]". With the same codebase you can develop locally, run your model on Apple silicon, or in the cloud on Nvidia GPUs. MLX is designed around Apple silicon - which has a unified memory architecture. It uses
0
0
1
looking to implement a minimal / educational llm inference engine on top of tinygrad, but pounders the question: . what optimization should be implemented by hand, and which part will be supposed to be optimized by @__tinygrad__ itself?.
0
1
18