Wei (Will) Feng Profile
Wei (Will) Feng

@weifengpy

Followers
103
Following
2K
Media
1
Statuses
37

PyTorch Distributed, FSDP, float8

United States
Joined March 2011
Don't wanna be here? Send us removal request.
@verl_project
verl project
7 months
verl is embracing @PyTorch fsdp2! Better throughput, memory usage, and composability with torch.compile! Please try it out and give us feedbacks: https://t.co/Ppa4VxBULk
0
6
18
@weifengpy
Wei (Will) Feng
1 year
We have been working on PyTorch native float8 and FSDP2 for distributed training. Check out TorchTitan and TorchAO/float8 https://t.co/fG295IMBO6 with Andrew Gu, @wanchao_ , @drisspg , @vkuzo , @brian_hirsh
1
6
15
@weifengpy
Wei (Will) Feng
13 years
@mikiobraun I appreciate your jBlas. I found the pre-compiled version still has DoubleMatrix.get(Range cr, Range rs) bug. Would you update?
0
0
1
@analyticbridge
Data Science Central
14 years
How to rank vectors based on their features?: http://t.co/COVrBYSs
0
2
1
@weifengpy
Wei (Will) Feng
14 years
On @Quora: What is the best open source implementation of R-tree? Answer: http://qr.ae/7CABN
0
0
1