BigScience Large Model Training
@BigScienceLLM
Followers
9K
Following
49
Media
5
Statuses
129
Follow the training of "BLOOM 🌸", the @BigScienceW multilingual 176B parameter open-science open-access language model, a research tool for the AI community.
JeanZay supercomputer (France)
Joined March 2022
The BLOOM model is now officially released!. Read more here: Find the model here:
BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at.
6
64
255
RT @ClementDelangue: The Bloom paper is out. Looks like it's doing worse than current GPT3 API in zero-shot generation tasks in English but….
0
105
0
The super-fast inference solutions are finally here for all to use:.
Learn how you can get under 1msec per token generation time with BLOOM 176B model!. Not one, but multiple super-fast solutions including Deepspeed-Inference, Accelerate and Deepspeed-ZeRO!.
1
2
29
RT @ClementDelangue: What do @StabilityAI @EMostaque #stablediffusion & @BigscienceW Bloom - aka the coolest new models ;) - have in common….
0
36
0
RT @huggingface: The Technology Behind BLOOM Training🌸. Discover how @BigscienceW used @MSFTResearch DeepSpeed + @nvidia Megatron-LM techno….
0
148
0
RT @BigscienceW: BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at..
0
779
0
RT @LucileSaulnier: 🌸@BigscienceW BLOOM's intermediate checkpoints have already shown some very cool capabilities! . What's great about BLO….
0
25
0
For 111 days, we've enjoyed world-class hardware stability and throughput thanks to the hard work of our friends at @Genci_fr, @INS2I_CNRS, Megatron & DeepSpeed. Having reached our objective earlier than expected, we'll keep training for a few more days. Stay tuned, more soon ;).
3
25
307