
BigScience Large Model Training
@BigScienceLLM
Followers
9K
Following
49
Media
5
Statuses
129
Follow the training of "BLOOM πΈ", the @BigScienceW multilingual 176B parameter open-science open-access language model, a research tool for the AI community.
JeanZay supercomputer (France)
Joined March 2022
RT @ClementDelangue: The Bloom paper is out. Looks like it's doing worse than current GPT3 API in zero-shot generation tasks in English butβ¦.
0
105
0
RT @Muennighoff: Crosslingual Generalization through Multitask Finetuning πΈ. Demo: π π»httpβ¦.
0
78
0
RT @ClementDelangue: What do @StabilityAI @EMostaque #stablediffusion & @BigscienceW Bloom - aka the coolest new models ;) - have in commonβ¦.
0
36
0
RT @huggingface: The Technology Behind BLOOM TrainingπΈ. Discover how @BigscienceW used @MSFTResearch DeepSpeed + @nvidia Megatron-LM technoβ¦.
0
148
0
RT @BigscienceW: BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at..
0
779
0
RT @LucileSaulnier: πΈ@BigscienceW BLOOM's intermediate checkpoints have already shown some very cool capabilities! . What's great about BLOβ¦.
0
25
0
For 111 days, we've enjoyed world-class hardware stability and throughput thanks to the hard work of our friends at @Genci_fr, @INS2I_CNRS, Megatron & DeepSpeed. Having reached our objective earlier than expected, we'll keep training for a few more days. Stay tuned, more soon ;).
3
25
306