Grok-1 support in gpt-fast at faster(?) than anyone else has reported so far. 75 tok/s for a 300B+ parameter model on an 8xA100 node. If I understand correctly, ColossalAI reported 15 seconds to generate 100 tokens. gpt-fast takes 4.2 seconds to generate *400* tokens.

𝐀𝐧 𝐨𝐩𝐞𝐧-𝐬𝐨𝐮𝐫𝐜𝐞 𝐯𝐞𝐫𝐬𝐢𝐨𝐧 𝐨𝐟 𝐂𝐡𝐚𝐭𝐆𝐏𝐓 𝐢𝐬 𝐟𝐢𝐧𝐚𝐥𝐥𝐲 𝐡𝐞𝐫𝐞. Seems to work pretty well. The model is published and released by ColossalAI. Link:  https://t.co/08bXdrDEkn Demo:  https://t.co/DG3VJCfCi2 #chatgpt #ai

今日はColossalAIをwindowsで動かそうと悪戦苦闘していました。推論の方は動いたけど微妙な性能、学習の方はエラーが解消されずにあきらめという残念な結果に... 明日はWSLで試してみようと思います。 昨日寝過ぎて完全にリズムが狂った... それでは、おやすみなさい💤

今日はお祝い絵をたくさん作りました。ハート鎖が作れることが分かったのも大収穫です。 ColossalAIはWSLで動かそうとしたらバグ？にぶつかりました。イシューが出ていたので、それが解決されたらまたチャレンジしようかな。今すぐやりたい人は素直にLinuxにすべきですね。 それでは、おやすなさい💤

Another drop, in the ocean of AI: Open-Sora: Democratizing Efficient Video Production for All,a fully open source project for video generation. Open-Sora 1.0 supports a full pipeline of video data preprocessing, training with ColossalAI acceleration, inference.

6/10 ⚙️ ColossalAI ColossalAI makes training large AI models easier and more affordable. It combines different methods to speed up the process, making it both efficient and cost-effective for users. https://t.co/1rcN67gNC4

ColossalAI Unlock large AI models with Colossal-AI! Access high-end compute instantly, no setup needed. Get $10 in credits & explore open-source solutions for video gen, LLaMA3, & more! #AI #MachineLearning #DeepLearning

Colossal-AIさん、from chatgpt.nn import GPTActor, GPTCritic, RewardModelのために、 transformers，loralibのインストールと、ディレクトリ移動が必要なのは分かりました。 /content/ColossalAI/applications/ChatGPT ColossalAIStrategyで応答待ちになります🤔

ColossalChat أخ جديد 🔥 لـ ChatGPT https://t.co/oBrJ9FL8zw نموذج يشبه ChatGPT وقائم عليه في بعض عملياته تم تطويره من Colossal-AI Tech. سريع ولا يتطلب تسجل لا يدعم اللغة العربية

Exciting update! 😆Take a look at Open-Sora's video generation results! #Sora #ColossalAI #AI #OpenSora If you have more interesting ideas for video generation, welcome to https://t.co/vCoGWqDXyz to get model weights for free experience🥳

#ColossalAI released an #opensource out-of-the-box solution to replicate the #ChatGPT training process. It includes #ReinforcementLearning with Human Feedback implementation (RLHF), promises a faster training process and supports single and multi-#GPU training 🤯 #Python #PyTorch

Say hello to Grok-1's new PyTorch+HuggingFace edition! 🚀 314 billion parameters, 3.8x faster inference. Easy to use, open-source, and optimized by Colossal-AI. 🤖 Dive in: #Grok1 #ColossalAI🌟 https://t.co/D1P1XM1rEs Download Now: https://t.co/Fg3BmiNRzT

AI 文章分享 针对 LLaMA3 系列量身定制的最具成本效益的推理、微调和预训练解决方案 -- @ColossalAI 推理 ⭐️ Colossal-AI 相比 vLLM 推理速度高 10%-15% 微调和持续预训练 ⭐️ Colossal-AI 相比 Megathon-DeepSpeed 训练效率高 20% HPC-AI Blog: https://t.co/tA28G3maqg

Blown away by @ColossalAI the team behind OpenSora, with an insane video generation demo: https://t.co/AjQulzCUhj

📛 ColossalAI 🧠 Colossal-AI offers affordable, quick, and accessible AI models with parallelism strategies, memory management, and user-friendly deep learning tools. 💻 Python ⭐ 32407 🍴 3764 🔗

🌟 Join us for a captivating talk panel on Colossal-AI: Breakthroughs in Efficient AI at ICML on July 23rd at 5 p.m. (Hawaii Time) 🚀 Professor James Demmel, HPC-AI Tech's CSO, will lead the discussion. Don't miss this eye-opening session! #AI #ICML #ColossalAI #Efficiency

🤖 Excitement is reaching its peak in the AI community as the International Conference on Machine Learning (ICML) draws near! 🚀 Colossal-AI is thrilled to be a key presenter at this prestigious event! 🎉 Join us on July 23rd in Honolulu, Hawai'i! 🌺 #ICML2023 #AI #ColossalAI

Trending repository of the day 📈 ColossalAI Making big AI models cheaper, easier, and more scalable Main language: Python Last 24h: 618 ⭐ Total: 13569 ⭐️ https://t.co/ekf5R0rLc4

Excited to announce that Prof. Yang You, founder of HPC-AI Tech, will be delivering a speech on the remarkable achievements of Colossal-AI in the AI infrastructure domain at NeurIPS. Join us for this insightful talk!🎉 #NeurIPS2023 #AIInfra #ColossalAI https://t.co/weazqYLj9s