Spiffy AI
@SpiffyAI
Followers
86
Following
7
Media
0
Statuses
4
Released torchdistill v1.1.0 last night! ⚗️ Key updates ⚗️ - @PyTorch 2.2.1 support - 3 new KD methods - Custom low-level loss support https://t.co/IXWsYr2nsx For the new KD methods (SRD w/ @Miles12Roy), we reproduced ImageNet results (2 wins, 1 lose) https://t.co/zjDmK5RAgU
github.com
New methods Add SRD method (PRs #436, #444, #446) Add Knowledge Distillation from A Stronger Teacher method (PR #433) Add Inter-Channel Correlation for Knowledge Distillation method (PR #432) YAM...
0
3
10
I’m happy to share that I’m starting a new position as Founding Research Engineer @SpiffyAI ! This is a totally new adventure for me. I am very excited to join such an amazing team and work together on challenging problems!
4
1
37
LLMs have problems that are difficult to identify and explain. To understand them better, we need to study the relationship between LLMs and their pre-training data, and with the OLMo release, @allen_ai helps make this possible! https://t.co/KYX8Ahzo3U
sciencenews.org
To develop better safeguards, computer scientists are studying how people have manipulated generative AI chatbots into answering harmful questions.
OLMo is here! And it’s 100% open. It’s a state-of-the-art LLM and we are releasing it with all pre-training data and code. Let’s get to work on understanding the science behind LLMs. Learn more about the framework and how to access it here: https://t.co/utvPpWwJIp
1
6
55
OLMo-7b is finally out 🎉, and we are releasing everything; weights, intermediate checkpoints, training code and logs, training data and toolkit, evaluation and adaptation code and data. Most of it has been released, and the rest is coming soon. OLMo-65b and Adapted OLMo-7b are
6
67
308