1/ Two amazing companies:
@databricks
and
@MosaicML
plan to join forces to empower everyone to train their own AI models, imbued with their own data.
Here is a story of the journey thus far, and what's ahead of this great partnership🧵:
2/ It started in a lab at UCLA, where I was a postdoc giving
@NaveenGRao
a lab tour as he was choosing where to continue his research in neuroscience
He chose to go to our rival lab at Brown, but that marked not the end, but the beginning of our relationship
3/ Years later, we reconnect when
@NaveenGRao
was starting Nervana, inspired his experience designing processors and neuroscience research, to build accelerators for a new workload: Training neural networks
At the time, semis, let alone ASICs, were 4-letter words for VCs
4/ Despite that, we were excited to invest in Nervana, which not only aimed to design chips, but released neon, a framework for training networks, predating PyTorch's release
The goal was to make training AI accessible to all
6/ But that was just another "beginning"
Nervana's acquisition opened the floodgates of VC dollars into AI accelerators, but
@NaveenGRao
asked:
If algorithms can give you orders of magnitude, why just focus on silicon like everyone else?
7/ Anticipating the cost of training giant, general models to skyrocket,
@NaveenGRao
left Intel with a small team on a new mission:
Collapse the cost of compute on all HW and make it possible for anyone to train the BEST model for THEIR use case while KEEPING their data private
8/ We were delighted to be chosen as
@MosaicML
's earliest investor, and observed this team BLOW past their milestones with more customers, revenue, and performance EXCEEDING the best from the black-box incumbent:
@OpenAI
9/ It's been honor working closely with
@NaveenGRao
for almost a decade, and getting to know
@alighodsi
better, both of whom are researchers turned entrepreneurs sharing the same mission: to decentralize AI and make it accessible to all
10/
@MosaicML
will combine its expertise in GAI infra/training/dev with the reach and scale
@databricks
has built to tip the scales in the favor of the many, following the footsteps of the generational companies that have made America great.
Today we’re announcing plans for
@MosaicML
to join forces with
@databricks
! We are excited at the possibilities for this deal including serving the growing number of enterprises interested in LLMs and diffusion models.