Lepton AI
@LeptonAI
Followers
3,654
Following
34
Media
9
Statuses
56
We are building an efficient AI application platform.
Cupertino, CA
Joined April 2023
Don't wanna be here?
Send us removal request.
Last Seen Profiles
Announcing Lepton AI open beta! Industrial-strength AI Inference with just a few lines of Python code – with automatic performance and reliability matching the hyperscalers. Forget docker and other infra nuts and bolts – we’ve got you covered!
More at:
3
36
165
We are super excited to partner with
@SambaNovaAI
to server the most state-of-the-art Samba-CoE-v0.3 model. In the LLM land, innovation happens with a joint effort on the hardware side and software side. 🧵
Introducing Samba-CoE v0.3, our latest Composition of Experts (CoE) model that surpasses DBRX by
@DbrxMosaicAI
and Grok-1 314B by
@xAIGrokInu
on the OpenLLM Leaderboard
@huggingface
! 🏆 Samba-CoE-v0.3 is now available on
@LeptonAI
@jiayq
, try now: .
#AI
11
29
74
2
6
24
1
5
20
🚀 Excited to introduce the future of machine learning on Lepton AI! We've teamed up with Google's latest marvel, Gemma, to bring you an API that's as powerful as it is user-friendly. 🌟 Start exploring with Gemma today at .
#MachineLearning
#AI
#Gemma
1
7
18
We transparently support PyTorch, HuggingFace Transformer, and other common AI libraries at the base. We also work closely with awesome open source libraries like vLLM - in fact, launching vLLM has never been easier.
1
1
17
🚀 Introducing Illusion Diffusion Model Apis by Lepton AI
Transform your wildest creative ideas into mesmerizing visuals! 🎨✨ Dive into a world where imagination meets reality.
#IllusionDiffusion
#UnleashCreativity
0
2
14
On the first Friday of 2024😝😝😝, we'd love to present you with our latest progress on OSS LLM models: Structural Decoding (Function Calling) for all Open LLMs!
Happy Friday! 🥳
0
6
14
🚀 Introducing "Prompt Craft" made with PromptLLM from
@hippoml_com
! Perfect simple prompts with ease to unleash creativity and efficiency like never before. 🌟💡🤖
Can you tell which one is made by AI? 😝😝😝
#LLM
#Promptshare
#promptllm
1
3
13
Let’s share some numbers. On LLaMA, our optimized runtime runs up to 90 times faster than the transformer baseline, and is available at today. Don't worry about optimization - we incorporated all for you.
1
3
9
Lepton is created by a group of passionate open source contributors behind caffe, onnx, pytorch 1.0, etcd and more. We’ve open-sourced substantial portions of our stack, and will continue to open-source more in the upcoming months. Stay tuned!
0
1
9
Guess who got a spot on HuggingFace Space of the Week? It's us! Try to checkout the emoji re-imagined with LCM 🚀🚀🚀
Bet you've never seen an emoji like this 😆
#huggingface
#lcm
#SDXLturbo
#sdxl
#imageGen
0
2
7
Container technology is great in standardizing deployment. But many developers (ourselves included) don’t need as many details as docker exposes. We allow you to specify your dependencies purely in Python. You’ll be free from infra details most of the time!
1
2
6
🚀 Lepton AI's model API now supports
#NodeJS
calls!
🖥️ Build smarter and faster with the power of AI in your favorite runtime.
Dive in now!
#LeptonAIUpdate
0
1
6
Behind the scene: Feel free to check this out! 🤠
0
1
6
@SambaNovaAI
SambaNova's hardware architecture enables one to deliver models with composition of experts - a much interesting modeling approach on top of existing awesome architectures to deliver state of the art results on benchmarks like Alpaca. Check it out at
0
0
5
We introduce a Python class called Photon that bridges ML to FastAPI and does magic underneath. Implementing this subclass for your model is all it takes – we’ve wrapped several GenAI models (from HuggingFace etc.) such as Whisper, LLaMa and SegmentAnything.
1
2
5
We've also enabled Medusa for LLM models like Llama2 at
- Llama2-7b :
- Llama2-13b :
- Llama2-70b :
Let us know what other models you'd like to try Medusa with! 🖖
(2/2)
2
1
5
1
1
5
Looking forward to meeting all of you! 🥳
Most recent (as of Sep 12) Speaker line-up of the largest GenAI event in silicon valley on Sep 23:
@rmisra11
from
@Microsoft
, Dr Jason Wei () from
@OpenAI
,
@DrJimFan
from
@nvidia
,
@hwchase17
from
@LangChainAI
, Arvind Jain from
@glean
, Jason Lopatecki…
2
3
6
1
0
5
@myshell_ai
Glad to see what we are shipping out together!😃 Make AI playable, reachable, and usable!
0
0
5
Stay tuned for the update on Medusa in production! 👾👾👾We'll introduce more details on this in production! And no BS😝😝, it's live at (1/x)
Medusa is probably one of the most elegant accelerated inference solution we have seen over the last year. It runs complementary to other numerical ones (like int8/fp8, compilation etc) and gives something around ~2x performance gain in practice.
(1/x)
2
39
225
1
3
4
As a result, for many HuggingFace models, you can simply launch it in one line by specifying `hf:model_name`. This includes text generation, image classification, sentiment analysis, and more to come.
1
1
3
Chilling at
@Ray_Summit_Live
? Let's talk about pythonic-AI for building applications! See y'all tmrw and let's talk ~ 🥳
Thanks to
@robertnishihara
and
@anyscalecompute
for inviting 🤠
1
0
3
🚀Check out the blog post by
@YuzeMa5
for the story and tip on fine-tuning open-source models with
@LeptonAI
and
@LangChainAI
. Let us know what you think!
0
0
3
@Ray_Summit_Live
@robertnishihara
@anyscalecompute
Just heads up,
@jiayq
will be giving the talk and showing LVE DEMO! 😝😝😝
1
0
1
@brittwalker_
@swyx
@SmolModels
@lqiao
@jiayq
@YuzeMa5
Based on what we are getting from
@ArtificialAnlys
, seems like we are doing pretty good 🥳
1
0
1
@YuzeMa5
Speaking of the demo mentioned in the talk, the demo is available at and the tutorial is at
0
0
1
@a13935257451
@jiayq
We do have APIs where you can call with your workspace token (Default access will be rate limited, but you can let us know at info
@lepton
.ai for unlimited access)
1
0
1