Explore tweets tagged as #litellm
@ai_for_success
AshutoshShrivastava
2 months
Bifrost just launched and they claim 40x faster than LiteLLM. It’s an open-source LLM gateway that manages and optimizes connections to multiple AI models. If the benchmarks match the hype, this could be big. > Fast open-source LLM gateway > MCP support for tool and agent
@getmaximai
Maxim AI
2 months
🚀 Maxim’s Bifrost is live on Product Hunt 🚀 We’re excited to share that Bifrost, the fastest and open-source LLM gateway, is live on Product Hunt. https://t.co/Mb9yaGSTt6
2
3
27
@oscarle_x
Oscar Le
10 days
Openrouter now allow you to BYOK for 1M request/month. That is technically free for small SaaS. So no need of maintaining a LiteLLM server.
0
0
8
@maikokojima
小島舞子 /『企業競争力を高めるための生成AIの教科書』クラフター代表取締役
20 hours
LiteLLMの代わりのAIエージェント開発者向けのAPIゲートウェイツールをMVPで作成!LPで1万ユーザーがいるとハルシネーション。 #AI駆動開発
0
1
11
@rogerscissp
Matthew Rogers
2 months
LiteLLM, when it won't let me delete an old model.
0
0
1
@kweinmeister
Karl Weinmeister
1 month
Want to use models from Google's Vertex AI Model Garden with an OpenAI-compatible API? My new video shows how to set up @LiteLLM as a local proxy to do just that. Simplify your workflow and call models like Qwen, DeepSeek, and more through a unified interface. #AI #LLM
1
3
10
@Agent0ai
Agent Zero
2 months
🤖 Agent Zero just helped me fix itself after an upgrade. This is one of the worst problems in python - dependency conflict. A0 scanned the history of LiteLLM to find the newest compatible in just seconds.
6
15
48
@aimlapi
AI/ML API
24 days
If you want to quickly and efficiently integrate an LLM into your "Internet Of Agents" hackathon project, @LiteLLM is your best friend. → Switch between any LLM provider with a single line of code → Experiment and deploy models without rewriting your functions → Keep code
2
3
3
@MaximeRivest
Maxime Rivest 🧙‍♂️🦙🐧
1 month
Left Functai (a dspy wrapper, for function style api) Right manual version with litellm and pillow. Why would you not use dspy and it's ecosystem (functai, arbor, ovllm, attachments, ax, etc)? The left version is easier to understand, easier to maintain, easier to train
7
4
32
@krrish_dh
Krrish
2 days
5️⃣ new things @LiteLLM ✅ Passthrough - give keys/teams access to specific endpoints 🛠️ MCP - Ensure MCP client stays open during tool call 💰 TogetherAI - add new cost tracking models 🩺 Health Checks - shared State Across Pods 📖 Wandb - new provider docs
0
0
1
@svpino
Santiago
1 month
litellm is so freaking good - write your code once / use any llm in the world without having to change a single line of code.
12
2
77
@ra612h
RA621H
11 days
SRE Magazine デビューしてみました。LiteLLMの導入について書いています。 記事を書いた後も、GPT-5-codex や Claude Sonnet 4.5 などモデルの追加もやって運用中です! #sre_magazine https://t.co/GsKyHNGRk3
0
5
7
@raw_works
Raymond Weitekamp
13 days
first, pinky, we will use @DSPyOSS and @LiteLLM proxy server with custom guardrails to translate any api call into spanish... ...then, we try to take over the world!
5
6
81
@geekbb
Geek
1 month
Helicone 一个开源监控工具,帮助开发者更好地监控、分析和优化与大型语言模型(LLM)相关的 API 调用。 一行代码即可记录 OpenAI、Anthropic、LangChain、Gemini、TogetherAI、LlamaIndex、LiteLLM、OpenRouter 等的所有请求。
4
22
94
@krrish_dh
Krrish
20 days
5️⃣ new things @LiteLLM 🎉 MCP - Oauth support 💸 Bedrock - support 'requestMetadata' for cost tracking 🔒 Google Model Armor Guardrail - handle multiple file inputs 🛠️ Ollama - fix index assignment for multiple tool calls 🧹 Gemini - pass api key for /countTokens endpoint
0
0
1
@krrish_dh
Krrish
22 hours
5️⃣ new things @LiteLLM 💪 GPT-5 - show reasoning on /chat/completions 🎉 GPT-5 - fix Responses API for Claude Code 🚀 Guardrails - return guardrail errors as model response ✅ Responses - use OpenAI Ruby SDK for Anthropic/Gemini 🛠️ DB - sanity check schema drift on startup
1
0
0
@krrish_dh
Krrish
26 days
5️⃣ new things @LiteLLM 🎉 CompactifAI - new LLM Provider 👋 Bedrock - add external id when role chaining 💪 Bedrock - handle empty args in tool call 🛠️ Teams - set default budget to JWT upserted teams 🔒 MCP - resolve specific server when using with access group
0
0
0
@AutomationAce_
Troy Tessalone | Automation Ace ⚡️
24 days
What is this @Zapier LiteLLM Proxy? https://t.co/8ezOpXuB7B
0
0
0
@bengo4_creators
弁護士ドットコム CREATOR'S
5 days
🎉メディア掲載のお知らせ SRE Magazine 10号に弁護士ドットコムの取り組みが掲載 LLMを共通APIで使えるように。AWS上のLiteLLM Proxyで、Bedrock / Azure OpenAI / Vertex AIを統合 ✅Auroraでメタデータ管理 ✅ECS Fargate+ALBで運用 ✅Datadogでユーザー×モデル×トークン可視化 #sre_magazine
1
8
13
@DMMcom_tech
DMM.com Tech
1 month
【DMMテックブログ】 「LiteLLM を App Runner + CloudFront + WAF でシンプルに構築・運用してみた話」を公開しました。 ユーザーレビューグループが生成AI活用の用途別コスト可視化とセキュアな利用制御を目的に、LiteLLMを用いたPoCを構築。その運用基盤を紹介します。 https://t.co/jsksqrH9b1
0
1
5