Product Hunt logo dark
  • Launches
    Coming soon
    Upcoming launches to watch
    Launch archive
    Most-loved launches by the community
    Launch Guide
    Checklists and pro tips for launching
  • Products
  • News
    Newsletter
    The best of Product Hunt, every day
    Stories
    Tech news, interviews, and tips from makers
    Changelog
    New Product Hunt features and releases
  • Forums
    Forums
    Ask questions, find support, and connect
    Streaks
    The most active community members
    Events
    Meet others online and in-person
  • Advertise
Subscribe
Sign in
Subscribe
Sign in
liteLLM

liteLLM

One library to standardize all LLM APIs

5.0
•11 reviews•

101 followers

One library to standardize all LLM APIs

5.0
•11 reviews•

101 followers

Visit website
Unified API
•
AI Infrastructure Tools
Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models
  • Overview
  • Launches1
  • Reviews11
  • Alternatives
  • Team
  • More
Company Info
github.com/BerriAI/litellmGitHub
liteLLM Info
Launched in 2023View 1 launch
Forum
p/litellm
  • Blog
  • •
  • Newsletter
  • •
  • Questions
  • •
  • Forums
  • •
  • Product Categories
  • •
  • Apps
  • •
  • About
  • •
  • FAQ
  • •
  • Terms
  • •
  • Privacy and Cookies
  • •
  • X.com
  • •
  • Facebook
  • •
  • Instagram
  • •
  • LinkedIn
  • •
  • YouTube
  • •
  • Advertise
© 2025 Product Hunt
SocialX

Similar Products

LangSmith
LangSmith
Build and deploy LLM applications with confidence
4.9(18 reviews)
AI Infrastructure ToolsAI Metrics and Evaluation
Metaphor Search API
Metaphor Search API
API to connect your LLM to the internet
SearchUnified API
Appwrite
Appwrite — The open-source Vercel alternative
The open-source Vercel alternative
Promoted

Do you use liteLLM?

liteLLM gallery image
liteLLM gallery image
liteLLM gallery image
Free
Launch tags:
API•Open Source•Developer Tools
Launch Team
Kat ManalacIshaan Jafferkrrish dholakia

What do you think? …

Ishaan Jaffer
Ishaan Jaffer
liteLLM

liteLLM

Maker
📌
Hi Producthunt, @krrish_dholakia and I are super excited to be launching 🚅 liteLLM An Open Source Python library to standardize LLM Inputs/Outputs for 50+ models (OpenAI, Anthropic, Cohere etc) :https://github.com/BerriAI/litellm 🚨Why did we build liteLLM We needed simplicity Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere, Anthropic, Replicate LLM APIs. 🚀How does it work liteLLM is a Python package that enables calling 50+ LLM API models using a consistent input/output interface - in the chatGPT format here’s an example of how liteLLM works response = completion(model="gpt-3.5-turbo", messages=messages) response = completion("claude-2", messages) response = completion("command-nightly", messages) 📞 Interested in using liteLLM? You can try out liteLLM today for free: https://github.com/BerriAI/litellm/ If you're interested in liteLLM you can meet with me https://calendly.com/d/4mp-gd3-k... or reach me on Twitter: https://twitter.com/ishaan_jaff
Report
2yr ago
FALAK SHER | phlaunchchecklist.com
Product Hunt Launch Checklist

Product Hunt Launch Checklist

@krrish_dholakia @ishaan_jaffer Amazing work guys! Congratulations on the launch.
Report
2yr ago
kaushik srinivasan
kaushik srinivasan
Congrats on the launch! Litellm is really useful for reliably and easily calling LLM APIs.
Report
2yr ago
Ishaan Jaffer
Ishaan Jaffer
liteLLM

liteLLM

Maker
@kaushik_s Thank you !
Report
2yr ago
Ishaan Jaffer
Ishaan Jaffer
liteLLM

liteLLM

Maker
@krrish_dholakia @falak_sher Thank you !
Report
2yr ago
Yi Ding
Yi Ding
LFG
Report
2yr ago
Ishaan Jaffer
Ishaan Jaffer
liteLLM

liteLLM

Maker
@yi_ding Thanks for the support❤️
Report
2yr ago
Cyril Gupta
Cyril Gupta
CloudFunnels AI

CloudFunnels AI

Launching soon!
The product looks good, will check it out
Report
2yr ago
Ishaan Jaffer
Ishaan Jaffer
liteLLM

liteLLM

Maker
@cyriljeet Thank you !
Report
2yr ago
5.0
Based on 11 reviews
Review liteLLM?

liteLLM is praised for its ability to simplify API calls across various LLM providers, offering a unified interface that enhances flexibility and efficiency. Makers of Me.bot highlight its versatility as an API calling center, while Instance uses it as an LLM gateway. Athina AI appreciates its ease in switching between models and supporting custom ones. Users commend its role in standardizing codebases and facilitating seamless integration with multiple AI services. Overall, liteLLM is valued for its consistency and ease of use.

Henry AmesederSergii ShcherbakHengjia Wang
+8
Summarized with AI
Pros
Cons
Reviews
All Reviews
Helpful
Pros
support for custom models (2)
Instance
Henry Ameseder
Henry Ameseder
used liteLLM to buildInstanceInstance
(358 points)
as LLM gateway for our product.
Report
2mo ago
ContextGem
Sergii Shcherbak
Sergii Shcherbak
used liteLLM to buildContextGemContextGem
(86 points)
Enables unified interface for all LLMs with easy provider switching.
Report
4mo ago
Me.bot
Hengjia Wang
Hengjia Wang
used liteLLM to buildSecond.Me by Me.botMe.bot
(434 points)
Versatile API calling center.
Report
5mo ago