Hello Product Hunters! My name is Namee, co-founder of LLMWare.ai, and I would like to share my open-source repo that will help you build really useful AI apps for the enterprise. I used to work as a Corporate Attorney at BigLaw working crazy hours doing very mundane and sometimes mind-numbingly repetitive tasks. I wanted to build AI that everyone can use to help solve the everyday soul-crushingly boring tasks like information retrieval, contract reviews, SQL queries, report generation and much more! (These are just few examples here and I am sure you can think of many others. 😅) Enter Small Language Models🤖 To help people at their corporate jobs, however, I saw a big problem with using external models like ChatGPT to access sensitive data and information. Knowing the data privacy and security concerns of my enterprise clients from my legal days, I knew that they would have a big problem with sending out data this way. After all, enterprises live in fear of data breaches and data copies – this is one of the biggest security risks they have. 💡That realization led me to one simple conclusion. AI has to come directly and privately to laptops where most of us access our work. ‼️Of course the models had to be small enough to run locally. And we needed to provide easy access and easy deployment (either private cloud, on prem or on device) so that no data needs to leave the enterprise security zone. That was my A-ha moment that led me to focus on small language models about 18 months ago. What is LLMWare? From the beginning, LLMWare has been exclusively focused on using, fine-tuning, and deploying small language models (SLMs) to enable easy to use and easy to deploy AI for the enterprise. We are pioneers in this space and was selected by Github earlier this year as a leading AI project in open source. 🏆 Who is it Perfect for? Enterprise developers looking to create lightweight apps for local deployment use cases to enhance productivity and to automate workflow. How to Get Started We have over 100+ examples in our open source repo that help you get started plus over 75+ models in Hugging Face. We have published Fast Start to RAG and Fast Start to Agents video series on YouTube along with many other videos that show you step-by-step how to get started with using SLMs. https://www.youtube.com/@llmware... Sign Up for a Beta Test In addition to LLMWare's open source library, we are developing our first commercial product that makes it easy to use and to deploy state of the art models directly on laptops, especially Intel-based hardware that powers most enterprise laptops (point and click deployment). If this sounds interesting to you, please contact me directly to sign up to be a beta tester! A Big THANKS Thank you Product Hunters for your support! And last but not least, a MASSIVE thanks to @chrismessina, our Hunter Extraordinaire, who believed in the mission behind LLMWare and helped us launch here. 🙏🌟

Namee Oberst

LLMWare

Maker

📌

10mo ago

AnnaHo

Picture Picker—Collect,Create,Edit Image

@llmware @namee_oberst Congratulations on the launch of your pioneering AI development tools tailored for the financial services industry!

@annaho2000 Thank you so much for your kind words and support!

Nevo David

Postiz

LLMware is really great! I love the approach to small language models!

@nevo_david THANK YOU so much for your kind support!!

APIPark

So do you want to position it as a model that can be deployed locally or a platform for quickly building AI applications? These are two different directions in themselves. Perhaps focusing more will make it easier for users to understand your positioning and help you do better.

@an_zuo Hi Thank you for your question - I understand that I need to better clarify. It is a platform for quickly building AI applications but we also have models in Hugging Face that can be used to build such applications...

LLMWare

Deploy AI privately and securely with small language models

Deploy AI privately and securely with small language models

LLMWare

Deploy AI privately and securely with small language models

Deploy AI privately and securely with small language models

Do you use LLMWare?

Do you use LLMWare?