Hello Product Hunters!! 🚀 I’m Manouk, co-founder of LangWatch. You may haven't heard from us in a while, but trust me—you’ll love this new ProductHunt launch. We’ve been listening and have solved your biggest pain points in building LLM applications. 🥁 And the best part? We have opened-up the access to all users. We’re thrilled to be live on Product Hunt today with our biggest release yet: LangWatch Optimization Studio! After building our powerful Monitoring & Evaluation platform, there was still a major pain point you shared with us. So, we solved it: This new feature takes LLM development to the next level, solving the most frustrating challenges teams face when optimizing LLM pipelines and ensuring top-tier performance. With the newest Optimization Studio, you can: ⚡ Evaluate & Optimize: Experiment different prompts and LLM-models automatically in seconds (with DSPy) 🧠 Custom Evaluations: Build tailored evaluations and bring them back to your real-time monitoring. 🔄 Seamless Deployment: Confidently push optimized prompts/few-shot examples and pipelines into production. A few highlights of LangWatch: 🌟 Observability: Monitor LLM performance, latency, costs, and quality. 📊 User-Analytics: Deeply understand what docs of your RAG are mostly used and topics discussed. 👩‍💻 Evaluations: Run evaluations to control for hallucinations or other criteria you care about real-time. ✏️ Prompt Management: Version, tweak, and deploy prompts directly from LangWatch. 🔬 Datasets: Build datasets of non-performing traces and start improving. 🐒 API: All analytics and features available per API. 🌍 Open Source: Join our growing community on GitHub to collaborate and contribute. Get started today: ⭐ GitHub: https://github.com/langwatch/lan... 📖 Docs: https://docs.langwatch.ai/ ⏯️ Live Training Today: https://lu.ma/um4owj65 If you're already a fan of DSPy, we'd love to hear about what you've built and explore how we can support you even more! A big thanks to the PH community for all your feedback and support. We’re here all day and can’t wait to hear your thoughts, questions, and feedback! Cheers, Manouk

Forum Threads

p/langwatch

Manouk Draisma

•

2mo ago

Use an Agent to test your Agent

How do you validate an AI agent that could reply in unpredictable ways?

My team and I have released Agentic Flow Testing an open-source framework where one AI agent autonomously tests another through natural language conversations.

p/langwatch

Manouk Draisma

•

2mo ago

Is there an AI quality Lead in your Dev/AI team?

Every day I speak with AI teams building with LLM-powered applications and something is changing.

I see a new role is quietly forming:

The AI Quality lead as the quality owner.

View all

Reviews of LangWatch

Gleb Podorozhnyy

•2 reviews

Awesome to see more products launch in this field. One of the biggest challenges for companies to create AI solutions is having the right platform in place as a starting point. Can't wait to explore this product even more for my own team!

Report

1yr ago

Eyüp Coskun

•1 review

I highly recommend LangWatch to anyone looking to elevate their AI-generated content with precision and effectiveness.

Report

1yr ago

Josh Manders

•2 reviews

Spams people for PH launch upvotes.

Report

1yr ago

View all 6 reviews

LangWatch

Maker

Launching soon!

📌

6mo ago

Darko Milojevic

Congratulations on the launch, excited to give it a try! 🚀

@dmilo8 amazing! Let me know how it works for you

Paul Jansen

Flat Icons API

Have worked with DSPy before, very curious towards how you guys are doing this.. How do I build a custom evaluation?

Heeeeey @mr_jansen great to hear you've already experience with it. If you open an account happy to help you onboard there. Within our low-code envirroment you can use the optimizers from DSPy under the "optimize button" right above - while building a workflow you can bring your custom eval back to the "Real-time-monitoring" Thanks for the support!

@manouk_dr Thanks, will create an account!

Richard Huth

Really enjoyed working on this project, still a lot to offer. We will keep on adding to it, as the use cases are really infinite!!

Great to have you on it!! @richard_huth

LangWatch

Agent Simulations — The missing layer in Agentic AI

LangWatch Optimization Studio

LangWatch Launches

Do you use LangWatch ?

Forum Threads

Use an Agent to test your Agent

Is there an AI quality Lead in your Dev/AI team?

Review LangWatch ?

Reviews of LangWatch