Hey, hunters!
Eight months ago, we launched dstack, an open-source tool for managing AI infrastructure across various cloud platforms. Since then, we've built an amazing community of users and improved the tool in many ways based on a ton of feedback.
Due to its support for multiple cloud providers, dstack is frequently used to access on-demand and spot GPUs across multiple clouds. From our users, we've learned that managing various cloud accounts, quotas, and billing can be cumbersome.
To streamline this process, today we launch dstack Sky, a managed service that enables users to access GPUs from multiple providers through dstack – without needing an account in each cloud provider.
TL;DR:
- GPUs at competitive rates from multiple providers
- No need for your own cloud accounts
- Compatible with dstack's CLI and API
- A pre-configured gateway for deploying services
With dstack Sky you can use all of dstack's features, incl. dev environments, tasks, services, and pools.
Feel free to leverage both on-demand and spot instances without needing to manage quotas, as they are automatically handled for you.
For more details about dstack Sky, check the official announcement: https://dstack.ai/blog/dstack-sky
I'm here to help with questions! ❤️
I tested dstack as a tool to do multi-cloud deployment of my own inference software. Works as a charm for any app, even non-AI/ML ones thanks to easy-to-use docker support.
Code is simple to read and pretty customizable.
I am running automated paper translations with a custom AI model every day on dstack, and it works perfect. With lots of paper, it helped me not only distribute the workloads on multiple GPU machines, but also easy to provision them with built-in Python API.
dstack is a really great tool to get GPU's (and CPU) instances at good prices across the world. It has a nice dev environment. Plus dstack sky centralizes billing across many providers - saving a huge amount of hassle. It is really easy to use and has a lot of potential. This will be my go to tool for anything related to cloud deployment and use. Please keep up the great work!
dstack
Portkey
dstack