Hi Hunters,
I’m Nicholas, co-founder of GPUDeploy.
GPUDeploy is like DoorDash or Airbnb for GPUs. You can launch an instance of on-demand A100s right now at $1.28/GPU/hour.
The previous iteration of this startup was a robotics company (drone delivery), which did not work out. However, training our RL models, we were renting GPUs and realized that what's out there is counterintuitive to use and overpriced - plus, the GPUs you want are always booked out.
Meanwhile, there are hundreds of unutilized, high-quality, cheap Nvidia GPU clusters out there. We have written software to make them available on-demand. We have GPUs online from data centers in Europe and the US and are offering them on-demand for wholesale prices that you would normally have to negotiate.
Any session you launch comes with ssh and Jupyter notebook access and is ready to be used for your machine learning needs immediately. I recently trained Andrej Karpathy's nanoGPT to plagiarize Shakespeare for <$0.20 on an RTX 4090.
We have H100s at $3.45, A100s at $1.28 and RTX 4090s at $0.49 available right now.
If you own any of these GPUs (AI company/hobbyist/data center), it is also super easy to take them online on our site and earn money. You can get in contact with us at contact@gpudeploy.com for custom onboardings or onboard yourself at www.gpudeploy.com/control. It takes 5 minutes and we are very flexible: you can take your node online and schedule offline time at any time. We are however opinionated on a high degree of reliability, while your node is online.
Compared to what's out there:
- we make it super simple to launch GPUs at wholesale prices now, no reservations, sales calls or the likes required.
- we have a very clean, to-the-point user experience.
- we don't put huge markups on the GPU prices.
Try it out!
Hi Nicholas, congratulations on the launch of GPUDeploy! The concept of making high-quality GPUs accessible on-demand is brilliant. Your solution addresses the common pain points of high costs and limited availability, especially with top-tier GPUs like A100s and RTX 4090s. I appreciate the straightforward pricing and seamless user experience you've crafted. The flexibility for GPU owners to earn money is a fantastic addition. Looking forward to seeing how this evolves!
Nicholas, GPUDeploy sounds like a game-changer for ML practitioners. The ability to access high-quality GPUs like A100s and H100s on-demand at such competitive prices is incredible. The ease of launching instances without the usual reservations and sales calls is a huge plus. Your focus on reliability and user experience is evident. Looking forward to seeing how this reshapes the GPU rental market!
Nicholas, this is a game-changer for the AI community! The seamless integration of on-demand GPU access without the hassle of reservations or high markups is a much-needed solution. The ability to train models affordably and efficiently, as you demonstrated with nanoGPT, is impressive. Excited to see how GPUDeploy can revolutionize access to high-quality GPUs for everyone. Well done!
Hi Nicholas,
GPUDeploy seems like a fantastic solution for accessing affordable GPU power.
Questions:
- How do you ensure the reliability and performance of the GPUs available on your platform?
- Can users scale up their usage seamlessly for larger projects or training models?
Congrats on the launch!
@kyrylosilin we capture performance metrics and perform a number of checks on each machine when it joins our site and continuously throughout its lifetime. Unreliable machines are removed immediately. With our on-demand offering you can seamlessly switch between machines - we currently offer machines up to 8xH100 with 640GB of GPU memory.
GPUDeploy
SaaS for Greater Good
Telebugs