I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson.
Performances are a little bit low, but mostly enough to make the app usable.
I tried to find GPU instances for < $50/month, but couldn't find any. The only alternative would have been to rent Apple M1 instances at Scaleway, but it's still way more expensive (€80/month) than hosting my 10 watts Jetson at home.
Does anybody know cheaper GPU instances? I don't need much computing power, about 0.5Tflops to 1TFlops
Engaging in self-promotion without taking the time to understand the context is not helpful. Moreover, the estimated cost of approximately $800 per month would still apply, which may not be within the desired budget.
I am answering to the version before you edited it.
You are absolutely right, and I apologize if I came across as dismissive. We may have different viewpoints, and it's important to respect and acknowledge each other's perspectives. I appreciate your input, and I'm here to listen and address any further questions or concerns.
Thanks! Is there a status page like https://oblivus.com/availability/ for Lambda Cloud? I got very excited about building a product on top of Lambda cloud for cocalc.com, but after read lots of docs, when I tried Lambda cloud, I just got the message: "We are currently out of capacity for all instances. Please check again in a few hours." This was on April 27. I immediately thought: "There is no possible way I can build a product on this for my users, but it may be very useful for other tasks, e.g., training." If there were something like https://oblivus.com/availability/, especially with historical data, it would be very useful to appropriately set my expectations about how Lambda Cloud can best be used.
By the way, Lambda Stack is VERY impressive. Thanks for maintaining that!
They operate a model known as a "marketplace" or "community" cloud. Unlike us, they utilize servers hosted by individuals in their homes. This is something completely different.
While they may offer lower prices, the infrastructure may have limitations in terms of reliability, scalability, and security compared to data center-based providers. Additionally, the performance and availability of the services vary depending on the hosts' hardware and internet connection.
If you're working with Jetson, the RTX 4000 may be more powerful than you need right now, and it's the least expensive we've got. It's worth exploring if there are cloud service providers that offer lower-end GPUs, as that could potentially be a better fit for your requirements and budget.
Less than 50$ will be really hard, at least in any form of professional setup (so not hosted in a random basement ;) ).
Our lowest at Genesis Cloud at this time are instances with an RTX 3060Ti for 0.20$/hour which adds up to 146$/month ( https://www.genesiscloud.com/pricing#nvidia3060ti )
Though, this includes free storage, no egress fees and has a lot more power than a Jetson.
If you need to optimize for low cost hosting, did you already check whether you actually must have a GPU for your use case? Modern CPU have some impressing capabilities.
Here we have another instance of self-promotion that does not align with what GGP mentioned. Thank you, Genesis and Lambda, for promoting yourselves in a startup thread. Given your long-standing presence in this industry, I would expect better engagement from you.
You were doing so well, self promoting and engaging with the community on your post earlier. I didn't expect to see you stoop to this level of commenting.
Maybe it's time to step away from the keyboard for a while?
I appreciate and respect every user who contributes by asking questions, providing feedback, or sharing suggestions. However, it is disappointing and unreasonable to witness self-promotion from companies that have been established in this industry for a considerable period of time under a startup thread.
Moreover, the fact that their self-promotion does not align with the intention of the original discussion and GGP explains their purpose. Their primary goal is not genuinely assisting or finding a solution.
In such cases, as you can imagine, it's challenging for me to maintain respect.
I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson. Performances are a little bit low, but mostly enough to make the app usable.
I tried to find GPU instances for < $50/month, but couldn't find any. The only alternative would have been to rent Apple M1 instances at Scaleway, but it's still way more expensive (€80/month) than hosting my 10 watts Jetson at home.
Does anybody know cheaper GPU instances? I don't need much computing power, about 0.5Tflops to 1TFlops