I have a spare 5090 lying around, and was thinking of building a server to rent it out for.
However, I'm not sure how much I should invest in it. Would a Ryzen 7 7700X be okay? (8-core) I know a certain crowd of users like server-grade CPUs, but that seems like too big of an investment for me at the moment.
Get a data-backed earnings estimate based on current GPU utilization and marketplace pricing. Set your price, see your range.
Check it out here: https://vast.ai/hosting/calculator
and give us feedback on discord, on the host feature-requests channel.
Disclaimer: Vast.ai does not guarantee any level of utilization or earnings.
I'm a newbie, i have a trained lora which i have to run on top of a base model and a workflow. Can i use them in vast ai serverless somehow? how bad would cold starts be?
This happens quite a lot of times. I have filtered to just use RTX 3090, nothing else.
But when I check my worker group. I see random much more expensive GPUs being loaded.
This defeats my cost optimisation purpose and using serverless. Not sure if something is wrong from my side
I would rather use a fixed instance, if this serverless api is not predictable
Is there anybody running a 16GB Vram Gpu (rtx a4000) on Pcie x16 with 32 GB ram on 4/8 cores cpu on a asus b250 Me motherboard?
Cant find any in the database, but the specs should make it work?
Edit: one limitation I see, is, the board has no m.2 port for fast read/write memory.
Hi, I'm new to renting GPUs and ComfyUI. I have a basic laptop that can't run ComfyUI locally. I'd like to rent GPUs to start learning and earn later to get myself a PC. Anybody here can please guide me how to use ComfyUI on Vast.AI? I searched YT but didn't find much content there. and the videos were old. I also want to know do we get comfy manager in there? How to download models, nodes in there? Do I need to use wget, Aria2c? Please help me out. I'm a newbie with almost zero knowledge. Thanks in advance.
Earlier this year, a neighbor of mine was selling a small solar field he owned, that produces more kWh’s per year than my house uses, so I planned on selling the net metered credits to friends and family. I bought it, and the next month, our utility provider (Eversource) lowered their rates enough to put the whole endeavor in the red. Sucks to be me, I know.
So, I’ve been looking at ways to make money with the excess kWh’s I have access to now (asking AI all sorts of different questions around the topic) and I’ve been researching vast.ai as a way to gradually make use of what I have.
I don’t really have a specific question, other than “I’m thinking of hosting on vast.ai, but I’m new to this! What do I do?” Of course, AI tells me exactly what I want to hear, but I want the cold hard truth from people who will tell me all the reasons this is not going to work (y’know… what reddit is tailor made for!).
So, if you were in my position (with more electricity than you know what to do with, but losing money if you just sold it on the grid), how would you get started with hosting?
Has anyone used Vast.ai for hosting image generation models ? I burnt through $10 setting up the RTX 5090 series. Iterated for ~20 times. NO luck. always either timed out or errored.
Wanted to download Stable Diffusion, LLama 7B construct and QWen Image plus. Accounted for VRAM requirements and Storage. NOthing still.
Can anyone help ? I can share more specifcs reg config.
What can I take for a rtx a4000? It comes together in a machine with 4x, 128 GB ram, 2 TB nvram, 500/500