this post was submitted on 27 Jan 2025
47 points (89.8% liked)
World News
500 readers
415 users here now
Please help and contribute as we vote on rules:
https://quokk.au/post/21590
Other Great Communities:
Rules
Be excellent to each other
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
it does not take an entire nvidia datacenter to serve one customer. the largest model appears to run on a high end rig.
The largest model, the only one that beats GPT is like 700gb.
It’s not running on a high end rig, it’s running on a server.