this post was submitted on 14 Dec 2025
1148 points (98.7% liked)
Memes
13372 readers
1349 users here now
Post memes here.
A meme is an idea, behavior, or style that spreads by means of imitation from person to person within a culture and often carries symbolic meaning representing a particular phenomenon or theme.
An Internet meme or meme, is a cultural item that is spread via the Internet, often through social media platforms. The name is by the concept of memes proposed by Richard Dawkins in 1972. Internet memes can take various forms, such as images, videos, GIFs, and various other viral sensations.
- Wait at least 2 months before reposting
- No explicitly political content (about political figures, political events, elections and so on), !politicalmemes@lemmy.ca can be better place for that
- Use NSFW marking accordingly
Laittakaa meemejä tänne.
- Odota ainakin 2 kuukautta ennen meemin postaamista uudelleen
- Ei selkeän poliittista sisältöä (poliitikoista, poliittisista tapahtumista, vaaleista jne) parempi paikka esim. !politicalmemes@lemmy.ca
- Merkitse K18-sisältö tarpeen mukaan
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not really. But the more you understand tech, the less you like the high tech market solutions and have the urge to have the same but in opensource.
I kinda dream that one day setups for mid-power home AI racks would be affordable enough to drop all the proprietary AIs and start automating my daily routines with agents & helping me build my local knowledge vector database with AI embeddings. No way in hell I'm exposing anything like that to thirdparties.
The efficiency improvements in some open models are becoming crazy, like hundreds of times from a year ago. I have a setup such as yours on my framework which can handle a 120b param model fully loaded. It's capable of the RAG setup you are already envisioning.
Moar deets, please!
What do you mean framework? What are the specs?
Hi,
I'm running the AMD AI 395+ with the 128gb of unified RAM option.
https://frame.work/ca/en/products/desktop-diy-amd-aimax300/configuration/new
I love mine. I'm running NixOS.
If you are capable of running 120b, the mistral cli bigger open source model in agentic mode could be available to you.
How much did your setup cost, if you don't mind to disclose such information?
I mentioned my spec above, and I added a 2tb m2, noctua upgrade and a couple expansion modules for the front. I preordered it around 6 months back so before any of the craziness. It was around $3600 CAD
Edit: also thank you. I have been busy making workflows and haven't looked at the models in a bit. I'll check out mistral
That's a good value! I was worrying something running mid power LLMs would cost 10k+ today. Sure ram screwup nuked the field, but it's also not on the top list of my priorities. So it gives me hope that by the time I would be ready it would be in even better shape.