I've only seen the episode with Toby Turner in it and it has made me a worse person.
nagaram
joined 2 years ago
The trick is to talk to real actual human beings and not people terminally online enough to know about Lemmy.
Find a lefty book club and you'll find reasonable people.
My favorite lefty take to hit a capitalism/libertarian shill with is that I don't really think a communist/socialist project like the Soviet Union is the future. And honestly, you'd be hard pressed to find someone who does want that.
Its becoming a pretty common take these days that capitalism is fine IF human and environmental needs are met first.
Ollama and all that runs on it its just the firewall rules and opening it up to my network that's the issue.
I cannot get ufw, iptables, or anything like that running on it. So I usually just ssh into the PC and do a CLI only interaction. Which is mostly fine.
I want to use OpenWebUI so I can feed it notes and books as context, but I need the API which isn't open on my network.
The put some damn fan service into Law and Order: SVU and I might start watching!
Am I right fellas!?
He can be a bastard and your brother!
Wait... actually I guess he can only be one...
I was thinking about that now that I have Mac Minis on the mind. I might even just set a mac mini on top next to the modem.
Ollama + Gemma/Deepseek is a great start. I have only ran AI on my AMD 6600XT and that wasn't great and everything that I know is that AMD is fine for gaming AI tasks these days and not really LLM or Gen AI tasks.
A RTX 3060 12gb is the easiest and best self hosted option in my opinion. New for <$300 and used even less. However, I was running with a Geforce 1660 ti for a while and thats <$100
A mac is a very funny and objectively correct option
I think I'm going to have a harder time fitting a threadripper in my 10 inch rack than I am getting any GPU in there.
I do already have a NAS. It's in another box in my office.
I was considering replacing the PIs with a BOD and passing that through to one of my boxes via USB and virtualizing something. I compromised by putting 2tb Sata SSDs in each box to use for database stuff and then backing that up to the spinning rust in the other room.
How do I do that? Good question. I take suggestions.
The PIs were honestly because I had them.
I think I'd rather use them for something else like robotics or a Birdnet pi.
But the pi rack was like $20 and hilarious.
The objectively correct answer for more compute is more mini PCs though. And I'm really thinking about the Mac Mini option for AI.