Cool. I've been hoping for solid pods to be widely adopted for sooo long now ;-P
Sims
joined 2 years ago
I totally love these 'lets run X on this completely unrelated Y' projects, and nested projects like running emulators in simulators etc. Nerds for the world!!
Ah, I thought I had herd of most distros, but I didn't know what Solus was: https://getsol.us/ 'A modern operating system to power your daily needs. Install today, update forever.' - whatever that means.
Seems like 2 hours of propaganda to me..
I'm not an expert in any of this, so just wildly speculating in the middle of the night about a huge hypothetical AI-lab for 1 person:
Super high-end equipment would probably quickly eat such a budget (2-5 * H100?), but a 'small' rack of 20-25 normal GPU's (p40) with 8gb+ vram, combined with a local petals.dev setup, would be my quick choice.
However, it's hard to compete with the cloud on power efficiency, so the setup would quickly expend all future power expenses. All non-sensitive traffic should probably go to something like groq cloud, and the rest on private servers.
An alternative solution is to go for a Npu setup (tpu,lpu, whatnotpu), and/or even a small power generator (wind, solar, digester/burner) to drive it. A cluster of 50 Opi5b (rk3588) 32gbram is within budget (50*6, 300Tops in theory, running with 1.6tb ram on 500w.). Afaik, the underlying software stack isn't there yet for small npu's, but more and more frameworks other than cuda pops up (cuda, rocm, metal, opencl, vulkan, ?) so one for Npu's will probably pop up soon.
Transformers use multiplications a lot, but bitnet doesn't (only addition), so perhaps models will move to a less power intensive hardware and model frameworks in the future?
Last on my mind atmo: You would probably also not spend all money on inference/training compute. Any descent cognitive architecture around a model (agent networks) need support functions. Tool servers, homeserved software for agents (fora/communication, scraping, modelling, codetesting, statistics etc). Basically versions of the tools we our selves use for different projects and communication/cooperation in an organization.
Didn't know it, so from readme: Immich, a high performance self-hosted photo and video management solution.
Dailymail is a propaganda outlet, but even they cannot lie about everything all the time - i hope.
This is a real potential problem, and here is a general walk-through by Anton Petrov on what this is about: iv.melmac.space/watch?v=IwpKNk_6jZ4 or https://youtu.be/IwpKNk_6jZ4
I think there are several factors influencing when someone feel 'bloat'. There's the 'purists' that tend to optimize their system to be as 'lean & mean' as possible - relentlessly, and there's the simplists that just want a simple setup/dashbord they can control - without too many options/distractions from info-bloat. Info-bloat hints to different types of bloat: filesize, dependencies, gfx details/animations, option-bloat, monetization-bloat and so on. There may also be cultural tendencies within different distro communities gentoo, tendencies from those with the emacs syndrome, or other more political groupings..
The last factor I can imagine atmo is that the level of hardware is very important and low end operators will tend to see more bloat when things run slowly - no matter their 'bloat focus'.
I had some Pythoncode for you but couldnt get the codeblock to play along 🙃
Well, if I need to resize those rigid panes, I'll just have to suck it up and manually move my hand to the keyboard ! ..and exercise is supposedly healthy anyway 🙃
I'll give it a spin. Thanks a lot.
edit: git had good information: https://github.com/zellij-org/zellij
edit2: "Try Zellij without installing
bash/zsh: bash <(curl -L zellij.dev/launch) fish/xonsh: bash -c 'bash <(curl -L zellij.dev/launch)' "
VERY easy to test out!
Last edit: https://zellij.dev/documentation/overview
Noob-warning ;)
Looks pretty cool. It almost gives a desktop-workspace vibe and seems way smarter than me flipping through my 6-10 session tabs.
Does someone know if Zellij run ontop of bash, fish etc, or is it a shell replacement ? I hopped to Guix and would rather not dive too deep atmo with changing shells and so on. Also, is it possible to control with mouse ? I often lean back and do things with a mouse and prefer both options if possible.
Never got around to using mux, but this seems nice.
Thx.
Cool info, but maybe the title is a bit ambiguous? Anyway:
'Deep-sea corals dating back a staggering 540 million years may have been the original pioneers of bioluminescence. This discovery challenges previous assumptions, pushing back the timeline of when animals first began to emit light.'