This guy develops on windows
rutrum
joined 2 years ago
I used nixos-mailserver with success, and very little configuration. Most of it was dns, and thr guide walked me through it. You would have to a nixos box somewhere though. I spun one up on my vps for it.
If you enable iptables you may have to disable firewall.
I am also using nixvim. Didn't know about this fork. I think I like it? It beats manually writing setup configs. But Im not a vim superuser by any means, so I'm sure nixneovim would be equally useful to me.
Use git? Use CI/CD? What do you mean?
That's right, "text-generation-webui". At least its unambiguous lol. Thanks for sharing.
What GPU are you using to run it? And what UI are you using to interface with it? (I know of gpt4all and the generic sounding ui-text-generation program or something)
Yes I've got that set but still running into issues at runtime.
It was not configured correctly. Its a nixos bug. Thanks for pointing out the daemon config its what lead me down to solving the docker problem.
Yes thats the nvidia-container-toolkit I described above. It should be installed.
From my short time with proxmox, I had to dive into the command line to do configuration at the host level that couldnt be done with the UI. I think nixos will help replacd those ad hoc configurations with nix options. In the many articles I read about gpu passthru, and also doing harddrive passthru, I had to work in the host debian environment.
I dumped proxmox because I couldnt get gpu passthrough to work, and havent looked back. Nixos modules and docker have served me better than VMs for my usecase.