Thank you that's was I was looking for!
Mixel
joined 2 years ago
Anwesend 👍🏻
Gibt es schon eine eta wann die Instanz auf 0.18 upgraded?
Yes thank you for the information I really appreciate it! I decided to go for kobold.cpp for the meantime with CLBlast which works just overall way better than standart CPU inference. But im looking into the ROCm LLamacpp support which I am currently trying.
Vielen dank für den Tipp, ich glaube ich bleibe aber solange bei jerboa bis eine die erste version von Boost für Lemmy rauskommt :) Die habe ich nämlich schon sehr Lange bei Reddit genutzt
I will try that once in home! Ty for the suggestions can I use kobold also in sillytavern? iirc there was an option for koboldai or something is that koboldcpp or what does that option do?
EDIT: I got it working and its wonderful thank you for suggesting me this :) I had some difficulties setting it up especially with opencl-mesa since I had to install opencl-amd and then finind out the device ID and so on but once it was working its great!
Richtig danke nochmal für die Antwort :) Ich habe auch einen thread auf lemmy.world gesehen wo die admins versucht haben auf 0.18 zu aktualisieren aber einige schwierigkeiten hatten ich hoffe das wird mit dem nächsten Update besser, sodass feddit auch ohne Komplikationen upgraden kann
How do use ooba with rocm I looked at the python file where you can install amd and it will just say "amd not supported" and exit. I guess it just doesn't update the webui.py when I update ooba? I somewhere heard that llama.cpp with CLBlast wouldn't work with ooba, or am I wrong? Also is konoldcpp worth a shot? I hear some success with it
This is sadly the correct answer. Many people also just use what their preferred OS preinstalles rarely users ever use an alternative to that
You can just have the extended interface so you have more options sadly there's no gesture for it yet
Have you search protondb for some reports? Not sure if the game runs good never had it
Can you elaborate on what questionable things they did? I am thinking of hosting my own gitea instance