this post was submitted on 06 Jul 2025
14 points (100.0% liked)

Technology

353 readers
162 users here now

Share interesting Technology news and links.

Rules:

  1. No paywalled sites at all.
  2. News articles has to be recent, not older than 2 weeks (14 days).
  3. No videos.
  4. Post only direct links.

To encourage more original sources and keep this space commercial free as much as I could, the following websites are Blacklisted:

More sites will be added to the blacklist as needed.

Encouraged:

founded 3 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Maxxie@lemmy.blahaj.zone 1 points 1 month ago* (last edited 1 month ago)

Everyone is guessing how much better llm can get, I wanna know how much it really costs.

I assume all ai companies are operating at a loss, but to what degree? Is all the RAG stuff a fad or in the future a significant part of api requests will go through llm? Can you stuff million lines of code into the black box and expect it to come up with a reasonable answer at a reasonable price?

I can't answer any of that without knowing the algorithmic cost of all this stuff, and whenever I try looking the answer ranges from "well its a few times heavier than a google search" to "a single request can power a small household for 6 hours"