this post was submitted on 31 Jul 2025
23 points (96.0% liked)

Selfhosted

50026 readers
225 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
HybridSarcasm@lemmy.world
HybridSarcasm@lemmy.hybridsarcasm.xyz
23
Reverse Proxy Monitoring (lemmy.nocturnal.garden)
submitted 2 days ago by tofu@lemmy.nocturnal.garden to c/selfhosted@lemmy.world
7 comments fedilink hide all child comments
 

I'm interested how y'all check/monitor your reverse proxy logs. I run an nginx vm that has ports 80 and 443 forwarded that exposes some of my services to the internet on different domains. I use nginx exporter for Prometheus, but I would like a better monitoring to see what connects to my services (like my Lemmy instance).

If I would be under pressure by LLM scrapers for example, I would only notice via application and hardware metrics, but I would have to figure out what's going on.

top 7 comments
sorted by: hot top controversial new old
[–] lemmyng@piefed.ca 5 points 2 days ago

Sounds like what you want is tracing. OpenTelemetry is the de facto standard for that. Couple it with aggressive sampling (here's a great talk on it https://www.usenix.org/conference/srecon24americas/presentation/cruz ) and you'll have a very efficient way of identifying use patterns.

[–] drkt@scribe.disroot.org 6 points 2 days ago (1 children)

Your proxy doesn't have its own logs?

I use Apache for reverse proxying and it's just standard access logs.
I built a python script to monitor all my access logs:
https://u.drkt.eu/GqBdds.png

[–] tofu@lemmy.nocturnal.garden 4 points 2 days ago (2 children)

It has logs of course, but I want something like a dashboard and alerts, not having to scroll a textfile

[–] doeknius_gloek@discuss.tchncs.de 6 points 2 days ago* (last edited 2 days ago)

I use Promtail + Loki + Grafana to monitor application logs. Promtail scrapes logs, Loki stores and indexes them and Grafana can query Loki with LogQL and also send alerts.

Apparently Promtail is superseded by Grafana Alloy, which I don't have experience with.

Anyway, I set this up mostly for fun and to preserve logs of terminated pods in my kubernetes cluster. I don't have any alerts in place, but I probably could.

https://grafana.com/docs/loki/latest/

[–] drkt@scribe.disroot.org 4 points 2 days ago* (last edited 2 days ago) (1 children)

Depending on what your log files look like, look at 'GoAccess'.
I think you're gonna be disappointed with existing solutions if you don't want to sit and stare at text files. It's big business to automate this kind of stuff, because it's hard.

[–] tofu@lemmy.nocturnal.garden 3 points 1 day ago

I gave it a quick try and while it's not exactly what I had in mind, it's pretty cool! I'll organize my log formats a bit and check it out more in depth, thanks

[–] Bakkoda@sh.itjust.works 3 points 2 days ago

Try out GoAcess.