Selfhosted

50550 readers

396 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago

MODERATORS

HybridSarcasm@lemmy.world

HybridSarcasm@lemmy.hybridsarcasm.xyz

Any tool to visualize Traefik access logs? (sh.itjust.works)

submitted 3 days ago* (last edited 2 days ago) by ohshit604@sh.itjust.works to c/selfhosted@lemmy.world

7 comments fedilink hide all child comments

Afternoon y’all -

I just spent the last few days fiddling with Prometheus under the impression I could visualize Traefik’s access logs with Perses however, after finally getting these three to communicate with one another it seems that Prometheus lacks the capability to query access logs.

I don’t host my own html/php, I typically find docker images like Invidious or Redlib spin them up in a compose/yaml file and reverse proxy them, my knowledge towards html/php is very minimal so when I read about adding files to the root path of my domain it may seem straight forward for some people but makes no sense to me, apologies if that comes off as ignorant.

I digress, I stumbled upon GoAccess and gave it a shot but from what I’m reading it seems that it needs access to the html that these application use to display reporting in a web-browser which I genuinely got no idea on how to do, Traefik currently spits access logs in a .log file which I assume would be enough to visualize from?

I want to thank everyone for their responses, I’ve been so busy that I couldn’t respond right away but I got GoAccess running and reverse proxied!

I was trying to stay away from Grafana and their associating applications as I’m under the impression they’re moving more towards close-sourced software and seem to be partnering with Google which lead to concerns in regard to data collection.

top 7 comments

sorted by: hot top controversial new old

[–] tofu@lemmy.nocturnal.garden 5 points 2 days ago

I've had a similar question about nginx recently and it should roughly be the same: https://lemmy.nocturnal.garden/post/161470

GoAccess helps to get a better glance, but eventually I want to set up Loki as well.

[–] fubarx@lemmy.world 5 points 3 days ago

Grafana: https://tomerklein.dev/visualizing-traefik-metrics-with-grafana-and-prometheus-step-by-step-a6a1e9b5fb2c

[–] JASN_DE@feddit.org 4 points 2 days ago (1 children)

Goaccess reads the Traefik log and spits out an HTML file you can then serve via e.g. Nginx. Works for me.

[–] ohshit604@sh.itjust.works 1 points 2 days ago* (last edited 2 days ago)

Thank you for this! I never used Nginx directly and only thought of it as a reverse proxy but I had no idea it was capable of actually hosting html/php.

I went back to the drawing board so to say and was able to get GoAccess running, granted non-containerized on bare metal, and was able to reverse proxy the Nginx instance via Traefik.

[–] MXX53@programming.dev 4 points 3 days ago (1 children)

I use alloy to scrape my traefik logs and pass them to Loki. Then I use logQL to parse out the info and regexp to format so I can use it in a visualization. I don’t have my configs handy at the moment but I can try and get them at some point to share something close to what I do as a starting point.

[–] jaark 2 points 2 days ago

This. Prometheus is for metrics, Loki is for logs. I've not come across Perses before, but it looks like it does a similar job to Grafana which integrates really well with Prometheus and Loki (and is produced by the same organisation as both of them).

[–] MangoPenguin@lemmy.blahaj.zone 1 points 2 days ago

Grafana is how I've done it, using Loki to ingest and store the logs, and Prometheus for metrics.

There's also Goaccess which is like 1000x easier to use, and works pretty well.