The original post: /r/datahoarder by /u/n3IVI0 on 2025-06-19 13:30:05.
I have for years been downloading comics from GoComics.com via wget. Recently, they have made changes to the website that have killed my handy bash script. They seem to be hiding the main comic of the day behind a javascript loader. I'll use Sherman's Lagoon as an example.
wget -E -H -k -K -p -nd -R html,svg,gif,css,jpg,jpeg,png,js,json,ico -P -T 5 -t 1 -e robots=off --http-user=USER -U "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.71 Safari/537.36 Edge/12.0" --referer="https://gocomics.com/" https://www.gocomics.com/shermanslagoon/$(date +%Y)/$(date +%m)/$(date +%d)
This will download the old comics down below, but not the latest comic being displayed by the Viewer up top. Can anybody figure out how to get wget to access the DAILY comic?
Thank you.