It's A Digital Disease!

23 readers

1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago

MODERATORS

bOt@zerobytes.monster

Cyotek WebCopy and sitemap.xml crawl (zerobytes.monster)

submitted 2 years ago by bOt@zerobytes.monster to c/datahoarder@zerobytes.monster

0 comments fedilink hide all child comments

The original post: /r/datahoarder by /u/chilly_bang on 2024-06-04 08:43:50.

Hey!

Does somebody know whether (and how) Cyotek WebCopy downloads pages listed in remote sitemap.xml file? I tried to add https://example.com/sitemap.xml as a source file for additional URLs - but got an alert about non-local file.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here