name: zimit
services:
zimit:
volumes:
- ${OUTPUT}:/output
shm_size: 1gb
image: ghcr.io/openzim/zimit
command: zimit --seeds ${URL} --name
${FILENAME} --depth ${DEPTH} #number of hops. -1 (infinite) is default.
#The image accepts the following parameters, as well as any of the Browsertrix crawler and warc2zim ones:
# Required: --seeds URL - the url to start crawling from ; multiple URLs can be separated by a comma (even if usually not needed, these are just the seeds of the crawl) ; first seed URL is used as ZIM homepage
# Required: --name - Name of ZIM file
# --output - output directory (defaults to /output)
# --pageLimit U - Limit capture to at most U URLs
# --scopeExcludeRx <regex> - skip URLs that match the regex from crawling. Can be specified multiple times. An example is --scopeExcludeRx="(\?q=|signup-landing\?|\?cid=)", where URLs that contain either ?q= or signup-landing? or ?cid= will be excluded.
# --workers N - number of crawl workers to be run in parallel
# --waitUntil - Puppeteer setting for how long to wait for page load. See page.goto waitUntil options. The default is load, but for static sites, --waitUntil domcontentloaded may be used to speed up the crawl (to avoid waiting for ads to load for example).
# --keep - in case of failure, WARC files and other temporary files (which are stored as a subfolder of output directory) are always kept, otherwise they are automatically deleted. Use this flag to always keep WARC files, even in case of success.
For the four variables, you can add them individually in Portainer (like I did), use a .env file, or replace ${OUTPUT}, ${URL},${FILENAME}, and ${DEPTH} directly.