I was trying to archive some twitter posts with gallery-dl, and twmd. My target is large, about 500 profiles need to be pulled with the first few profiles i succeed downloading having a few thousand media files each. So i hit the quota soon after those few profiles.
A while ago when i was doing the same with yt-dlp on other sites, the same problem also happen. Back then --flat-playlist was a must have for large playlists.
I've tried out -g -G -j with gallery dl, thinking there might be a chance we can get a whole list of url with one request. But the quota capped on this also
I also need to constantly update the files, adding new files from new posts. Any idea what could be done to avoid hitting the quota? Or is there a request count documentation for gallery-dl?