[Bulk Image Scraper] Option to add a delay between scrapes.

[godwinthehorny]

Currently, rule34.xxx has been restricting traffic quite a bit because of scrapers, returning a "429: too many requests" error when trying to scrape tags. Adding a field to the options tab of the scraper to add a delay between each attempt should prevent this from happening.

Image

[godwinthehorny]

Alternatively, if someone could tell me how I would go about adding a pause/sleep function to the gelbooru-xpath.yml to make it do it for each one, that would be much appreciated. I can't seem to figure it out.

[punamust]

There's currently a hardcoded 0.5s delay:

CommunityScripts/plugins/bulkImageScrape/bulkImageScrape.py

Line 353 in 1277b24

time.sleep(0.5)

It could probably be made configurable via the UI, but you could just modify the plugin on-disk directly (and reload) to change it.