The AutoThrottle extension honours the standard Scrapy settings for
concurrency and delay. This means that it will respect
CONCURRENT_REQUESTS_PER_DOMAIN and CONCURRENT_REQUESTS_PER_IP options
and never set a download delay lower than DOWNLOAD_DELAY.
我在文档中找到了这个注释,可以解答您的疑问。在
相关问题 更多 >
编程相关推荐