垃圾中间件
scrapy-middlewares的Python项目详细描述
scrapy-middlewares
scrapy middlewares
Installation 安装
pip install scrapy_middlewares requests httpx aiohttp
Usage example 使用示例
'DOWNLOADER_MIDDLEWARES':{'scrapy_middlewares.req_sync_middleware.ModuleReqMiddleware':601},# module_name:# 'httpx', 'requests'yieldModuleRequest(url=url,callback=self.parse,module_name='requests')
'DOWNLOADER_MIDDLEWARES':{'scrapy_middlewares.req_async_middleware.ModuleAsyncReqMiddleware':601},# module_name:# 'httpx_async', 'aiohttp'yieldModuleRequest(url=url,callback=self.parse,module_name='httpx_async')
- 项目
标签：
欢迎加入QQ群-->： 979659372
