监视URL的更改
keepaneyeon的Python项目详细描述
监视URL的更改
快速启动
keepaneyeon配置为yaml。以下配置将 下载urlhttp://httpbin.org/html和 http://httpbin.org/bytes/128。它将结果存储在s3中。
storage:-&aws!storage/s3access_key:<...>secret_access_key:<...>path:'s3://bucket/path'downloaders:-&http!downloader/http{}targets:-!targetname:staticdownloader:*httpurl:'http://httpbin.org/html'store:*aws-!targetname:dynamicdownloader:*httpurl:'http://httpbin.org/bytes/128'store:*aws
如果config.yaml包含上述配置,则可以执行 下载时使用:
keepaneyeon config.yaml