{{description}}
datapackage-pipelines-aws的Python项目详细描述
#数据包管道的AWS扩展
[![构建状态](https://travis-ci.org/frictionlessdata/datapackage-pipelines-aws.svg?(https://travis ci.org/frictionlesssdata/datapackage-pipetapepipeople-aws)
``` ` ` `
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `使用数据包管道aws作为插件对于[DPP](https://github.com/frictionlessdata/datapackage pipelines datapackage pipelines)。在pipeline-spec.yaml中,它将如下所示:
``yaml
…
-运行:aws.dump.to_s3
````
请参阅[设置凭据的指南](http://docs.aws.amazon.com/sdk for java/v1/developer guide/credentials.html)
*`acl`-提供上传文件的acl。默认值为“public read”(有关详细信息,请参见[BOTO3 docs](http://boto3.readthedocs.io/en/latest/reference/services/s3.html s3.client.put_u object)。
*`path`-数据包的路径(键/前缀)。可能包含可用于“datapackage.json”的格式字符串,例如:`my/example/path/{owner}/{name}/{version}`
*`content\u type`-在S3中存储文件时使用的内容类型。默认为文本/纯文本(通常S3默认为二进制/八位字节流,但我们更喜欢文本/纯文本)。
*`endpoint\uURL`-允许使用S3兼容服务的API端点(例如,'https://ams3.digitaloceanspaces.com')
示例:
``yaml
数据中心:
标题:数据中心到S3
管道:
-
运行:加载元数据
参数:
url:http://example.com/my datapackage/datapackage.json
-
run:load_resource
参数:
url:http://example.com/my datapackage/datapackage.json
resource:my resource
-
run:aws.dump.to_s3
参数:
bucket:my.bucket.name
路径:path/{owner}/{name}/{version}
-
run:aws.dump.to_s3
参数:
bucket:my.another.bucket
path:another/path/{version}
acl:private
```
*my.bucket.name/path/my name/py package name/latest/..
*my.bucket.name/another/path/latest/..
\change撸u acl
` private'private''public-read''public-read-read''public-read''authenticated-read''aws-exec-read''bucket-own-read''bucket-own-own-full-control''''aws-exec-read''aws-exec-read''bucket-bucket-own-own-full-control''`
例如:'
``yaml
```yaml
datahub:
>标题:datahub-to-s3
>管道:
>>>
-
->>>>>
参数:
url:http://example.com/my datapackage/datapackage.json
-
run:load_resource
参数:
url:http://example.com/my datapackage/datapackage.json
resource:my resource
-
run:aws.dump.to_s3
参数:
bucket:my.bucket.name
路径:path/{owner}/{name}/{version}
-
运行:aws.change_acl
参数:
bucket:my.another.bucket
path:path/
acl:private
`````
执行上述管道将在s3上保存数据包,并将acl改为private以“path”为前缀的所有键:
**注意:*如果path参数不是设置这将更改给定bucket中所有对象的acl
[![构建状态](https://travis-ci.org/frictionlessdata/datapackage-pipelines-aws.svg?(https://travis ci.org/frictionlesssdata/datapackage-pipetapepipeople-aws)
``` ` ` `
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `使用数据包管道aws作为插件对于[DPP](https://github.com/frictionlessdata/datapackage pipelines datapackage pipelines)。在pipeline-spec.yaml中,它将如下所示:
``yaml
…
-运行:aws.dump.to_s3
````
请参阅[设置凭据的指南](http://docs.aws.amazon.com/sdk for java/v1/developer guide/credentials.html)
*`acl`-提供上传文件的acl。默认值为“public read”(有关详细信息,请参见[BOTO3 docs](http://boto3.readthedocs.io/en/latest/reference/services/s3.html s3.client.put_u object)。
*`path`-数据包的路径(键/前缀)。可能包含可用于“datapackage.json”的格式字符串,例如:`my/example/path/{owner}/{name}/{version}`
*`content\u type`-在S3中存储文件时使用的内容类型。默认为文本/纯文本(通常S3默认为二进制/八位字节流,但我们更喜欢文本/纯文本)。
*`endpoint\uURL`-允许使用S3兼容服务的API端点(例如,'https://ams3.digitaloceanspaces.com')
示例:
``yaml
数据中心:
标题:数据中心到S3
管道:
-
运行:加载元数据
参数:
url:http://example.com/my datapackage/datapackage.json
-
run:load_resource
参数:
url:http://example.com/my datapackage/datapackage.json
resource:my resource
-
run:aws.dump.to_s3
参数:
bucket:my.bucket.name
路径:path/{owner}/{name}/{version}
-
run:aws.dump.to_s3
参数:
bucket:my.another.bucket
path:another/path/{version}
acl:private
```
*my.bucket.name/path/my name/py package name/latest/..
*my.bucket.name/another/path/latest/..
\change撸u acl
` private'private''public-read''public-read-read''public-read''authenticated-read''aws-exec-read''bucket-own-read''bucket-own-own-full-control''''aws-exec-read''aws-exec-read''bucket-bucket-own-own-full-control''`
例如:'
``yaml
```yaml
datahub:
>标题:datahub-to-s3
>管道:
>>>
-
->>>>>
参数:
url:http://example.com/my datapackage/datapackage.json
-
run:load_resource
参数:
url:http://example.com/my datapackage/datapackage.json
resource:my resource
-
run:aws.dump.to_s3
参数:
bucket:my.bucket.name
路径:path/{owner}/{name}/{version}
-
运行:aws.change_acl
参数:
bucket:my.another.bucket
path:path/
acl:private
`````
执行上述管道将在s3上保存数据包,并将acl改为private以“path”为前缀的所有键:
**注意:*如果path参数不是设置这将更改给定bucket中所有对象的acl