apacheairflowprovidersamazon for Apache Airflow提供程序包

apache-airflow-providers-amazon的Python项目详细描述


包装apache airflow providers amazon

版本:1.0.0

目录

提供程序包

这是amazonprovider的提供程序包。此提供程序包的所有类 在airflow.providers.amazonpython包中。在

安装

注意!在

2020年11月,新版本的PIP(20.3)发布了一个新的2020解析器。这个解析器 尚不适用于Apache Airflow,可能会导致安装错误-取决于您的选择 额外的。为了安装气流,您需要将pip降级到20.2.4版本 pip upgrade --pip==20.2.4或者,如果您使用pip20.3,您需要添加选项 --use-deprecated legacy-resolver到pip安装命令。在

您可以将此软件包安装在现有的airflow 2.*上,通过 pip install apache-airflow-providers-amazon

PIP要求

PIP packageVersion required
boto3>=1.15.0,<1.16.0
botocore>=1.18.0,<1.19.0
watchtower~=0.7.3

跨提供程序包依赖项

为了使用包的所有特性,可能需要这些依赖项。 您需要安装指定的后端口提供程序包才能使用它们。在

从PyPI安装时,可以安装这种跨提供程序依赖项。例如:

pip install apache-airflow-providers-amazon[apache.hive]
^{tb2}$

提供程序类摘要

在Airflow 2.0中,amazon提供者的所有操作员、传输、挂钩、传感器、机密 在airflow.providers.amazon包中。您可以阅读有关使用的命名约定的更多信息 在Naming conventions for provider packages

操作员

新操作员

^{3}$

移动运算符

Airflow 2.0 operators: ^{} packageAirflow 1.10.* previous location (usually ^{})
aws.operators.athena.AWSAthenaOperatorcontrib.operators.aws_athena_operator.AWSAthenaOperator
aws.operators.batch.AwsBatchOperatorcontrib.operators.awsbatch_operator.AWSBatchOperator
aws.operators.ecs.ECSOperatorcontrib.operators.ecs_operator.ECSOperator
aws.operators.emr_add_steps.EmrAddStepsOperatorcontrib.operators.emr_add_steps_operator.EmrAddStepsOperator
aws.operators.emr_create_job_flow.EmrCreateJobFlowOperatorcontrib.operators.emr_create_job_flow_operator.EmrCreateJobFlowOperator
aws.operators.emr_terminate_job_flow.EmrTerminateJobFlowOperatorcontrib.operators.emr_terminate_job_flow_operator.EmrTerminateJobFlowOperator
aws.operators.s3_copy_object.S3CopyObjectOperatorcontrib.operators.s3_copy_object_operator.S3CopyObjectOperator
aws.operators.s3_delete_objects.S3DeleteObjectsOperatorcontrib.operators.s3_delete_objects_operator.S3DeleteObjectsOperator
aws.operators.s3_list.S3ListOperatorcontrib.operators.s3_list_operator.S3ListOperator
aws.operators.sagemaker_base.SageMakerBaseOperatorcontrib.operators.sagemaker_base_operator.SageMakerBaseOperator
aws.operators.sagemaker_endpoint.SageMakerEndpointOperatorcontrib.operators.sagemaker_endpoint_operator.SageMakerEndpointOperator
aws.operators.sagemaker_endpoint_config.SageMakerEndpointConfigOperatorcontrib.operators.sagemaker_endpoint_config_operator.SageMakerEndpointConfigOperator
aws.operators.sagemaker_model.SageMakerModelOperatorcontrib.operators.sagemaker_model_operator.SageMakerModelOperator
aws.operators.sagemaker_training.SageMakerTrainingOperatorcontrib.operators.sagemaker_training_operator.SageMakerTrainingOperator
aws.operators.sagemaker_transform.SageMakerTransformOperatorcontrib.operators.sagemaker_transform_operator.SageMakerTransformOperator
aws.operators.sagemaker_tuning.SageMakerTuningOperatorcontrib.operators.sagemaker_tuning_operator.SageMakerTuningOperator
aws.operators.sns.SnsPublishOperatorcontrib.operators.sns_publish_operator.SnsPublishOperator
aws.operators.sqs.SQSPublishOperatorcontrib.operators.aws_sqs_publish_operator.SQSPublishOperator

转移运算符

新的传输运算符

New Airflow 2.0 transfers: ^{} package
aws.transfers.glacier_to_gcs.GlacierToGCSOperator
aws.transfers.mysql_to_s3.MySQLToS3Operator

移动转移运算符

Airflow 2.0 transfers: ^{} packageAirflow 1.10.* previous location (usually ^{})
aws.transfers.dynamodb_to_s3.DynamoDBToS3Operatorcontrib.operators.dynamodb_to_s3.DynamoDBToS3Operator
aws.transfers.gcs_to_s3.GCSToS3Operatoroperators.gcs_to_s3.GCSToS3Operator
aws.transfers.google_api_to_s3.GoogleApiToS3Operatoroperators.google_api_to_s3_transfer.GoogleApiToS3Transfer
aws.transfers.hive_to_dynamodb.HiveToDynamoDBOperatorcontrib.operators.hive_to_dynamodb.HiveToDynamoDBOperator
aws.transfers.imap_attachment_to_s3.ImapAttachmentToS3Operatorcontrib.operators.imap_attachment_to_s3_operator.ImapAttachmentToS3Operator
aws.transfers.mongo_to_s3.MongoToS3Operatorcontrib.operators.mongo_to_s3.MongoToS3Operator
aws.transfers.redshift_to_s3.RedshiftToS3Operatoroperators.redshift_to_s3_operator.RedshiftToS3Transfer
aws.transfers.s3_to_redshift.S3ToRedshiftOperatoroperators.s3_to_redshift_operator.S3ToRedshiftTransfer
aws.transfers.s3_to_sftp.S3ToSFTPOperatorcontrib.operators.s3_to_sftp_operator.S3ToSFTPOperator
aws.transfers.sftp_to_s3.SFTPToS3Operatorcontrib.operators.sftp_to_s3_operator.SFTPToS3Operator

传感器

新传感器

New Airflow 2.0 sensors: ^{} package
aws.sensors.cloud_formation.CloudFormationCreateStackSensor
aws.sensors.cloud_formation.CloudFormationDeleteStackSensor
aws.sensors.ec2_instance_state.EC2InstanceStateSensor
aws.sensors.glacier.GlacierJobOperationSensor
aws.sensors.glue.AwsGlueJobSensor
aws.sensors.redshift.AwsRedshiftClusterSensor
aws.sensors.s3_keys_unchanged.S3KeysUnchangedSensor
aws.sensors.sagemaker_training.SageMakerTrainingSensor
aws.sensors.step_function_execution.StepFunctionExecutionSensor

移动传感器

Airflow 2.0 sensors: ^{} packageAirflow 1.10.* previous location (usually ^{})
aws.sensors.athena.AthenaSensorcontrib.sensors.aws_athena_sensor.AthenaSensor
aws.sensors.emr_base.EmrBaseSensorcontrib.sensors.emr_base_sensor.EmrBaseSensor
aws.sensors.emr_job_flow.EmrJobFlowSensorcontrib.sensors.emr_job_flow_sensor.EmrJobFlowSensor
aws.sensors.emr_step.EmrStepSensorcontrib.sensors.emr_step_sensor.EmrStepSensor
aws.sensors.glue_catalog_partition.AwsGlueCatalogPartitionSensorcontrib.sensors.aws_glue_catalog_partition_sensor.AwsGlueCatalogPartitionSensor
aws.sensors.s3_key.S3KeySensorsensors.s3_key_sensor.S3KeySensor
aws.sensors.s3_prefix.S3PrefixSensorsensors.s3_prefix_sensor.S3PrefixSensor
aws.sensors.sagemaker_base.SageMakerBaseSensorcontrib.sensors.sagemaker_base_sensor.SageMakerBaseSensor
aws.sensors.sagemaker_endpoint.SageMakerEndpointSensorcontrib.sensors.sagemaker_endpoint_sensor.SageMakerEndpointSensor
aws.sensors.sagemaker_transform.SageMakerTransformSensorcontrib.sensors.sagemaker_transform_sensor.SageMakerTransformSensor
aws.sensors.sagemaker_tuning.SageMakerTuningSensorcontrib.sensors.sagemaker_tuning_sensor.SageMakerTuningSensor
aws.sensors.sqs.SQSSensorcontrib.sensors.aws_sqs_sensor.SQSSensor

钩子

新挂钩

New Airflow 2.0 hooks: ^{} package
aws.hooks.batch_client.AwsBatchClientHook
aws.hooks.batch_waiters.AwsBatchWaitersHook
aws.hooks.cloud_formation.AWSCloudFormationHook
aws.hooks.ec2.EC2Hook
aws.hooks.elasticache_replication_group.ElastiCacheReplicationGroupHook
aws.hooks.glacier.GlacierHook
aws.hooks.glue.AwsGlueJobHook
aws.hooks.kinesis.AwsFirehoseHook
aws.hooks.redshift.RedshiftHook
aws.hooks.secrets_manager.SecretsManagerHook
aws.hooks.ses.SESHook
aws.hooks.step_function.StepFunctionHook

移动挂钩

Airflow 2.0 hooks: ^{} packageAirflow 1.10.* previous location (usually ^{})
aws.hooks.athena.AWSAthenaHookcontrib.hooks.aws_athena_hook.AWSAthenaHook
aws.hooks.base_aws.AwsBaseHookcontrib.hooks.aws_hook.AwsHook
aws.hooks.datasync.AWSDataSyncHookcontrib.hooks.aws_datasync_hook.AWSDataSyncHook
aws.hooks.dynamodb.AwsDynamoDBHookcontrib.hooks.aws_dynamodb_hook.AwsDynamoDBHook
aws.hooks.emr.EmrHookcontrib.hooks.emr_hook.EmrHook
aws.hooks.glue_catalog.AwsGlueCatalogHookcontrib.hooks.aws_glue_catalog_hook.AwsGlueCatalogHook
aws.hooks.lambda_function.AwsLambdaHookcontrib.hooks.aws_lambda_hook.AwsLambdaHook
aws.hooks.logs.AwsLogsHookcontrib.hooks.aws_logs_hook.AwsLogsHook
aws.hooks.s3.S3Hookhooks.S3_hook.S3Hook
aws.hooks.sagemaker.SageMakerHookcontrib.hooks.sagemaker_hook.SageMakerHook
aws.hooks.sns.AwsSnsHookcontrib.hooks.aws_sns_hook.AwsSnsHook
aws.hooks.sqs.SQSHookcontrib.hooks.aws_sqs_hook.SQSHook

秘密

感动的秘密

Airflow 2.0 secrets: ^{} packageAirflow 1.10.* previous location (usually ^{})
aws.secrets.secrets_manager.SecretsManagerBackendcontrib.secrets.aws_secrets_manager.SecretsManagerBackend
aws.secrets.systems_manager.SystemsManagerParameterStoreBackendcontrib.secrets.aws_systems_manager.SystemsManagerParameterStoreBackend

释放

版本1.0.0

CommitCommittedSubject
d5589673a2020-12-08Move dummy_operator.py to dummy.py (#11178) (#11293)
b40dffa082020-12-08Rename remaing modules to match AIP-21 (#12917)
9b39f24782020-12-08Add support for dynamic connection form fields per provider (#12558)
bd90136aa2020-11-30Move operator guides to provider documentation packages (#12681)
02d94349b2020-11-29Don't use time.time() or timezone.utcnow() for duration calculations (#12353)
de3b1e6872020-11-28Move connection guides to provider documentation packages (#12653)
663259d4b2020-11-25Fix AWS DataSync tests failing (#11020)
3fa51f94d2020-11-24Add check for duplicates in provider.yaml files (#12578)
ed09915a02020-11-23[AIRFLOW-5115] Bugfix for S3KeySensor failing to accept template_fields (#12389)
370e7d07d2020-11-21Fix Python Docstring parameters (#12513)
c34ef853c2020-11-20Separate out documentation building per provider (#12444)
0080354502020-11-18Update provider READMEs for 1.0.0b2 batch release (#12449)
7ca0b6f122020-11-18Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)
ae7cb4a1e2020-11-17Update wrong commit hash in backport provider changes (#12390)
6889a333c2020-11-15Improvements for operators and hooks ref docs (#12366)
c94b1241a2020-11-13Add extra error handling to S3 remote logging (#9908)
7825e8f592020-11-13Docs installation improvements (#12304)
250436d962020-11-10Fix spelling in Python files (#12230)
85a18e13d2020-11-09Point at pypi project pages for cross-dependency of provider packages (#12212)
59eb5de782020-11-09Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)
b2a28d1592020-11-09Moves provider packages scripts to dev (#12082)
fcb6b00ef2020-11-08Add authentication to AWS with Google credentials (#12079)
fb6bddba02020-11-07In AWS Secrets backend, a lookup is optional (#12143)
cf9437d792020-11-06Simplify string expressions (#12123)
41bf172c12020-11-04Simplify string expressions (#12093)
4e8f9cc8d2020-11-03Enable Black - Python Auto Formmatter (#9550)
8c42cf1b02020-11-03Use PyUpgrade to use Python 3.6 features (#11447)
5e77a61542020-11-02Docstring fix for S3DeleteBucketOperator (#12049)
8222851342020-10-29Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844)
db121f7262020-10-28Add truncate table (before copy) option to S3ToRedshiftOperator (#9246)
5a439e84e2020-10-26Prepare providers release 0.0.2a1 (#11855)
8afdb6ac62020-10-26Fix spellings (#11825)
872b1566a2020-10-25Generated backport providers readmes/setup for 2020.10.29 (#11826)
6ce855af12020-10-24Fix spelling (#11821)
3934ef2242020-10-24Remove redundant builtins imports (#11809)
4c8e033c02020-10-24Fix spelling and grammar (#11814)
4830687452020-10-24Use Python 3 style super classes (#11806)
0df60b7732020-10-23Add reattach flag to ECSOperator (#10643)
b9d677cdd2020-10-22Add type hints to aws provider (#11531)
349b0811c2020-10-20Add D200 pydocstyle check (#11688)
674368f662020-10-19Fixes MySQLToS3 float to int conversion (#10437)
0823d46a72020-10-16Add type annotations for AWS operators and hooks (#11434)
16e7129712020-10-13Added support for provider packages for Airflow 2.0 (#11487)
d38a0a7812020-10-12added type hints for aws cloud formation (#11470)
d305876be2020-10-12Remove redundant None provided as default to dict.get() (#11448)
c3e3405842020-10-11Change prefix of AwsDynamoDB hook module (#11209)
42a23d16f2020-10-11Update MySQLToS3Operator's s3_bucket to template_fields (#10778)
422b61a9d2020-10-09Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701)
dd98b21492020-10-06Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)
32b3cfbcf2020-10-06Strict type check for all hooks in amazon (#11250)
6d573e8ab2020-10-03Add s3 key to template fields for s3/redshift transfer operators (#10890)
0a0e1af802020-10-03Fix Broken Markdown links in Providers README TOC (#11249)
ca4238eb42020-10-02Fixed month in backport packages to October (#11242)
5220e4c382020-10-02Prepare Backport release 2020.09.07 (#11238)
00ffedb8c2020-09-30Add amazon glacier to GCS transfer operator (#10947)
e3f96ce7a2020-09-24Fix incorrect Usage of Optional[bool] (#11138)
f3e87c5032020-09-22Add D202 pydocstyle check (#11032)
b61225a882020-09-21Add D204 pydocstyle check (#11031)
2410f592a2020-09-19Get Airflow configs with sensitive data from AWS Systems Manager (#11023)
2bf7b7cac2020-09-19Add typing to amazon provider EMR (#10910)
9edfcb7ac2020-09-19Support extra_args in S3Hook and GCSToS3Operator (#11001)
4e1f3a69d2020-09-14[AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655)
e9add79162020-09-14Fix Failing static tests on Master (#10927)
383a118d22020-09-14Add more type annotations to AWS hooks (#10671)
9549274d12020-09-09Upgrade black to 20.8b1 (#10818)
2934220dc2020-09-08Always return a list from S3Hook list methods (#10774)
f40ac9b152020-09-01Add placement_strategy option (#9444)
e4878e6772020-08-31fix type hints for s3 hook read_key method (#10653)
2ca615cff2020-08-29Update Google Cloud branding (#10642)
8969b71852020-08-28Removed bad characters from AWS operator (#10590)
8349061f92020-08-26Improve Docstring for AWS Athena Hook/Operator (#10580)
fdd9b6f652020-08-25Enable Black on Providers Packages (#10543)
3696c34c22020-08-24Fix typo in the word "release" (#10528)
3734876d92020-08-24Implement impersonation in google operators (#10052)
ee7ca128a2020-08-22Fix broken Markdown refernces in Providers README (#10483)
c6358045f2020-08-22Fixes S3ToRedshift COPY query (#10436)
7c206a82a2020-08-22Replace assigment with Augmented assignment (#10468)
27d08b76a2020-08-21Amazon SES Hook (#10391)
dea345b052020-08-17Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022)
f6734b3b82020-08-12Enable Sphinx spellcheck for doc generation (#10280)
82f744b872020-08-11Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286)
19bc97d0c2020-08-10Revert "Add Amazon SES hook (#10004)" (#10276)
f06fe616e2020-08-10Add Amazon SES hook (#10004)
0c77ea8a32020-08-06Add type annotations to S3 hook module (#10164)
24c8e4c2d2020-08-06Changes to all the constructors to remove the args argument (#10163)
9667314b22020-08-05Add correct signatures for operators in amazon provider package (#10167)
0002877532020-08-03Improve Typing coverage of amazon/aws/athena (#10025)
53ada6e792020-08-03Add S3KeysUnchangedSensor (#9817)
aeea712742020-08-02Remove ^{} parameter from provider operator constructors (#10097)
2b8dea64e2020-08-01Fix typo in Athena sensor retries (#10079)
1508c43ec2020-07-29Adding new SageMaker operator for ProcessingJobs (#9594)
7d24b088c2020-07-25Stop using start_date in default_args in example_dags (2) (#9985)
8b10a4b352020-07-25Stop using start_date in default_args in example_dags (#9982)
33f0cd2652020-07-22apply_default keeps the function signature for mypy (#9784)
e7c87fe452020-07-20Refactor AwsBaseHook._get_credentials (#9878)
2577f93342020-07-16Fix S3FileTransformOperator to support S3 Select transformation only (#8936)
52b6efe1e2020-07-15Add option to delete by prefix to S3DeleteObjectsOperator (#9350)
553bb7af72020-07-13Keep functions signatures in decorators (#9786)
2f31b30602020-07-08Get Airflow configs with sensitive data from Secret Backends (#9645)
07b81029e2020-07-08Allow AWSAthenaHook to get more than 1000/first page of results (#6075)
564192c162020-07-08Add AWS StepFunctions integrations to the aws provider (#8749)
ecce1ace72020-07-08[AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator
a79e2d4c42020-07-06Move provider's log task handlers to the provider package (#9604)
ee20086b82020-07-02Move S3TaskHandler to the AWS provider package (#9602)
40add26d42020-06-29Remove almost all references to airflow.contrib (#9559)
c858babdd2020-06-26Remove kwargs from Super calls in AWS Secrets Backends (#9523)
87fdbd0702020-06-25Use literal syntax instead of function calls to create data structure (#9516)
c7a454aa32020-06-22Add AWS ECS system test (#8888)
df8efd04f2020-06-21Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460)
e13a14c872020-06-21Enable & Fix Whitespace related PyDocStyle Checks (#9458)
d0e7db4022020-06-19Fixed release number for fresh release (#9408)
12af6a0802020-06-19Final cleanup for 2020.6.23rc1 release preparation (#9404)
992a18c842020-06-19Move MySqlToS3Operator to transfers (#9400)
a60f589aa2020-06-19Add MySqlToS3Operator (#9054)
c7e5bce572020-06-19Prepare backport release candidate for 2020.6.23rc1 (#9370)
40bf8f28f2020-06-18Detect automatically the lack of reference to the guide in the operator descriptions (#9290)
f6bd817a32020-06-16Introduce 'transfers' packages (#9320)
58a8ec0e42020-06-16AWSBatchOperator <> ClientHook relation changed to composition (#9306)
a80cd25e82020-06-15Close/Flush byte stream in s3 hook load_string and load_bytes (#9211)
ffb8574032020-06-14Decrypt secrets from SystemsManagerParameterStoreBackend (#9214)
a69b031f22020-06-10Add S3ToRedshift example dag and system test (#8877)
17adcea832020-06-02Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)
357e11e0c2020-05-29Add Delete/Create S3 bucket operators (#8895)
1ed171bfb2020-05-28Add script_args for S3FileTransformOperator (#9019)
0b0e4f7a42020-05-26Preparing for RC3 relase of backports (#9026)
00642a46d2020-05-26Fixed name of 20 remaining wrongly named operators. (#8994)
1d36b03032020-05-23Fix references in docs (#8984)
f946f96da2020-05-23Old json boto compat removed from dynamodb_to_s3 operator (#8987)
375d1ca222020-05-19Release candidate 2 for backport packages 2020.05.20 (#8898)
12c5e5d8a2020-05-17Prepare release candidate for backport packages (#8891)
f3521fb0e2020-05-16Regenerate readme files for backport package release (#8886)
f4edd90a92020-05-16Speed up TestAwsLambdaHook by not actually running a function (#8882)
92585ca4c2020-05-15Added automated release notes generation for backport operators (#8807)
85bbab27d2020-05-15Add EMR operators howto docs (#8863)
e61b9bb9b2020-05-13Add AWS EMR System tests (#8618)
ed3f5131a2020-05-13Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845)
7236862a12020-05-12[AIRFLOW-2310] Enable AWS Glue Job Integration (#6007)
d590e5e762020-05-11Add option to propagate tags in ECSOperator (#8811)
0c3db84c32020-05-11[AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731)
cbebed2b42020-05-10Allow passing backend_kwargs to AWS SSM client (#8802)
c7788a6892020-05-10Add imap_attachment_to_s3 example dag and system test (#8669)
ff5b701492020-05-07Add google_api_to_s3_transfer example dags and system tests (#8581)
4421f011e2020-05-01Improve template capabilities of EMR job and step operators (#8572)
379a884d62020-04-28fix: aws hook should work without conn id (#8534)
74bc316c52020-04-27[AIRFLOW-4438] Add Gzip compression to S3_hook (#8571)
7ea66a1a92020-04-26Add example DAG for ECSOperator (#8452)
b6434dedf2020-04-24[AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441)
becedd5af2020-04-19Remove unrelated EC2 references in ECSOperator (#8451)
ab1290cb02020-04-13Make launch_type parameter optional (#8248)
87969a3502020-04-09[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)
b46d6c0602020-04-08Add support for AWS Secrets Manager as Secrets Backend (#8186)
68d1714f22020-04-04[AIRFLOW-6822] AWS hooks should cache boto3 client (#7541)
8a02402572020-03-31Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)
7239d9a822020-03-28Get Airflow Variables from AWS Systems Manager Parameter Store (#7945)
eb4af4f942020-03-28Make BaseSecretsBackend.build_path generic (#7948)
438da72412020-03-28[AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891)
686d7d50b2020-03-25Standardize SecretBackend class names (#7846)
eef87b9952020-03-23[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)
5648dfbc32020-03-23Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827)
a360024122020-03-19[AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753)
2a54512d72020-03-17[AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745)
a8b5fc74d2020-03-16[AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733)
e31e9ddd22020-03-14[AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376)
3bb60afc72020-03-13[AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619)
c0c5f11ad2020-03-12[AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598)
b7cdda1c62020-03-10[AIRFLOW-4438] Add Gzip compression to S3_hook (#7680)
42eef38212020-03-07[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)
9a94ab2462020-03-01[AIRFLOW-6962] Fix compeleted to completed (#7600)
1b38f6d9b2020-02-29[AIRFLOW-5908] Add download_file to S3 Hook (#6577)
3ea3e1a2b2020-02-26[AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443)
6eaa7e3b12020-02-25[AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574)
3320e432a2020-02-24[AIRFLOW-6817] Lazy-load ^{} to keep user-facing API untouched (#7517)
7d0e7122d2020-02-24[AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451)
4d03e33c12020-02-22[AIRFLOW-6817] remove imports from ^{}, replaced implicit imports with explicit imports, added entry to ^{} - squashed/rebased (#7456)
47a922b862020-02-21[AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474)
9cbd7de6d2020-02-18[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)
58c3542ed2020-02-12[AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375)
b7aa778b32020-02-10[AIRFLOW-6767] Correct name for default Athena workgroup (#7394)
9282185e62020-02-09[AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386)
94fccca972020-02-04[AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347)
f3ad5cf612020-02-03[AIRFLOW-4681] Make sensors module pylint compatible (#7309)
88e40c7142020-02-03[AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339)
a311d3d822020-02-03[AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341)
cb766b05b2020-02-03[AIRFLOW-XXXX] Fix Static Checks on CI (#7342)
97a429f9d2020-02-02[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)
7527eddc52020-02-02[AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336)
cf141506a2020-02-02[AIRFLOW-6708] Set unique logger names (#7330)
63aa3db882020-02-02[AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824)
af4157fde2020-02-02[AIRFLOW-6672] AWS DataSync - better logging of error message (#7288)
373c6aa4a2020-01-30[AIRFLOW-6682] Move GCP classes to providers package (#7295)
83c0378732020-01-30[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)
1988a97e82020-01-28[AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274)
ab10443e92020-01-28[AIRFLOW-6424] Added a operator to modify EMR cluster (#7213)
40246132a2020-01-28[AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270)
82c0e5aff2020-01-28[AIRFLOW-6655] Move AWS classes to providers (#7271)
599e4791c2020-01-18[AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146)
c319e81ca2020-01-17[AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178)
941a070572020-01-15[AIRFLOW-6570] Add dag tag for all example dag (#7176)
78d8fe6942020-01-08[AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811)
e0b0227252019-12-28[AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)
57da456852019-12-24[AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888)
cf647c27e2019-12-18[AIRFLOW-6038] AWS DataSync reworked (#6773)
7502cad282019-12-17[AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764)
c4c635df62019-12-17[AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678)
4fb498f872019-12-09[AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686)
a1e2f86352019-11-20[AIRFLOW-6021] Replace list literal with list constructor (#6617)
baae140842019-11-19[AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588)
504cfbac12019-11-18[AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539)
992f0e3ac2019-11-12AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512)
c015eb2f62019-11-10[AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502)
3d76fb4bf2019-11-09[AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518)

欢迎加入QQ群-->: 979659372 Python中文网_新手群

推荐PyPI第三方库


热门话题
java FirebaseInstanceId。getInstance()始终为空   linux Java执行文件错误   javaspringboot:如何使用Ajax在springboot和Thymeleaf中创建进度条?   java禁用在安卓上使用传单时启用setJavaScriptEnabled   java如何在主体中发布原始类型JSON数据?   消除JAVA While循环中的额外输出   如何在java中直接将基本数据类型分配给自定义类   java为什么addNode()方法返回编译错误“类型中的方法…不适用于参数…”,我该如何修复它?   java惰性合成可观察对象   eclipse Java Blackberry位图单击   java Android:AsyncTask对象[]无法在doInBackground中强制转换   java有没有办法重构或改进这段代码?   java如何使用系统以十六进制打印字节。出来普林顿?   多线程如何在我的java聊天室中调试“java.net.UnknownHostException”?   java如何从Google App Engine下载应用程序源文件   java如何在Spring Data Mongo的聚合$group中使用类似$dateToString   java IBM websphere application server未在MyEclipse8中启动。0