我试着在S3上使用AWS胶水进行分区和扣合。但这种扣法不起作用。只有分区有效。我怎样才能用AWS胶水扣?你知道吗
datasink4 = glueContext.write_dynamic_frame.from_options(
frame = dropnullfields3,
connection_type = "s3",
connection_options = {"path": s3_output_full,
"partitionKeys": ["PARTITIONKEY"],
"bucketColumns": ["ROW_ID"],
"numberOfBuckets": 12},
format = "parquet",
transformation_ctx = "datasink4")
job.commit()
目前没有回答
相关问题 更多 >
编程相关推荐