上传Mydumper目录到S3。
mydumper2s3的Python项目详细描述
我的翻斗车到S3
一个可以上传mydumper转储文件到s3bucket的工具。在
即使在mydumper运行时，它也可以工作，对于mydumper打开的文件，mydumper2s3
然后等待我的文件上传程序关闭。--delete-after-upload
选项使您可以备份MySQL而不必将所有数据转储到
本地磁盘。在
它是这样工作的：
+-----------+
| mydumper |
+-----+-----+
|
|
v
+-----+------+ upload +-------------+ +------+
| local disk +----------> mydumper2s3 +------> s3 |
| <----------+ | |bucket|
+------------+ delete +-------------+ +------+
after
upload
安装
^{pr2}$使用
检查帮助：
$ mydumper2s3 --help
Usage: mydumper2s3.py [OPTIONS]
mydumper2s3: upload mydumper dumped files to s3 bucket. It works even
while mydumper is running!
Options:
-a, --access_key TEXT S3 access_key
-s, --secret_key TEXT S3 secret_key
-d, --domain TEXT S3 domain
-b, --bucket TEXT S3 bucket, if not spcified, a new bucket
named by directory will be created
-l, --path TEXT
-i, --check-interval INTEGER
--ssl / --no-ssl
-t, --upload-thread INTEGER thread numbers used to upload to s3
--delete-after-upload / --no-delete-after-upload
if set to True, files will be deleted in
local space after uploading.
--help Show this message and exit.
示例
上传文件到S3（如果mydumper正在运行，您仍然可以使用这个命令， mydumper2s3将搜索mydumper进程pid并监视由打开的文件 我的翻斗车。）：
$ mydumper2s3 --domain 127.0.0.1:9000 \
--bucket test1 \
--path ~/Downloads/target \
--access_key AKIAIOSFODNN7EXAMPLE \
--secret_key wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY \
--upload-thread=10
138 files in directory, 0 dumping, 0 uploading, 138 uploaded.
138 files successfully uploaded.
您可以使用以下命令检查备份（在安装mydumper2s3之后可以在$PATH中找到）：
$ verify-dump --domain 127.0.0.1:9000 \
--bucket test1 \
--path ~/Downloads/target \
--access_key AKIAIOSFODNN7EXAMPLE \
--secret_key wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
All files are exist both on local and on S3, file name check pass...
start verifying file's md5, file count: 138.
(1/138) verifying metadata...pass
(2/138) verifying test-schema-create.sql...pass
(3/138) verifying test.foo_event-schema.sql...pass
(4/138) verifying test.foo_event_alarms-schema.sql...pass
(5/138) verifying test.foo_list-schema.sql...pass
…
发展
在本地运行monio
docker run -p 9000:9000 \
-e "MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" \
-e "MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" \
minio/minio server /data
- 项目
标签：
欢迎加入QQ群-->： 979659372
