如何使用Pymysql/Python从第三方API向数据库插入数据?

2024-06-16 10:08:36 发布

您现在位置:Python中文网/ 问答频道 /正文

如何使用Pymysql/Python从第三方API向数据库插入实时数据

我正试图从第三方API请求数据

我们得到的API链接如下所示 获取/api/v4/dblines

如何使用Pymysql/Python从第三方API向数据库插入实时数据,使用requests、Pymysql和pandas? 我们必须插入2020.01.01的数据

下面是来自此示例链接的示例JSON数据: https://api.example.com/api/v4/dblines?a=ABC123&b=1min

    [
    1593649440000, start_time
    "2.9923453200",
    "2.9923453200",
    "2.0045299700",
    "2.0045299700",
    "2.2400009700",
    1593649499999, end_time
    "2.0010870500",
    2,
    "2.0300009700",
    "2.0001359600",
    "0"
    ],
    [
    1593649500000,
    "2.9923453297",
    "2.9923453297",
    "2.9923453297",
    "2.9923453297",
    "25.950000970",
    1593649559999,
    "2.1176054000",
    4,
    "25.950000970",
    "2.1176054000",
    "0"
    ],
    [
    1593649560000,
    "2.9923453297",
    "2.9923453297",
    "2.9923453297",
    "2.9923453297",
    "2.0000009718",
    1593649619999,
    "1.00000097",
    0,
    "1.00000097",
    "1.00000097",
    "0"
    ],

Tags: 数据httpsapi数据库json示例pandastime
1条回答
网友
1楼 · 发布于 2024-06-16 10:08:36

以下是一个例子:

from sqlalchemy import create_engine
import pandas as pd
import requests

# getting json using requests
# data = requests.get('https://api.example.com/api/v4/dblines?a=ABC123&b=1min').json()
# data example
data = [
    [
        1593649440000,
        "2.9923453200",
        "2.9923453200",
        "2.0045299700",
        "2.0045299700",
        "2.2400009700",
        1593649499999,
        "2.0010870500",
        2,
        "2.0300009700",
        "2.0001359600",
        "0"
    ],
    [
        1593649500000,
        "2.9923453297",
        "2.9923453297",
        "2.9923453297",
        "2.9923453297",
        "25.950000970",
        1593649559999,
        "2.1176054000",
        4,
        "25.950000970",
        "2.1176054000",
        "0"
    ]
]

# create df using json from API
df = pd.DataFrame(
    data,
    columns=[
        # change aliases to column names here...
        'start_time',
        'alias1',
        'alias2',
        'alias3',
        'alias4',
        'alias5',
        'end_time',
        'alias6',
        'alias7',
        'alias8',
        'alias9',
        'alias10',
    ]
)
# drop unnecessary columns, duplicates, processing df, blabla etc...
# and init db connection
engine = create_engine('mysql+pymysql://{user}:{pw}@localhost/{db}'
                       .format(user='db_user',
                               pw='db_password',
                               db='db_name'))
# insert df into db using connection 
# change if_exists if you need
df.to_sql(con=engine, name='table_name_here', if_exists='replace')

见评论。希望这有帮助

相关问题 更多 >