如何对请求使用多线程处理?

2024-05-23 22:42:12 发布

您现在位置:Python中文网/ 问答频道 /正文

你好,我有一段使用Python的代码,它使用了requests模块:

import requests

url1 = "myurl1" # I do not remember exactly the exact url
reponse1 = requests.get(url1)
temperature1 = reponse1.json()["temperature"]

url2 = "myurl2" # I do not remember exactly the exact url
reponse2 = requests.get(url2)
temperature2 = reponse2.json()["temp"]

url3 = "myurl3" # I do not remember exactly the exact url
reponse3 = requests.get(url3)
temperature3 = reponse3.json()[0]

print(temperature1)
print(temperature2)
print(temperature3)

实际上我得告诉你这有点慢。。。你有办法提高我的代码速度吗?我想使用多线程,但我不知道如何使用它。。。你知道吗

非常感谢!你知道吗


Tags: the代码jsonurlgetnotrequestsdo
1条回答
网友
1楼 · 发布于 2024-05-23 22:42:12

试试Python executors

import requests
from concurrent.futures import ThreadPoolExecutor, as_completed
from multiprocessing import cpu_count

urls = ['/url1', '/url2', '/url3']
with ThreadPoolExecutor(max_workers=2*cpu_count()) as executor:
    future_to_url = {executor.submit(requests.get, url): url for url in urls}
    for future in as_completed(future_to_url):
        response = future.result()  # TODO: handle exceptions here
        url = future_to_url[future]
        # TODO: do something with that data

相关问题 更多 >