使用Python BeautifulSoup查找页数

Question

我想从steam页面中提取总页数（在本例中为11）。我相信下面的代码应该可以工作（返回11），但它返回的是一个空列表。就像它找不到paged_items_paging_pagelink类。在

import requests
import re
from bs4 import BeautifulSoup
r = requests.get('http://store.steampowered.com/tags/en-us/RPG/')
c = r.content
soup = BeautifulSoup(c, 'html.parser')


total_pages = soup.find_all("span",{"class":"paged_items_paging_pagelink"})[-1].text

Answer 1

无需使用BeautifulSoup的另一种更快的方法：

import requests

url = "http://store.steampowered.com/contenthub/querypaginated/tags/NewReleases/render/?query=&start=20&count=20&cc=US&l=english&no_violence=0&no_sex=0&v=4&tag=RPG" # This returns your query in json format
r = requests.get(url)

print(round(r.json()['total_count'] / 20)) # total_count = number of records, 20 = number of pages shown

11