我发现自己经常需要欧盟统计局的经济统计信息,以便训练和测试推理模型
我尝试使用请求和美化组自动化流程
headers = {
'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36',
'Accept': '*/*'
}
page = requests.get('https://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=sts_inpr_m&lang=en', headers=headers)
return BeautifulSoup(page.text, 'html.parser')
我得到的答复是:
<html>
<head></head>
<body>
<script type='text/javascript' language='JavaScript' src='https://appsso.eurostat.ec.europa.eu/nui/js/jquery-1.3.2.js'></script>
<script type='text/javascript' language='JavaScript' src='https://appsso.eurostat.ec.europa.eu/nui/js/noMultipleWindows.js?d=1594493775728'></script>
<form id='firepost' method='POST' action='https://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=sts_inpr_m&lang=en&fbclid=IwAR0wiAQfEomg6H-OfRlAgbLI5laWbqXr0W5QjeT89I_MOvaQiQUIDEx5XBg'>
<input type='hidden' name='dataset' value="sts_inpr_m"/>
<input type='hidden' name='fbclid' value="IwAR0wiAQfEomg6H-OfRlAgbLI5laWbqXr0W5QjeT89I_MOvaQiQUIDEx5XBg"/>
<input type='hidden' name='lang' value="en"/>
</form>
<form id='errorForm' method='POST' action='https://appsso.eurostat.ec.europa.eu/nui/onewindowpersession.do'>
</form>
<script type='text/javascript'>
blockOrAllowProceed();
</script>
</body>
</html>
我如何(如果可能的话)使BeautifulSoup从指定位置获取内容
指定的url不是get请求。这是一个带有json主体的post请求,如下面的代码所示
输出:
相关问题 更多 >
编程相关推荐