擅长:python、mysql、java
<p>页面正在使用java脚本创建您想要的链接,您无法刮取该链接,您需要复制页面请求,在这种情况下,页面正在发送post请求:</p>
<pre><code>Request URL: https://prod-catalog-product-api.dickssportinggoods.com/v1/search
Request Method: POST
Status Code: 200 OK
Remote Address: [2600:1400:d:696::25db]:443
Referrer Policy: no-referrer-when-downgrade
</code></pre>
<p>使用浏览器中的inspect element工具检查请求标头,以模拟post请求</p>
<p>这是发送post请求的url:</p>
<pre><code>https://prod-catalog-product-api.dickssportinggoods.com/v1/search
</code></pre>
<p>这是浏览器发送的帖子信息</p>
<pre><code>{selectedCategory: "12301_1714863", selectedStore: "1406", selectedSort: 1,…}
isFamilyPage: true
pageNumber: 0
pageSize: 48
searchTypes: []
selectedCategory: "12301_1714863"
selectedFilters: {X_BRAND: ["New Balance"]} #< - this is the info that you want to get
selectedSort: 1
selectedStore: "1406"
storeId: 15108
totalCount: 3360
</code></pre>
<p>页面可能还需要标题,因此请确保模拟浏览器发送的请求</p>