修复:Selenium Python中的延迟加载

2024-05-16 12:50:07 发布

您现在位置:Python中文网/ 问答频道 /正文

由于延迟加载元素,Python在可能的100个元素中只选择了18个元素,在页面加载时,只会加载18个元素,在滚动时,会上载新元素,删除以前加载的元素。我如何解决这个问题,以便它将所有100个元素存储在persons列表中,并单击其中的每个元素

DOM element structure of the page

d = 0
itr = 1
time.sleep(17)

while True:
    persons = browser.find_elements_by_xpath("//*[@class='i-edit mrs no-text-decoration ember-view']")
    print(len(persons))
    for i, person in zip(names, persons):
        time.sleep(4) 
        persons = browser.find_elements_by_xpath("//*[@class='i-edit mrs no-text-decoration ember-view']")
        if d >= len(persons):
            break
        i = names[d]
        person = persons[d]
        browser.execute_script("arguments[0].scrollIntoView(true);", person)
        time.sleep(3) 
        person.click()

Tags: notextbrowser元素bytimesleepelements
1条回答
网友
1楼 · 发布于 2024-05-16 12:50:07

单击页面上的所有元素,其中新元素在向下滚动后加载,旧元素消失

while True:
    # Get screen height upon page loading for the first time 
    last_height = browser.execute_script("return document.body.scrollHeight")

    #Get the list of elements 
    persons = browser.find_elements_by_xpath("//*[@class='i-edit mrs no-text-decoration ember-view']")

    # Lopp through all elements and click on them
    for i in range (1,len(persons)+1):
        # As after every click page will be reloaded, getting fresh reference to element every time , so that wont get stale element exception
        linkXpath = "(//*[@class='i-edit mrs no-text-decoration ember-view'])["+str(i)+"]"
        WebDriverWait(browser, 30).until(EC.element_to_be_clickable((By.XPATH, linkXpath ))).click()
    # Scroll down to bottom
    browser.execute_script("window.scrollTo(0, document.body.scrollHeight);")
    time.sleep(2)

    #Get new height of screen
    new_height = browser.execute_script("return document.body.scrollHeight")
    if new_height == last_height:
        break
    last_height = new_height

相关问题 更多 >