Python下载的表格式数据

Question

这是从表下载数据并在cmd上输出的代码。我想知道相同的数据是否可以像行和列一样下载到相同的表结构中？ 这就是我尝试过的

代码：

import urllib
import re
from urlparse import urlparse
from bs4 import BeautifulSoup as bs

urls = ["http://physics.iitd.ac.in/content/list-faculty-members", "http://www.iitkgp.ac.in/commdir3/list.php?division=3&deptcode=ME","http://www.iitkgp.ac.in/commdir3/list.php?division=3&deptcode=CE"]
i = 0


while i< len(urls):
    htmlfile = urllib.urlopen(urls[i])
    htmltext = htmlfile.read()
    soup = bs(htmltext)
    tables  = soup.find_all('table', attrs = {'border': '0' , 'width' : '100%' , 'cellpadding': '10'})
    head = soup.find_all('h2' , attrs = {'class' : 'title style3'})
    ree = tables.find_all('tr')
    hea = head.find_all('big').find_all('strong')
    datasets = []
    q = []
    s = []
    t = hea.get_text()
    q.append(t)

    for b in ree:
        x = [td.get_text() for td in b.find_all('td')]
        dataset = [strong.get_text() for strong in b.find('td').find('a').find_all('strong')]
        datasets.append(dataset)
        q.append(x) 
print q
i+=1

Answer 1

我想很多人会建议在处理表格数据时使用熊猫图书馆。对于结构良好的HTML，您可以盲目地使用pandas read\u HTML

import pandas as pd
tables = pd.read_html("http://physics.iitd.ac.in/content/list-faculty-members")
dataframe = tables[0]