循环遍历刮取的数据并输出结果

Question

我正试图通过BBC足球结果网站获取球队、投篮、进球、卡片和事件。我目前有3个团队的数据传递到URL中

我用Python编写脚本，并使用Beautiful soupbs4包。将结果输出到屏幕时，将打印第一组、第一组和第二组，然后打印第一组、第二组和第三组。所以一队实际上被打印了三次，而我只想得到三支队伍一次

一旦我解决了这个问题，我将把结果写入文件。我将团队数据添加到数据框中，然后添加到列表中（我不确定这是否是最好的方法）。 我肯定if与for循环有关，但我不确定如何解决这个问题。 代码：

from bs4 import BeautifulSoup
import urllib2
import pandas as pd


out_list = []
for numb in('EFBO839787', 'EFBO839786', 'EFBO815155'):

url = 'http://www.bbc.co.uk/sport/football/result/partial/' + numb + '?teamview=false'
teams_list = []
inner_page = urllib2.urlopen(url).read()
soupb = BeautifulSoup(inner_page, 'lxml')

for report in soupb.find_all('td', 'match-details'):
            home_tag = report.find('span', class_='team-home')
            home_team = home_tag and ''.join(home_tag.stripped_strings)

            score_tag = report.find('span', class_='score')
            score = score_tag and ''.join(score_tag.stripped_strings)

            shots_tag = report.find('span', class_='shots-on-target')
            shots = shots_tag and ''.join(shots_tag.stripped_strings)

            away_tag = report.find('span', class_='team-away')
            away_team = away_tag and ''.join(away_tag.stripped_strings)

            df = pd.DataFrame({'away_team' : [away_team], 'home_team' : [home_team], 'score' : [score],  })
            out_list.append(df)

for shots in soupb.find_all('td', class_='shots'):

              home_shots_tag = shots.find('span',class_='goal-count-home')
              home_shots = home_shots_tag and ''.join(home_shots_tag.stripped_strings)

              away_shots_tag = shots.find('span',class_='goal-count-away')
              away_shots = away_shots_tag and ''.join(away_shots_tag.stripped_strings)

              dfb = pd.DataFrame({'home_shots': [home_shots], 'away_shots' : [away_shots] })
              out_list.append(dfb)

for incidents in soupb.find("table", class_="incidents-table").find("tbody").find_all("tr"):

                   home_inc_tag = incidents.find("td", class_="incident-player-home")
                   home_inc = home_inc_tag and ''.join(home_inc_tag.stripped_strings)

                   type_inc_goal_tag = incidents.find("td", "span", class_="incident-type goal")
                   type_inc_goal = type_inc_goal_tag and ''.join(type_inc_goal_tag.stripped_strings)

                   type_inc_tag = incidents.find("td", class_="incident-type")
                   type_inc = type_inc_tag and ''.join(type_inc_tag.stripped_strings)

                   time_inc_tag = incidents.find('td', class_='incident-time')
                   time_inc = time_inc_tag and ''.join(time_inc_tag.stripped_strings)

                   away_inc_tag = incidents.find('td', class_='incident-player-away')
                   away_inc = away_inc_tag and ''.join(away_inc_tag.stripped_strings)

                   df_incidents = pd.DataFrame({'home_player' : [home_inc],'event_type' : [type_inc_goal],'event_time': [time_inc],'away_player' : [away_inc]})

                   out_list.append(df_incidents)


print "end"

print out_list

我不熟悉python和堆栈溢出，任何关于设置问题格式的建议都很有用

提前谢谢

Answer 1

这看起来像是一个打印问题，您在哪个缩进级别打印列表

它应该是零缩进，一直到代码的左边

或者，您希望将_列表移出到最顶层的for循环中，以便在每次迭代后重新分配它

Answer 2

这3个for循环应该在主for循环中

out_list = []
for numb in('EFBO839787', 'EFBO839786', 'EFBO815155'):
  url = 'http://www.bbc.co.uk/sport/football/result/partial/' + numb + '?teamview=false'
  teams_list = []
  inner_page = urllib.request.urlopen(url).read()
  soupb = BeautifulSoup(inner_page, 'lxml')

  for report in soupb.find_all('td', 'match-details'):
              # your code as it is

  for shots in soupb.find_all('td', class_='shots'):
              # your code as it is

  for incidents in soupb.find("table", class_="incidents-table").find("tbody").find_all("tr"):
              # your code as it is

它工作得很好——只出现一次团队

下面是第一个for循环的输出：

[{'score': ['1-3'], 'away_team': ['Man City'], 'home_team': ['Dynamo Kiev']}, 
{'score': ['1-0'], 'away_team': ['Zenit St P'], 'home_team': ['Benfica']}, 
{'score': ['1-2'], 'away_team': ['Boston United'], 'home_team': ['Bradford Park Avenue']}]