-1

我正在使用 Daniel Rodriguez 的稍微编辑过的代码。我正在尝试获取 2014 年以来的所有 NBA 盒子得分数据。此代码有两个先前部分：第一个获取所有球队名称，第二个获取具有 ESPN 比赛 ID、日期、主队的球队的所有比赛，主场比分，客场球队和客场比分。这两个部分工作得很好。

然后我尝试运行从游戏 ID 中获取游戏的所有 boxscore 数据的部分。它适用于大部分游戏，然后几乎随机停止游戏并给出错误：

AttributeError：“NoneType”对象没有属性“find_all”

我说随机是因为我一遍又一遍地运行相同的代码，并且它永远不会停止在相同的盒子分数上。它每次都会在不同的盒子分数上出错。

这是代码（**行是错误发生的地方）：

import numpy as np
import pandas as pd
import requests
import time
from bs4 import BeautifulSoup
import os
os.chdir('C:\Users\steven2r\Documents\Python')

games = pd.read_csv('games.csv').set_index('id')
BASE_URL = 'http://espn.go.com/nba/boxscore?gameId={0}'

request = requests.get(BASE_URL.format(games.index[0]))

table = BeautifulSoup(request.text).find('table', class_='mod-data')
heads = table.find_all('thead')
headers = heads[0].find_all('tr')[1].find_all('th')[1:]
headers = [th.text for th in headers]
columns = ['id', 'team', 'player'] + headers
bad_downloads = []

players = pd.DataFrame(columns=columns)

def get_players(players, team_name):
    array = np.zeros((len(players), len(headers)+1), dtype=object)
    array[:] = np.nan
    for i, player in enumerate(players):
        cols = player.find_all('td')
        array[i, 0] = cols[0].text.split(',')[0]
        for j in range(1, len(headers) + 1):
            if not cols[1].text.startswith('DNP'):
                array[i, j] = cols[j].text

    frame = pd.DataFrame(columns=columns)
    for x in array:
        line = np.concatenate(([index, team_name], x)).reshape(1,len(columns))
        new = pd.DataFrame(line, columns=frame.columns)
        frame = frame.append(new)
    return frame

for index, row in games.iterrows():
    print(index)
    request = requests.get(BASE_URL.format(index))
    table = BeautifulSoup(request.text).find('table', class_='mod-data')

    if table == []:
        print index, 'bad'
        bad_downloads.append(index)
    else:
        heads = table.find_all('thead')
        bodies = table.find_all('tbody')

        team_1 = heads[0].th.text
        team_1_players = bodies[0].find_all('tr') + bodies[1].find_all('tr')
        team_1_players = get_players(team_1_players, team_1)
        players = players.append(team_1_players)

        team_2 = heads[3].th.text
        team_2_players = bodies[3].find_all('tr') + bodies[4].find_all('tr')
        team_2_players = get_players(team_2_players, team_2)
        players = players.append(team_2_players)

players = players.set_index('id')
print(players)
players.to_csv('players.csv')

print bad_downloads
4

1 回答 1

0

请参阅使用 BeautifulSoup 解析 NBA Boxscore 数据时出现的问题 BeautifulSoup 似乎与 ESPN 不完全兼容。上面的链接提供了另一种解决方案。

于 2015-02-12T20:03:01.470 回答