2

我对以下代码有疑问。

import urllib2
import csv
from bs4 import BeautifulSoup
soup = BeautifulSoup(urllib2.urlopen('http://www.ny.com/clubs/nightclubs/index.html').read())
clubs = []
trains = ["A","C","E","1","2","3","4","5","6","7","N","Q","R","L","B","D","F"]
for club in soup.find_all("dt"):
    clubD = {}
    clubD["name"] = club.b.get_text()
    clubD["address"] = club.i.get_text()
    text = club.dd.get_text()
    nIndex = text.find("(")
    if(text[nIndex+1]=="2"):
        clubD["number"] = text[nIndex:nIndex+15]
    sIndex = text.find("Subway")
    sIndexEnd = text.find(".",sIndex)
    if(text[sIndexEnd-1] == "W" or text[sIndexEnd -1] == "E"):
        sIndexEnd2 = text.find(".",sIndexEnd+1)
        clubD["Subway"] = text[sIndex:sIndexEnd2]
    else:
        clubD["Subway"] = text[sIndex:sIndexEnd]
    try:
        cool = clubD["number"]
    except (ValueError,KeyError):
        clubD["number"] = "N/A"
    clubs.append(clubD)
keys = [u"name", u"address",u"number",u"Subway"]
f = open('club.csv', 'wb')
dict_writer = csv.DictWriter(f, keys)
dict_writer.writerow([unicode(s).encode("utf-8") for s in clubs])

我收到错误 ValueError: dict contains fields not in fieldnames。我不明白这怎么可能。任何帮助都会很棒。我正在尝试将字典转换为 excel 文件。

4

1 回答 1

2

clubs是一个字典列表,而每个字典有四个字段:姓名、地址、号码和地铁。您将需要对每个字段进行编码:

# Instead of:
#dict_writer.writerow([unicode(s).encode("utf-8") for s in clubs])

# Do this:
for c in clubs:
    # Encode each field: name, address, ...
    for k in c.keys():
        c[k] = c[k].encode('utf-8').strip()

    # Write to file
    dict_writer.writerow(c)

更新

我查看了您的数据,其中一些字段以新行结尾\n,因此我更新了代码以同时编码和去除空格。

于 2013-06-05T03:05:49.977 回答