我在这里在 python 2.7.1 上使用 Beautiful Soup 3.2。
我最近一直在尝试做一些简单的工作，但这似乎相当棘手：
我执行以下操作：
temp=BeautifulSoup(urllib2.urlopen(urlList[1], None,15))
但是，我收到错误：
File "/home/foo/k/kat/BeautifulSoup.py", line 1519, in __init__
BeautifulStoneSoup.__init__(self, *args, **kwargs)
File "/home/foo/k/kat/BeautifulSoup.py", line 1144, in __init__
self._feed(isHTML=isHTML)
File "/home/foo/k/kat/BeautifulSoup.py", line 1186, in _feed
SGMLParser.feed(self, markup)
File "/usr/lib/python2.7/sgmllib.py", line 104, in feed
self.goahead(0)
File "/usr/lib/python2.7/sgmllib.py", line 143, in goahead
k = self.parse_endtag(i)
File "/usr/lib/python2.7/sgmllib.py", line 320, in parse_endtag
self.finish_endtag(tag)
File "/usr/lib/python2.7/sgmllib.py", line 358, in finish_endtag
method = getattr(self, 'end_' + tag)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xfa' in
position 4: ordinal not in range(128)
如果我再次运行相同的循环，有时，我也会得到：
File "/home/foo/k/kat/BeautifulSoup.py", line 1519, in __init__
BeautifulStoneSoup.__init__(self, *args, **kwargs)
File "/home/foo/k/kat/BeautifulSoup.py", line 1144, in
__init__
self._feed(isHTML=isHTML)
File "/home/foo/k/kat/BeautifulSoup.py", line 1186, in _feed
SGMLParser.feed(self, markup)
File "/usr/lib/python2.7/sgmllib.py", line 104, in feed
self.goahead(0)
File "/usr/lib/python2.7/sgmllib.py", line 143, in goahead
k = self.parse_endtag(i)
File "/usr/lib/python2.7/sgmllib.py", line 320, in parse_endtag
self.finish_endtag(tag)
File "/usr/lib/python2.7/sgmllib.py", line 358, in finish_endtag
method = getattr(self, 'end_' + tag)
UnicodeEncodeError: 'ascii' codec can't encode characters in position
4-5: ordinal not in range(128)
如何避免此错误？显然 sgmllib.py 有问题。
我尝试了 SOF 的一些解决方案：
*] 尝试soup = BeautifulSoup(page, fromEncoding=<encoding of the page>)
结果：剂量工作，同样的错误。
*] 尝试将我的 sgmllib.py 从 2.7.2 版本升级到我的 2.7.1 版本结果：剂量工作，同样的错误。
*] 尝试html = BeautifulSoup(page.encode('utf-8'))
结果：剂量工作，同样的错误。
我将不胜感激有关如何解决此编码错误的任何建议。