1

我正在尝试使用在多个帖子中推荐的 MLStripper 类从电子邮件中删除 html 以获得纯文本。由于“@”符号,strip_tags 函数在尝试解析时遇到问题。我猜这个类不够强大,只能解析有效的 html 标签,关于如何修复以下内容以处理“@”或其他库以从文本中删除 html 的任何建议?我还需要删除 & 之类的东西。

Python:

from HTMLParser import HTMLParser

class MLStripper(HTMLParser):
            def __init__(self):
                 self.reset()
                 self.fed = []
            def handle_data(self, d):
                 self.fed.append(d)
            def get_data(self):
                 return ''.join(self.fed)

            def strip_tags(self, html):
                 s = MLStripper()
                 s.feed(html)
                 return s.get_data()

 ML = MLStripper()
 test = ML.strip_tags("<div><br>On Sep 27, 2012, at 4:11 PM, Mark Smith <marksmith@gmail.com> wrote</br></div>")
 print test

错误:

Traceback (most recent call last):
  File "IMAPReader.py", line 49, in <module>
    strippedText = ML.strip_tags("<marksmith@gmail.com>")
  File "IMAPReader.py", line 22, in strip_tags
    s.feed(html)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/HTMLParser.py", line 108, in feed
    self.goahead(0)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/HTMLParser.py", line 148, in goahead
    k = self.parse_starttag(i)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/HTMLParser.py", line 229, in parse_starttag
    endpos = self.check_for_whole_start_tag(i)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/HTMLParser.py", line 304, in check_for_whole_start_tag
    self.error("malformed start tag")
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/HTMLParser.py", line 115, in error
    raise HTMLParseError(message, self.getpos())
HTMLParser.HTMLParseError: malformed start tag, at line 1, column 9
4

2 回答 2

3

如果您希望获得无效标记,则不需要 HTML 解析器。看看 BeautifulSoup:

http://www.crummy.com/software/BeautifulSoup/

他们有一个很好的例子来做你想做的事:

http://www.crummy.com/software/BeautifulSoup/bs4/doc/

from bs4 import BeautifulSoup

html_doc = """
<html><head><title>The Dormouse's story</title></head>

<p class="title"><b>The Dormouse's story</b></p>

<p class="story">Once upon a time there were three little sisters; and their names were
<a href="http://example.com/elsie" class="sister" id="link1">Elsie</a>,
<a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
<a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
and they lived at the bottom of a well.</p>

<p class="story">...</p>
"""

soup = BeautifulSoup(html_doc)

print(soup.get_text())

返回...

# The Dormouse's story
#
# The Dormouse's story
#
# Once upon a time there were three little sisters; and their names were
# Elsie,
# Lacie and
# Tillie;
# and they lived at the bottom of a well.
#
# ...
于 2012-11-15T02:25:29.853 回答
0

你使用的是什么版本的 Python?我使用 Python 2.7.2 运行了您的代码,但遇到了与您相同的错误。后来我在一台装有Python 2.7.3的计算机上运行它,它运行良好。这很奇怪,所以我查了一下,发现一些文档说 Python 中包含的 HTML 解析器在以后的版本中变得更加宽松。尝试升级到 2.7.3,它应该可以工作。

于 2012-11-15T02:41:48.803 回答