3

我已经使用pytextrank来提取关键字。我使用以下命令安装了 pytextrank 和 spacy。

pip install pytextrank
pip install -U spacy
python -m spacy download en

这是我的代码

import pytextrank
import sys

path_stage0 = jsonPath
path_stage1 = "data/json/temp/o1.json"

with open(path_stage1, 'w') as f:
    for graf in pytextrank.parse_doc(pytextrank.json_iter(path_stage0)):
        f.write("%s\n" % pytextrank.pretty_print(graf._asdict()))
        # to view output in this notebook
        print(pytextrank.pretty_print(graf))

当我尝试执行此操作时出现以下错误

ValueError                                Traceback (most recent call last)
<ipython-input-12-07819fc6acea> in <module>()
  6 
  7 with open(path_stage1, 'w') as f:
  ----> 8     for graf in 
  pytextrank.parse_doc(pytextrank.json_iter(path_stage0)):
  9         f.write("%s\n" % pytextrank.pretty_print(graf._asdict()))
 10         # to view output in this notebook

 /home/sameera/anaconda2/lib/python2.7/site-
 packages/pytextrank/pytextrank.pyc in parse_doc(json_iter)
259                 print("graf_text:", graf_text)
260 
--> 261             grafs, new_base_idx = parse_graf(meta["id"], graf_text, base_idx)
262             base_idx = new_base_idx
263 

/home/sameera/anaconda2/lib/python2.7/site-packages/pytextrank/pytextrank.pyc in parse_graf(doc_id, graf_text, base_idx, spacy_nlp)
193     doc = spacy_nlp(graf_text, parse=True)
194 
--> 195     for span in doc.sents:
196         graf = []
197         digest = hashlib.sha1()

/home/sameera/anaconda2/lib/python2.7/site-packages/spacy/tokens/doc.pyx in __get__ (spacy/tokens/doc.cpp:9664)()
432 
433             if not self.is_parsed:
--> 434                 raise ValueError(
435                     "sentence boundary detection requires the dependency parse, which "
436                     "requires data to be installed. If you haven't done so, run: "

ValueError: sentence boundary detection requires the dependency parse, which 
requires data to be installed. If you haven't done so, run: 
python -m spacy download en
to install the data

我正在使用 python 2.7、anaconda 4.3、jupyter notebook 和 ubuntu 14.04

4

2 回答 2

2

这可能只是您将代码复制到 StackOverflow 的方式的错误，但如果不是：

确保缩进“with”语句下面的所有内容，包括 for 循环。

基本上：

with open(path_stage1, 'w') as f:
    for graf in pytextrank.parse_doc(pytextrank.json_iter(path_stage0)):
        f.write("%s\n" % pytextrank.pretty_print(graf._asdict()))
        print(pytextrank.pretty_print(graf))
于 2017-07-18T23:42:08.263 回答
1

最好使用包requirements.txt中的pytextrank代替pip install -U spacy-- 因为spaCy它正在迅速发展并且-U将安装最新版本。这些更新并不总是向后兼容。

此外，请随时在 GitHub 存储库上发布问题pytextrank：https ://github.com/ceteri/pytextrank/issues

很高兴听到使用情况:)

于 2017-09-26T16:26:52.660 回答