0

我在我的conf/nutch-site.xml

<property>
  <name>plugin.includes</name>
  <value>urlfilter-regex|protocol-(http|file)|parse-(text|html|pdf|msword)|in
dex-(basic|anchor|more)|query-(basic|site|url)|response-(json|xml)|summary-basic
|scoring-opic|urlnormalizer-(pass|regex|basic)</value>
  <description>Regular expression naming plugin directory names to
  include.  Any plugin not matching this expression is excluded.
  In any case you need at least include the nutch-extensionpoints plugin. By
  default Nutch includes crawling just HTML and plain text via HTTP,
  and basic indexing and search plugins. In order to use HTTPS please enable 
  protocol-httpclient, but be aware of possible intermittent problems with the 
  underlying commons-httpclient library.
  </description>
</property>

请注意解析器列表 - 只有文本、html、pdf 和 msword。但出于某种奇怪的原因,我刚刚在我的索引中发现了一些 application/x-javascript 文件。为什么会这样?它是否使用插件目录中的内容而忽略了我的plugin.includes?

4

1 回答 1

0

我使用 Nutch 1.1(不是trunk)来解析 rss 提要。我使用 parse-rss 插件。仅当我激活插件时才会解析提要。如果不是,它们将被忽略。所以要回答你的问题,是的,Nutch 应该只使用 plugin.includes 中定义的插件。

于 2010-11-15T14:55:03.713 回答