我正在使用 solr-4.4.0 和 nutch-1.7。我是 solr 和 nutch 的新手。我正在尝试使用以下博客集成 solr 和 nutch::
http://www.building-blocks.com/thinking/building-a-search-engine-with-nutch-and-solr-in-10-minutes/
成功启动 solr::
manish@ubuntu:~$ cd /usr/local/solr/example/
manish@ubuntu:/usr/local/solr/example$ java -jar start.jar
以及成功建立索引的网址::
manish@ubuntu:/usr/local/nutch/bin/nutch crawl urls -dir crawl -depth 3 -topN 50
样本输出::
fetching http://www.tatvic.com/tatvic-excel-plugin-webinar (queue crawl delay=5000ms)
-activeThreads=10, spinWaiting=9, fetchQueues.totalSize=36
-activeThreads=10, spinWaiting=10, fetchQueues.totalSize=36
-activeThreads=10, spinWaiting=10, fetchQueues.totalSize=36
-activeThreads=10, spinWaiting=10, fetchQueues.totalSize=36
-activeThreads=10, spinWaiting=10, fetchQueues.totalSize=36
-activeThreads=10, spinWaiting=10, fetchQueues.totalSize=36
.
.
.
.
.
..
Parsed (1ms):http://www.tatvic.com/anomaly-detection/
Parsed (1ms):http://www.tatvic.com/blog/dynamic-funnel-in-google-analytics/
Parsed (1ms):http://www.tatvic.com/blog/google-analytics-custom-reports/
Parsed (0ms):http://www.tatvic.com/collaborative-filtering/
Parsed (1ms):http://www.tatvic.com/contact-thanks/
..
.
.
.
.
LinkDb: linkdb: crawl/linkdb
LinkDb: URL normalize: true
LinkDb: URL filter: true
LinkDb: internal links will be ignored.
LinkDb: adding segment: file:/usr/local/nutch/crawl/segments/20130909064920
LinkDb: adding segment: file:/usr/local/nutch/crawl/segments/20130909065449
LinkDb: adding segment: file:/usr/local/nutch/crawl/segments/20130909064936
LinkDb: adding segment: file:/usr/local/nutch/crawl/segments/20130909043135
LinkDb: adding segment: file:/usr/local/nutch/crawl/segments/20130909035154
LinkDb: merging with existing linkdb: crawl/linkdb
LinkDb: finished at 2013-09-09 07:01:53, elapsed: 00:00:04
crawl finished: crawl
但是,在发布到 solr 时,我得到了以下信息:
manish@ubuntu:/usr/local/nutch$ bin/nutch solrindex http://127.0.0.1:8983/solr/ crawl/crawldb -linkdb crawl/linkdb crawl/segments/*
Indexer: starting at 2013-09-09 07:05:05
Indexer: deleting gone documents: false
Indexer: URL filtering: false
Indexer: URL normalizing: false
No IndexWriters activated - check your configuration
Indexer: finished at 2013-09-09 07:05:12, elapsed: 00:00:07
它的真正含义是什么?它根本不发帖吗?
在浏览器中它没有显示任何内容::
http://127.0.0.1:8983/solr/select?q=tatvic
浏览器示例::
<response><lst name="responseHeader"><int name="status">0</int><int name="QTime">111</int><lst name="params"><str name="q">tatvic</str></lst></lst><result name="response" numFound="0" start="0"/></response>
我试了很多次!!
我认为这可能是一个问题。
你能帮我解决这个问题吗?