zoukankan      html  css  js  c++  java
  • nutch1.9 + solr4.72

        solr.server.url : URL of the SOLR instance (mandatory)
        solr.commit.size : buffer size when sending to SOLR (default 1000)
        solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)
        solr.auth : use authentication (default false)
        solr.auth.username : use authentication (default false)
        solr.auth : username for authentication
        solr.auth.password : password for authentication
    
    
    Indexer: java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
        at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:114)
        at org.apache.nutch.indexer.IndexingJob.run(IndexingJob.java:176)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.indexer.IndexingJob.main(IndexingJob.java:186)

    解决办法:

    找到 $NUTCH_HOME/conf/nutch-default.xml 里面的

      <value>/home/hadoop/nutch-1.9/plugins</value>  是我的nutch1.9 插件路径根据自己目录修改。
    <!-- plugin properties -->
    
    <property>
      <name>plugin.folders</name>
      <value>/home/hadoop/nutch-1.9/plugins</value>
      <description>Directories where nutch plugins are located.  Each
      element may be a relative or absolute path.  If absolute, it is used
      as is.  If relative, it is searched for on the classpath.</description>
    </property>

    solr日志提示:

    INFO  - 2014-11-07 17:01:39.848; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /data2/solr-4.7.2/example/solr/collection1/,
    dataDir=/data2/solr-4.7.2/example/solr/collection1/data/ INFO - 2014-11-07 17:01:39.850; org.apache.solr.core.JmxMonitoredMap; No JMX servers found, not exposing Solr information with JMX. INFO - 2014-11-07 17:01:39.855; org.apache.solr.core.SolrCore; [collection1] Added SolrEventListener
    for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]} INFO - 2014-11-07 17:01:39.856; org.apache.solr.core.SolrCore; [collection1] Added SolrEventListener
    for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}

    又遇到另一个错误

    Active IndexWriters :
    SOLRIndexWriter
        solr.server.url : URL of the SOLR instance (mandatory)
        solr.commit.size : buffer size when sending to SOLR (default 1000)
        solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)
        solr.auth : use authentication (default false)
        solr.auth.username : use authentication (default false)
        solr.auth : username for authentication
        solr.auth.password : password for authentication
    
    
    Indexer: java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
        at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:114)
        at org.apache.nutch.indexer.IndexingJob.run(IndexingJob.java:176)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.indexer.IndexingJob.main(IndexingJob.java:186
  • 相关阅读:
    Windows7如何让快速启动栏的资源管理器默认打开我的电脑(计算机)
    [转]C# Invoke和BeginInvoke的区别
    [转]RAID0、RAID1、RAID0+1、RAID5原理介绍
    【引用】Dashboard设计思路
    [Resolution]Your search cannot be completed because this site is not assigned to an indexer
    A Brief Introduction to Boolean Algebra(布尔代数简介)
    [转]从头开始安装Eclipse和VE
    [转]领导者如何问更好的问题
    如何使用花生壳(www.oray.com)实现动态域名映射(DDNS)
    如何手动删除Windows服务
  • 原文地址:https://www.cnblogs.com/zhanggl/p/4081857.html
Copyright © 2011-2022 走看看