0

我最近安装了 hadoop-2.4.0 和 hbase-0.95.18 编译

sudo mvn clean package assembly:assembly -DskipTests -Dhadoop.profile=2.4

使用以下 pom.xml 选项。

<protobuf.version>2.5.0</protobuf.version>

<id>hadoop-2.4</id>
  <activation>
    <property>
      <name>hadoop.profile</name>
      <value>2.4</value>
    </property>
  </activation>
  <properties>
    <hadoop.version>2.4.0</hadoop.version>
    <slf4j.version>1.7.5</slf4j.version>

这是我的 hbase-site.xml 信息。

<configuration>
   <property>
      <name>hbase.rootdir</name>
      <value>hdfs://big7:54310/hbase</value>
   </property>
   <property>
      <name>dfs.replication</name>
      <value>3</value>
   </property>
   <property>
      <name>hbase.cluster.distributed</name>
      <value>true</value>
   </property>
   <property>
      <name>hbase.zookeeper.quorum</name>
      <value>big11,big1,big4</value>
   </property>
   <property>
      <name>hbase.zookeeper.property.clientPort</name>
      <value>2222</value>
   </property>
   <property>
      <name>hbase.zookeeper.property.dataDir</name>
      <value>/home/hduser/hadoop/zookeeper</value>
   </property>
   <property>
      <name>hbase.cluster.distributed</name>
      <value>true</value>
   </property>
</configuration>

HMaster & Zookeepers 已成功启动,但 regionservers 未启动。我在主日志中收到以下错误。

2014 -05-09 16:11:59,030 INFO org.apache.hadoop.hbase.master.ServerManager: Registering server=big11,60020,1399632116991
2014 -05-09 16:11:59,038 INFO org.apache.hadoop.conf.Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
2014 -05-09 16:11:59,041 INFO org.apache.hadoop.hbase.master.ServerManager: Waiting for region servers count to settle; currently checked in 1, slept for 100 ms, expecting minimum of 1, maximum of 2147483647, timeout of 4500 ms, interval of 1500 ms.
2014 -05-09 16:11:59,058 **ERROR org.apache.hadoop.hbase.master.HMaster: Region server \00\00big11,60020,1399632116991 reported a fatal error**:
     **ABORTING region server big11,60020,1399632116991: Unhandled exception: Region server startup failed
     Cause:
     java.io.IOException: Region server startup failed**
        at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1279)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1136)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
        at java.lang.Thread.run(Thread.java:744)
     Caused by: java.lang.UnsupportedOperationException: **This is supposed to be overridden by subclasses.**
        at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
        at org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
        at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
        ... 2 more

2014 -05-09 16:11:59,768 INFO org.apache.hadoop.hbase.master.ServerManager: Registering server=big1,60020,1399632116879
2014 -05-09 16:11:59,777 ERROR org.apache.hadoop.hbase.master.HMaster: Region server \00\00big9,60020,1399632116855 reported a fatal error:
     ABORTING region server big9,60020,1399632116855: Unhandled exception: Region server startup failed
     Cause:
     java.io.IOException: Region server startup failed
        at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1279)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1136)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
        at java.lang.Thread.run(Thread.java:744)
     Caused by: java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
        at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
        at org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
        at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
        ... 2 more

有人可以帮我解决这个问题吗?

4

1 回答 1

0

有两个使用 2.4.0 编译的 .proto 文件

$HBASE_HOME/src/main/protobuf/ErrorHandling.proto $HBASE_HOME/src/main/protobuf/hbase.proto

由于您更改了 protobuf.version,您是否使用 protobuf 编译器版本 2.5.0 从 .proto 文件重新生成 .java 文件。这可能是问题之一。

您可以使用以下步骤执行此操作。

  1. 安装 protobuf-compiler 版本 2.5.0
  2. 在 $HBASE_HOME/src/main/protobuf 文件夹中运行以下命令 -

    $>protoc -I./ --java_out=src/main/java ErrorHandling.proto

    $>protoc -I./ --java_out=src/main/java hbase.proto

  3. 重新编译 hbase 并启动服务器。

您可以关注此处的讨论以了解更多信息。

于 2014-05-22T07:53:33.730 回答