7

我尝试使用客户端程序将一些数据写入 hbase

HBase @ Hadoop 在来自 Cloudera @ ubuntu 的预配置 VM 中运行。

客户端在托管 VM 的系统上运行，并直接在 VM 中运行客户端。

所以现在我想用vm外的客户端来访问vm上的服务器

我正在使用 NAT。为了能够访问在虚拟机上运行的 HBase Master、HUE 等服务器，我在虚拟框中配置了端口转发：在此处输入图像描述

因此，我可以访问 HBase Master 的概述站点，HUE..

为了在 vm 上的服务器上运行客户端，我创建了 hbase-site.xml 的内容：

<configuration>
    <property>
        <name>hbase.zookeeper.quorum</name>
        <value>localhost</value>
    </property>
    <property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>9997</value>
    </property>
    <property>
        <name>hbase.master</name>
        <value>localhost:9999</value>
    </property>
</configuration>

所以我希望转发有效：

运行客户端时日志中的错误消息如下所示：

11/09/07 17:48:00 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
11/09/07 17:48:00 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
11/09/07 17:48:01 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
11/09/07 17:48:01 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181
11/09/07 17:48:01 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.SocketException: Address family not supported by protocol family: connect
    at sun.nio.ch.Net.connect(Native Method)
    at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:500)
    at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1050)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1077)
11/09/07 17:48:03 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
11/09/07 17:48:04 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
11/09/07 17:48:04 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181
11/09/07 17:48:04 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.SocketException: Address family not supported by protocol family: connect
    at sun.nio.ch.Net.connect(Native Method)
    at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:500)
    at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1050)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1077)
11/09/07 17:48:05 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181

正确的连接日志（直接在 vm 上运行客户端时）如下所示：

11/09/07 09:05:29 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
11/09/07 09:05:29 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181
11/09/07 09:05:29 INFO zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
11/09/07 09:05:29 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x132449d36df0006, negotiated timeout = 40000

所以我现在只在第一个问题之前的日志行中看到连接 url 不正确，因为端口被正确转发，但 IP 仍然是 localhost 而不是端口转发设置中配置的 10.0.2.15：

Opening socket connection to server localhost/127.0.0.1:2181

我发现的唯一提示是禁用 IPV6 -> 在主机（win7）和 vm（Ubuntu）中禁用并检查端口 -> 它们被正确转发

有人有想法吗？

4

3 回答 3

5

只是为了给阅读本文的用户增加价值，这里是解决方案：

Could not resolve the DNS name of cloudera-vm

为了解决这个问题，我只是添加到 C:\Windows\System32\drivers\etc\hosts ：

192.168.56.101  cloudera-vm

因此，每当使用 cloudera-vm 时，它都会解析为适当的 IP。VM 现在以 Host-Only-Network 模式运行，并且现在分配到 192.168.56.101。所以不需要端口转发。

只是为了比较：

hbase-site.xml

<configuration>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>cloudera-vm</value>
  </property>
</configuration>

持久性.xml

<persistence
    xsi:schemaLocation="http://java.sun.com/xml/ns/persistence http://java.sun.com/xml/ns/persistence/persistence_1_0.xsd"
    version="1.0">

    <persistence-unit name="hbase-addressbook"
        transaction-type="RESOURCE_LOCAL">

        <properties>
            <property name="datanucleus.ConnectionURL" value="hbase:cloudera-vm" />
            <property name="datanucleus.ConnectionUserName" value="" />
            <property name="datanucleus.ConnectionPassword" value="" />
            <property name="datanucleus.autoCreateSchema" value="true" />
            <property name="datanucleus.validateTables" value="false" />
            <property name="datanucleus.Optimistic" value="false" />
            <property name="datanucleus.validateConstraints" value="false" />
        </properties>
    </persistence-unit>
</persistence>

之后我又遇到了另一个错误（尽管所有连接字符串都是正确的，但连接被拒绝）因此我研究了几天的原因。

解决方案是通过将以下内容附加到文件来禁用在 VM 上运行的 Ubuntu 的 IPV6：/etc/sysctl.conf

net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1

重新启动后，一切都连接并正常工作:)

于 2011-09-27T14:37:47.673 回答
0

我认为您可以在代码中清楚地设置配置，例如 HbaseConfiguration conf = HbaseConfiguration.create(); conf.set("hbase.zookeeper.quorum", "ubuntu1,ubuntu2"); ...也许可以帮助你..

于 2011-11-18T07:50:54.697 回答
0

你试过一个简单的：

<property name="connectionURL" value="hbase:master.standalone.hostname:60000"/>
于 2012-03-20T02:44:05.703 回答