1

有没有人能够在 1 台笔记本电脑上配置 2(或 3)节点 3 CDH 4.1 集群。

笔记本电脑通过 WiFi 连接到互联网,并且虚拟机(VirtualBox、CentOS7)被配置为使用桥接网络。每个虚拟机都有一个专用的 IP 地址,它们可以相互 ping 通,它们可以 ping 主机,它们可以连接到 Internet。

我使用这些命令安装了软件

systemctl disable firewalld.service
reboot
chmod 755 jdk-6u45-linux-x64-rpm.bin
./jdk-6u45-linux-x64-rpm.bin
wget http://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/cloudera-cdh4.repo
cp cloudera-cdh4.repo /etc/yum.repos.d/
rpm --import http://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/RPMGPG-KEY-cloudera
yum install hadoop-hdfs-namenode
yum install hadoop-hdfs-journalnode
yum install zookeeper-server
yum install hadoop-hdfs-zkfc
service zookeeper-server init --myid=1
yum install zookeeper-server
service zookeeper-server start

你可以看到我已经禁用了防火墙。但是在 zookeeper.log 我可以看到

2014-07-18 17:56:29,910 [myid:1] - WARN [WorkerSender[myid=1]:QuorumCnxManager@368] - Cannot open channel to 2 at election address nn2.abhishek.com/192.168.1.31:3888
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:354)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:327)
at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:393)
at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:662)
2014-07-18 17:56:29,911 [myid:1] - WARN [WorkerSender[myid=1]:QuorumCnxManager@368] - Cannot open channel to 3 at election address jt1.abhishek.com/192.168.1.32:3888
java.net.NoRouteToHostException: No route to host
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:354)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:327)
at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:393)
at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:662)

不知何故,我有一种感觉,CDH不能以这种方式安装,特别需要一个有路由器和局域网等的企业设置。

有没有人能够在一台笔记本电脑和 2 台虚拟机上安装 CDH 4.1?你能启动zookeeper服务器吗?

请帮帮我。

4

1 回答 1

3

我自己解决了这个问题。

我必须在所有虚拟机上执行以下操作。

systemctl disable firewalld.service
systemctl stop firewalld.service

我认为在其中一台机器上防火墙仍在运行。

解决此问题的一个好方法是从您尝试执行此操作的每台机器到所有其他机器

nc machine.domain.com 3888

如果这有效,则意味着流量可以流动。在我的情况下,ping 工作正常,但 nc 没有。

于 2014-07-21T22:11:59.323 回答