0

我们正在尝试在带有 Vagrant 的 4 节点 CentOS 6 集群上建立 Zeppelin 的沙箱/评估实例,并且在构建过程中存在一些依赖关系问题。这是我们正在运行的高级脚本。

(已尝试将其作为特权帐户和用户运行,结果相同。)

重新创建步骤

  • 从二进制安装 Hadoop 2.7.0
  • 从二进制安装 Spark 1.4.0
  • 从二进制安装 Maven 3.3.3
  • 运行以下命令:

    curl --silent --location  https://rpm.nodesource.com/setup | bash -
    yum install -y nodejs
    git config --global url."https://".insteadOf git://
    git clone https://github.com/apache/incubator-zeppelin.git
    cd incubator-zeppelin
    npm update -g npm
    npm install -g grunt-cli
    npm install -g grunt 
    npm install -g bower
    mvn clean package -Pspark-1.4 -Dhadoop.version=2.7.0 -Phadoop-2.6 -DskipTests
    

堆栈跟踪

这是我们在构建 zeppelin-web 步骤时收到的堆栈跟踪的示例:

==> node1: Downloaded: https://repo.maven.apache.org/maven2/com/google/guava/guava/10.0.1/guava-10.0.1.jar (1467 KB at 154.5 KB/sec)
==> node1: [INFO] Installing node version v0.10.18
==> node1: [INFO] Creating temporary directory /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Downloading Node.js from http://nodejs.org/dist/v0.10.18/node-v0.10.18-linux-x64.tar.gz to /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz
==> node1: [INFO] No proxy was configured, downloading directly
==> node1: [INFO] Extracting Node.js files in node_tmp
==> node1: [INFO] Unpacking /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz into /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Moving node binary to /home/vagrant/incubator-zeppelin/zeppelin-web/node/node
==> node1: [INFO] Deleting temporary directory /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Installed node locally.
==> node1: 
==> node1: [INFO] Installing npm version 1.3.8
==> node1: [INFO] Downloading NPM from http://registry.npmjs.org/npm/-/npm-1.3.8.tgz to /home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz
==> node1: [INFO] No proxy was configured, downloading directly
==> node1: [INFO] Extracting NPM files in node/
==> node1: [INFO] Unpacking /home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz into /home/vagrant/incubator-zeppelin/zeppelin-web/node
==> node1: [INFO] Installed NPM locally.
==> node1: [INFO] 
==> node1: [INFO] --- frontend-maven-plugin:0.0.23:npm (npm install) @ zeppelin-web ---
==> node1: [INFO] Running 'npm install --color=false' in /home/vagrant/incubator-zeppelin/zeppelin-web
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-angular-templates
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-dom-munger
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-autoprefixer
==> node1: [ERROR] npm http GET https://registry.npmjs.org/bower
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-concurrent
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-connect
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-clean
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-concat
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-copy
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-cssmin
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-htmlmin
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-jshint
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-uglify

...

它会这样持续一段时间,然后整个构建失败。

TL;博士

在先决条件方面是否缺少某些东西,或者在文档中没有的 CentOS 6 上构建它是否有一些技巧?:) 此外,这已发布到 Zeppelin 用户委员会,因此也可以在那里/代替回答。

4

2 回答 2

2

能够使用上述步骤重现错误。查看此链接后: 链接

我能够使用以下方法成功构建:

mvn clean install -DskipTests

希望你觉得这很有帮助。

于 2015-07-07T17:56:18.110 回答
1

我的问题的解决方案是以非 root 用户身份运行以下命令:

sudo env "PATH=$PATH" mvn clean install -Pspark-1.4 -Pspark.version=1.4.0 -Phadoop.version=2.7.0 -DskipTests
sudo env "PATH=$PATH" mvn clean install -Pspark-1.4 -Pspark.version=1.4.0 -Phadoop.version=2.7.0 -DskipTests -rf :zeppelin-web
于 2015-07-08T21:14:41.777 回答