hadoop - 即使在 MRv1 上运行时，sqoop 也会尝试连接到纱线

Question

我有一个 cloudera 集群版本 5.3.x，并且在使用以下命令运行 sqoop 客户端时

sqoop import --connect jdbc:mysql://HOST/myapplication --username myuser --direct -table=mytable -m 1 --hive-import --append --hive-table myapplication.tableimp --target-dir /user/hive/warehouse/myapplication/tableimp

它在以下语句处循环。即使我们的集群上只有 MRv1，它似乎也在尝试连接到 yarn。

INFO client.RMProxy: Connecting to ResourceManager at node/<ipaddress>:8032
INFO ipc.Client: Retrying connect to server: node/<ipaddress>:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
INFO ipc.Client: Retrying connect to server: node/<ipaddress>:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

我尝试了以下内容，该内容记录在 cloudera 上，但仍然没有任何变化。

alternatives --set sqoop2-tomcat-conf /etc/sqoop2/tomcat-conf.mr1

我可能应该提一下，我在该 VM 上的 /etc/sqoop2 位置没有看到 tomcat-conf.mr1 文件。

Answer 1

hadoop-conf 指向纱线配置。使用以下命令将其更改为 mapreduce 配置修复了它。

[root@node01 bin]# alternatives --config hadoop-conf

There are 4 programs which provide 'hadoop-conf'.

  Selection    Command

-----------------------------------------------

*+ 1           /etc/hadoop/conf.cloudera.yarn

   2           /etc/hadoop/conf.cloudera.hdfs

   3           /etc/hadoop/conf.cloudera.mapreduce

   4           /opt/cloudera/parcels/CDH-5.1.3-1.cdh5.1.3.p0.12/etc/hadoop/conf.empty


Enter to keep the current selection[+], or type selection number: 3