0

当我尝试在 hdfs 中复制 3 个文件的目录时，出现以下错误

     hduser@saket-K53SM:/usr/local/hadoop$ bin/hadoop dfs -copyFromLocal /tmp/gutenberg /user/hduser/gutenberg
12/08/01 23:48:46 WARN hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/hduser/gutenberg/gutenberg/pg20417.txt could only be replicated to 0 nodes, instead of 1
12/08/01 23:48:46 WARN hdfs.DFSClient: Error Recovery for block null bad datanode[0] nodes == null
12/08/01 23:48:46 WARN hdfs.DFSClient: Could not get block locations. Source file "/user/hduser/gutenberg/gutenberg/pg20417.txt" - Aborting...
copyFromLocal: java.io.IOException: File /user/hduser/gutenberg/gutenberg/pg20417.txt could only be replicated to 0 nodes, instead of 1
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/hduser/gutenberg/gutenberg/pg20417.txt could only be replicated to 0 nodes, instead of 1

我的 fsck 输出是

hduser@saket-K53SM:/usr/local/hadoop$ bin/hadoop fsck -blocks
FSCK started by hduser from /127.0.0.1 for path / at Wed Aug 01 23:50:49 IST 2012
Status: HEALTHY
Total size: 0 B
Total dirs: 10
Total files:    0 (Files currently being written: 2)
Total blocks (validated):   0
Minimally replicated blocks:    0
Over-replicated blocks: 0
Under-replicated blocks:    0
Mis-replicated blocks:      0
Default replication factor: 1
Average block replication:  0.0
Corrupt blocks:     0
Missing replicas:       0
Number of data-nodes:       0
Number of racks:        0
FSCK ended at Wed Aug 01 23:50:49 IST 2012 in 3 milliseconds


The filesystem under path '/' is HEALTHY

此外，当我尝试格式化名称节点时，我收到以下错误

hduser@saket-K53SM:/usr/local/hadoop$ bin/hadoop namenode -format
12/08/01 23:53:07 INFO namenode.NameNode: STARTUP_MSG: 
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = saket-K53SM/127.0.1.1
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-   1.0 -r 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012

Re-format filesystem in /app/hadoop/tmp/dfs/name ? (Y or N) y
Format aborted in /app/hadoop/tmp/dfs/name
12/08/01 23:53:09 INFO namenode.NameNode: SHUTDOWN_MSG: 
SHUTDOWN_MSG: Shutting down NameNode at saket-K53SM/127.0.1.1

任何帮助，将不胜感激..

4

3 回答 3

6

我相信这是一个非常愚蠢的问题。输入“Y”而不是小写“y”（它应该是大写）

于 2012-09-21T11:32:02.597 回答
1

您是否尝试过：

  • 停止名称节点
  • 停止数据节点
  • 删除 /app/hadoop*
  • 格式化名称节点
  • 再次启动datanode和namenode
于 2012-11-13T07:40:18.540 回答
0

停止所有守护进程（ig stop-all.sh）后，删除保存 namenode 临时文件的数据目录。删除数据目录后，再次启动 hadoop 守护进程 ig start-all.sh。“数据”目录的路径是conf/core-site.xml中hadoop.tmp.dir属性的值。

我认为这将解决您的问题

于 2013-11-19T07:04:55.007 回答