0

我正在尝试在 HDInsights 上学习 Hadoop 版本 1.1.0。我按照分步说明在 Hadoop 命令行上运行命令。我首先编译了java代码，然后创建了一个jar文件，然后执行了map reduce命令。但是当我运行 mapreduce 命令时，它给了我下面的错误。有人可以帮助我理解错误的含义以及我需要做些什么来纠正它吗？ 

c:\hadoop-training\mrdcache>hadoop jar DCache.jar DCache mrdcache/input/nyse mrdcache/output

13/08/08 23:29:01 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/08/08 23:29:01 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:8020/hadoop/hdfs/tmp/mapred/staging/Ramya/.staging/job_201308082321_0001
13/08/08 23:29:01 ERROR security.UserGroupInformation: PriviledgedActionException as:myusername cause:java.io.FileNotFoundException: File does not exist: mrdcache/output Exception in thread "main" java.io.FileNotFoundException: File does not exist: mrdcache/output
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:518)
    at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:750)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
    at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
    at DCache.main(Dcache.java:199)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

感谢任何帮助！谢谢，拉米亚

4

1 回答 1

0

文件在哪里？你应该像这样使用 ASV：hadoop jar C:\Tutorials\log4jMapReduce.jar log4jMapReduce asv:///sample.log asv:///Tutorials/output

http://www.windowsazure.com/en-us/manage/services/hdinsight/using-mapreduce-with-hdinsight/

于 2013-08-21T07:18:21.127 回答