サンプルで動作確認１
/usr/local/hadoop/bin$mkdir input
/usr/local/hadoop/bin$mkdir output
/usr/local/hadoop/bin$ ./hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+'
Exception in thread "main" java.io.IOException: Error opening job jar: hadoop-*-examples.jar
at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
Caused by: java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:131)
at java.util.jar.JarFile.<init>(JarFile.java:150)
at java.util.jar.JarFile.<init>(JarFile.java:87)
at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
このコマンドを実行するときはoutputファイルを消す必要があった。
/usr/local/hadoop$ rm -r output/
/usr/local/hadoop$ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+'
10/05/08 00:11:42 INFO mapred.FileInputFormat: Total input paths to process : 2
java.io.IOException: Not a file: hdfs://localhost:54310/user/hadoop/input/conf
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:206)
at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:781)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249)
at org.apache.hadoop.examples.Grep.run(Grep.java:69)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.examples.Grep.main(Grep.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
このエラーは以下の２つのコマンドで対応する。
bin/hadoop dfs -rmr input
bin/hadoop dfs -put conf input
で再度実行
/usr/local/hadoop$ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+'
10/05/08 00:37:26 INFO mapred.FileInputFormat: Total input paths to process : 13
10/05/08 00:37:26 INFO mapred.JobClient: Running job: job_201005080023_0002
10/05/08 00:37:27 INFO mapred.JobClient: map 0% reduce 0%
10/05/08 00:37:35 INFO mapred.JobClient: map 15% reduce 0%
10/05/08 00:37:38 INFO mapred.JobClient: map 30% reduce 0%
10/05/08 00:37:41 INFO mapred.JobClient: map 46% reduce 0%
10/05/08 00:37:44 INFO mapred.JobClient: map 61% reduce 10%
10/05/08 00:37:47 INFO mapred.JobClient: map 76% reduce 10%
10/05/08 00:37:50 INFO mapred.JobClient: map 92% reduce 10%
10/05/08 00:37:53 INFO mapred.JobClient: map 100% reduce 20%
.....
10/05/08 00:38:29 INFO mapred.JobClient: Combine input records=0
10/05/08 00:38:29 INFO mapred.JobClient: Map output records=7
10/05/08 00:38:29 INFO mapred.JobClient: Reduce input records=7
動いた！！（Refer to: Hadoop Troubleshooting）
中身を見る
http://d.hatena.ne.jp/huchiyama1976/20080528/1211992793
参考サイト