Changes between Version 8 and Version 9 of shunfa/2010/0524_NutchEZ_InstallTest

Timestamp:

Jun 10, 2010, 5:02:18 PM (15 years ago)

Author:

shunfa

Comment:

--

shunfa/2010/0524_NutchEZ_InstallTest

@@ -28 +28 @@
 == 執行 ==
 
-=== 上傳urls ===
- * bin/hadoop dfs -put urls urls
+=== 2010/06/10 ===
 {{{
-log4j:ERROR setFile(null,true) call failed.
-java.io.FileNotFoundException: /tmp/NutchEZ/logs/hadoop.log (Permission denied)
-...something message...
-log4j:ERROR Either File or DatePattern options are not set for appender [DRFA].
-put: org.apache.hadoop.security.AccessControlException: Permission denied: user=nutchuser, access=WRITE, inode="":root:supergroup:rwxr-xr-x
+10/06/10 16:58:42 INFO mapred.JobClient: Task Id : attempt_201006091555_0003_r_000000_0, Status : FAILED
+Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
+10/06/10 16:58:53 INFO mapred.JobClient: Task Id : attempt_201006091555_0003_r_000000_1, Status : FAILED
+Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
+10/06/10 16:59:05 INFO mapred.JobClient: Task Id : attempt_201006091555_0003_r_000000_2, Status : FAILED
+Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
+Exception in thread "main" java.io.IOException: Job failed!
+        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
+        at org.apache.nutch.crawl.Generator.generate(Generator.java:472)
+        at org.apache.nutch.crawl.Generator.generate(Generator.java:409)
+        at org.apache.nutch.crawl.Crawl.main(Crawl.java:116)
+nutch crawl is error
 }}}
- * 暫時切換至root測試
-
-=== 爬網 ===
- * bin/nutch crawl urls -dir search -threads 2 -depth 3 -topN 100000
-
-== 待完成事項 ==
- * 爬網, 搜尋檔案..等執行階段測試