close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_core.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
- Timestamp:
-
May 22, 2008, 4:27:39 PM (18 years ago)
- Author:
-
waue
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
|
v16
|
v17
|
|
| 7 | 7 | == 工作里程 == |
| 8 | 8 | === 5/22 === |
| 9 | | * 錯誤解決 ==> 5. Select menu option: Project > Clean... (卡住.. 因為發生了九百多個錯誤 ) ==> Window > Preferences > java> compiler: 設定 compiler compliance level to 5.0 (變成9個warning) |
| 10 | | * 安裝IBM mapReduce tool |
| 11 | | 1. 下載 MapReduce_Tools.zip |
| 12 | | 2. 關掉 Eclipse -> 解壓縮 MapReduce Tools zip 到 /usr/lib/eclipse/plugins/ |
| 13 | | * 使用 IBM mapReduce tool |
| 14 | | * 重開啟Eclipse-> 選 File > New > Project ->有 MapReduce category. |
| 15 | | * 使用教學: Help -> Cheat sheet -> MapReduce -> Write a MapReduce application |
| 16 | | |
| 17 | | |
| | 9 | * 成功編譯hadoop in Eclipse 並解決昨天的問題 |
| | 10 | * 解決錯誤 5. ==> Window > Preferences > java> compiler: 設定 compiler compliance level to 5.0 (變成9個warning) |
| | 11 | * 解決錯誤 7.1 ==> add a new MapReduce server location > server name : 任意 、 Hostname : localhost 、 Installation directory: /home/waue/workspace/nutch/ 、 Username : waue |
| | 12 | * 解決錯誤 7.2 ==> 其實在執行7.1之前需要先將hadoop filesystem startup 起來才行,並且將範例檔放入hadoop filesystem中如bin/hadoop dfs -put 132.txt test |
| | 13 | * 解決錯誤 8 ==> 打開umd-hadoop-core > src > edu.umd.cloud9.demo > DemoWordCount.java ,編輯程式碼如 String filename = "/user/waue/test/132.txt"; ,接著右鍵點run as ... > 選擇之前設定的hadoop file system > 看到console 端 map-reduce 已經在run即可 |
| | 14 | * 安裝IBM mapReduce tool |
| | 15 | 1. 下載 MapReduce_Tools.zip |
| | 16 | 2. 關掉 Eclipse -> 解壓縮 MapReduce Tools zip 到 /usr/lib/eclipse/plugins/ |
| | 17 | * 使用 IBM mapReduce tool |
| | 18 | * 重開啟Eclipse-> 選 File > New > Project ->有 MapReduce category. |
| | 19 | * 使用教學: Help -> Cheat sheet -> MapReduce -> Write a MapReduce application |
| 18 | 20 | === 5/21 === |
| 19 | 21 | * 藉著用此篇文章實做設計map-reduce 程式 [http://www.umiacs.umd.edu/~jimmylin/cloud9/umd-hadoop-dist/cloud9-docs/howto/start.html cloud 9] ,以下紀錄我的作法: |