Changes between Version 7 and Version 8 of NCHCCloudCourse100928/Lab1

Timestamp:

Jul 20, 2011, 10:57:00 PM (13 years ago)

Author:

waue

Comment:

--

NCHCCloudCourse100928/Lab1

@@ -31 +31 @@
 == Hadoop Streaming with commands ==
 
- * 範例一：使用 cat 當 mapper，使用 wc 當 reducer
+ * 確認 hadoop 有啟動
 {{{
 hadoop@lucid:~$ cd /opt/hadoop
 hadoop@lucid:/opt/hadoop$ bin/start-all.sh
+}}}
+ * 範例一：使用 cat 當 mapper，使用 wc 當 reducer
+{{{
 hadoop@lucid:/opt/hadoop$ bin/hadoop fs -put conf input
 hadoop@lucid:/opt/hadoop$ bin/hadoop jar ./contrib/streaming/hadoop-0.20.2-streaming.jar -input input -output output -mapper /bin/cat -reducer /usr/bin/wc
@@ -48 +51 @@
 hadoop@lucid:/opt/hadoop$ bin/hadoop jar ./contrib/streaming/hadoop-0.20.2-streaming.jar -input input -output output -mapper streamingMapper.sh -reducer streamingReducer.sh -file streamingMapper.sh -file streamingReducer.sh
 }}}
-
+ * 觀看執行結果
+{{{
+hadoop@lucid:/opt/hadoop$ bin/hadoop fs -cat output/part-00000
+}}}