Changes between Version 23 and Version 24 of Streaming


Ignore:
Timestamp:
Apr 26, 2010, 6:52:42 PM (15 years ago)
Author:
waue
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • Streaming

    v23 v24  
    1212
    1313{{{
    14 $ bin/hadoop jar contrib/streaming/hadoop-0.18.3-streaming.jar \
     14$ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar \
    1515-input $INPUT -output $OUTPUT -mapper $MAPPER -reducer $REDUCER
    1616}}}
    … …  
    1919
    2020 || bin/hadoop  || 呼叫使用hadoop程式 ||  ||
    21  || jar contrib/streaming/hadoop-0.18.3-streaming.jar  || 使用streaming這個功能 || ps:預設此jar檔放在 contrib/streaming/ 內 ||
     21 || jar contrib/streaming/hadoop-0.20.2-streaming.jar  || 使用streaming這個功能 || ps:預設此jar檔放在 contrib/streaming/ 內 ||
    2222 || -input $INPUT  || 設定hdfs上的輸入資料夾 || ps:需先上傳資料到hdfs 上 ||
    2323 || -output $OUTPUT  ||  設定hdfs上的輸出資料夾||  ps:在hdfs 上的 output資料夾不可重複||
    … …  
    3434
    3535{{{
    36 $ bin/hadoop jar contrib/streaming/hadoop-0.18.3-streaming.jar \
     36$ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar \
    3737-input lab4_input -output stream-out1 -mapper /bin/cat -reducer /usr/bin/wc
    3838}}}
    … …  
    145145
    146146{{{
    147 $ bin/hadoop jar contrib/streaming/hadoop-0.18.3-streaming.jar  \
     147$ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar  \
    148148-mapper /opt/hadoop/mapper.php -reducer /opt/hadoop/reducer.php -input lab4_input -output stream_out2
    149149}}}