Changes between Version 18 and Version 19 of MR_manual


Ignore:
Timestamp:
Jul 11, 2008, 5:34:47 PM (17 years ago)
Author:
waue
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • MR_manual

    v18 v19  
    179179 = 四、效能測試 =
    180180 = 五、開發程式 =
     181
     182 * [http://trac.nchc.org.tw/cloud/browser/hadoop-eclipse.pdf 可以參考Programming hadoop in Eclipse .pdf]
     183
    181184 == 5.1 install IBM !MapReduce tool ==
    182185 1. Download the IBM !MapReduce Tools zip file and extract to /tmp/. [[br]]
    … …  
    200203set compiler compliance level to 5.0
    201204}}}
    202  * Some eclipse-plugin may exhaust much resource, you may happen to “out of
    203 
    204 memory error”. We suggest to execute eclipse with some parameters as that :
     205 * Some eclipse-plugin may exhaust much resource, you may happen to “out of memory error”. We suggest to execute eclipse with some parameters as that :
    205206{{{
    206207 $  eclipse -vmargs -Xmx 512m
    … …  
    217218 > Finish
    218219}}}
    219  * at “Project explorer”, you will see “sample” tree. Now, you should
    220 
    221 create a sample code.
     220 * at “Project explorer”, you will see “sample” tree. Now, you should create a sample code.
    222221{{{
    223222Eclipse
    … …  
    227226 * the sample code is here
    228227
    229 [http://trac.nchc.org.tw/cloud/attachment/wiki/hadoop-sample-code/!WordCount.java]
     228[http://trac.nchc.org.tw/cloud/attachment/wiki/hadoop-sample-code/WordCount.java]
    230229
    231230 * paste the contents to your new adding file “!WordCount.java”
    … …  
    238237}}}
    239238
    240  * At the bottom of your window, you should have a "!MapReduce Servers" tab.
    241 
    242 If not, see second bullet above. Switch to that tab.
    243 
    244  * At the top right edge of the tab, you should see a little blue elephant
    245 
    246 icons.
     239 * At the bottom of your window, you should have a "!MapReduce Servers" tab.  If not, see second bullet above. Switch to that tab.
     240
     241 * At the top right edge of the tab, you should see a little blue elephant icons.
    247242{{{
    248243Eclipse
    … …  
    253248Username : waue
    254249}}}
    255  * If any password prompt, please input the password which you login to
    256 
    257 local
    258 
    259  * It should show up under a little elephant icon in the Project Explorer
    260 
    261 (on the left side of Eclipse).
    262 
    263  * ps  :  Pleast make sure your Hadoop is working on local system. If not,
    264 
    265 please refer “session 2 Hadoop Setup” for debuging, or you can not pass
    266 
    267 through.
    268 
     250 * If any password prompt, please input the password which you login to local
     251
     252 * It should show up under a little elephant icon in the Project Explorer  (on the left side of Eclipse).
     253
     254 * ps  :  Pleast make sure your Hadoop is working on local system. If not, please refer “session 2 Hadoop Setup” for debuging, or you can not pass through.
     255
     256{{{
    269257 $ cd /home/waue/workspace/hadoop/ [[br]]
    270258 $ wget http://www.gutenberg.org/etext/132/132.txt   [[br]]
    271259 $ bin/hadoop dfs -mkdir input [[br]]
    272260 $ bin/hadoop dfs -ls [[br]]
    273 {{{
     261
    274262Found 1 items
    275263/user/waue/input        <dir>           2008-05-23 15:15        rwxr-xr-x   
    276 
    277264  waue     supergroup
    278265}}}
    … …  
    288275 * A “console” tag will show beside “!MapReduce Server” tag.
    289276
    290  * While Map Reduce is running, you can visit http://localhost:50030/ to
    291 
    292 view that Hadoop is dispatching jobs by Map Reduce.
     277 * While Map Reduce is running, you can visit http://localhost:50030/ to view that Hadoop is dispatching jobs by Map Reduce.
    293278
    294279 * After finish, you can go to http://localhost:50060/ to see the result.