close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": libsvn_swig_py2.7-1.so.1: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
- Timestamp:
-
Apr 23, 2009, 5:42:46 PM (17 years ago)
- Author:
-
waue
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
|
v1
|
v2
|
|
| 22 | 22 | || /tmp/hadoop/ [[br]] /tmp/nutch || 日誌檔、中間檔與暫存檔 || |
| 23 | 23 | |
| 24 | | = step 1 安裝好Hadoop叢集 = |
| 25 | | |
| 26 | | * 可以參考這篇 [wiki:0330Hadoop_Lab3 hadoop叢集安裝] |
| 27 | | * 當然單機版也可以,只是這樣就直接安裝nutch更省事囉!單機安裝nutch可以參考這裡[wiki:waue/2009/0406 nutch單機安裝],但是設定檔要參考這篇的才完整。 |
| 28 | | * 安裝好hadoop 叢集之後,/opt/的權限就是使用者的了,並且ssh登入兩台都免密碼,hadoop也能正常執行,並且安裝於/opt/hadoop下,設定檔在 /opt/conf |
| | 24 | = step 1 安裝好Hadoop = |
| | 25 | |
| | 26 | 可以用實做一的方法來安裝,然而為了簡化Hadoop安裝,用最簡方式實做 |
| | 27 | {{{ |
| | 28 | ~$ sudo su - |
| | 29 | ~# echo "deb http://free.nchc.org.tw/debian lenny non-free" > /etc/apt/sources.list.d/lenny-nonfree.list |
| | 30 | ~# echo "deb http://www.classcloud.org unstable main" > /etc/apt/sources.list.d/hadoop.list |
| | 31 | ~# apt-get update |
| | 32 | ~# apt-get install hadoop |
| | 33 | (略 .. 確認 java 授權選項 .. ) |
| | 34 | ~# passwd hdfsadm |
| | 35 | }}} |
| 29 | 36 | |
| 30 | 37 | = step 2 下載與安裝 = |