Changes between Version 1 and Version 2 of shunfa/2010/0503


Ignore:
Timestamp:
May 3, 2010, 4:13:13 PM (14 years ago)
Author:
shunfa
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • shunfa/2010/0503

    v1 v2  
    2525||Step8|| 格式化HDFS ||  ||
    2626||Step9|| 啟動Hadoop ||  ||
     27
     28== 找不到Datanode時 ==
     29
     30=== 錯誤訊息 ===
     31 * /tmp/hadoop/logs/hadoop-shunfa-datanode-shunfa-VBox1.log
     32{{{
     33#!text
     342010-05-03 15:27:26,322 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
     35/************************************************************
     36STARTUP_MSG: Starting DataNode
     37STARTUP_MSG:   host = shunfa-VBox1/127.0.1.1
     38STARTUP_MSG:   args = []
     39STARTUP_MSG:   version = 0.20.2
     40STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
     41************************************************************/
     422010-05-03 15:27:30,640 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /var/hadoop/hadoop-shunfa/dfs/data: namenode namespaceID = 812261000; datanode namespaceID = 2021031637
     43        at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:233)
     44        at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:148)
     45        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:298)
     46        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
     47        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
     48        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
     49        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1246)
     50        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1368)
     51
     522010-05-03 15:27:30,648 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
     53/************************************************************
     54SHUTDOWN_MSG: Shutting down DataNode at shunfa-VBox1/127.0.1.1
     55************************************************************/
     56}}}
     57
     58=== 解法 ===
     59
     60 * 修改 datanode 的 namespaceID (路徑：/var/hadoop/hadoop-shunfa/dfs/data/current/VESSION)
     61{{{
     62#!text
     63namespaceID=2021031637
     64改成
     65namespaceID=812261000
     66}}}
     67
     68 * 重新啟動Datanode
     69{{{
     70hadooper-1:~$ /opt/hadoop/bin/hadoop-daemon.sh start datanode
     71hadooper-2:~$ /opt/hadoop/bin/hadoop-daemon.sh start datanode
     72}}}
    2773== 簡化 ==
    2874
    29 
     75 
    3076
    3177== References ==
     78 * [http://archive.cloudera.com/docs/cdh.html Cloudera’s Distribution for Hadoop (CDH)] - Jazz提供
     79 * [http://forum.hadoop.tw/viewtopic.php?f=4&t=43 Hadoop Taiwan-Jazz的回覆]
    3280 * [http://trac.nchc.org.tw/cloud/wiki/Hadoop_Lab7 Waue的教材]