hadoop2 - Hadoop v2.7 pseudo distributed installation NativeCodeLoader error -


i've tried install hadoop in system , first getting permissions able resolve simple chmod , chown after solving issue there new error arises whenever use start-dfs.sh

kishan@rock ~ $ start-dfs.sh 17/04/08 12:22:18 warn util.nativecodeloader: unable load native-hadoop library platform... using builtin-java classes applicable  incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address not configured. starting namenodes on [] localhost: starting namenode, logging /usr/local/hadoop-2.7.3/logs/hadoop-kishan-namenode-rock.out  localhost: starting datanode, logging /usr/local/hadoop-2.7.3/logs/hadoop-kishan-datanode-rock.out  starting secondary namenodes [0.0.0.0] 0.0.0.0: starting secondarynamenode, logging /usr/local/hadoop-2.7.3/logs/hadoop-kishan-secondarynamenode-rock.out  17/04/08 12:22:33 warn util.nativecodeloader: unable load native-hadoop library platform... using builtin-java classes applicable kishan@rock ~ $ jps 10303 jps

it's warning nodes not running.

update: namenode error log:

2017-04-09 21:32:40,002 error org.apache.hadoop.hdfs.server.namenode.namenode: failed start namenode. org.apache.hadoop.hdfs.server.common.inconsistentfsstateexception: directory /home/kishan/hdfs/namenode in inconsistent state: storage directory not exist or not accessible.     @ org.apache.hadoop.hdfs.server.namenode.fsimage.recoverstoragedirs(fsimage.java:327)     @ org.apache.hadoop.hdfs.server.namenode.fsimage.recovertransitionread(fsimage.java:215)     @ org.apache.hadoop.hdfs.server.namenode.fsnamesystem.loadfsimage(fsnamesystem.java:975)     @ org.apache.hadoop.hdfs.server.namenode.fsnamesystem.loadfromdisk(fsnamesystem.java:681)     @ org.apache.hadoop.hdfs.server.namenode.namenode.loadnamesystem(namenode.java:585)     @ org.apache.hadoop.hdfs.server.namenode.namenode.initialize(namenode.java:645)     @ org.apache.hadoop.hdfs.server.namenode.namenode.<init>(namenode.java:812)     @ org.apache.hadoop.hdfs.server.namenode.namenode.<init>(namenode.java:796)     @ org.apache.hadoop.hdfs.server.namenode.namenode.createnamenode(namenode.java:1493)     @ org.apache.hadoop.hdfs.server.namenode.namenode.main(namenode.java:1559) 2017-04-09 21:32:40,003 info org.apache.hadoop.util.exitutil: exiting status 1 

org.apache.hadoop.hdfs.server.common.inconsistentfsstateexception: directory /home/kishan/hdfs/namenode in inconsistent state: storage directory not exist or not accessible

your namenode needs format. 

hdfs namenode -format

if datanode data directories created, manually remove them before re-starting cluster.


Comments

Post a Comment

Popular posts from this blog

c# - Update a combobox from a presenter (MVP) -

i using mvp in project, new in mvp. have 2 comboboxes. when select option in combobox, combobox should filled new data. this action in presenter. view 'view1' in presenter, , introduced combobox1 , combobox2 properties in 'view1', because need 'datasource', 'displaymember', 'valuemember' , 'refresh()' in method below. but, when using pattern, enough send property like public string combobox2 { { return combobox1.selectedvalue.tosstring(); } } into presenter not whole combobox. how can solve problem? public void onselectedindexchangedcombobox1() { if (view1.combobox1.selectedindex == -1) { return; } datatable dt = tools.getdatatable("a path"); var query = (from o in dt.asenumerable() o.field<string>("afield") == farmerview.combobox1.selectedvalue.tostring() orderby o.field<string>("anotherfield") select...
Read more

How to understand 2 main() functions after using uftrace to profile the C++ program? -

i trying uftrace profile following simple c++ program: #include <iostream> class { public: a() {std::cout << "a created" << std::endl;} ~a() {std::cout << "a destroyed" << std::endl;} }; int main() { a; return 0; } the profile result this: # uftrace a.out created destroyed # duration tid function 2.026 [ 4828] | __cxa_atexit(); [ 4828] | main() { [ 4828] | __static_initialization_and_destruction_0() { 89.397 [ 4828] | std::ios_base::init::init(); 0.768 [ 4828] | __cxa_atexit(); 93.029 [ 4828] | } /* __static_initialization_and_destruction_0 */ 94.425 [ 4828] | } /* main */ [ 4828] | main() { [ 4828] | a::a() { 11.104 [ 4828] | std::operator <<(); 10.825 [ 4828] | std::basic_ostream::operator <<(); 24.514 [ 4828] | } /* a::a */ [ 4828] | a::~a() { 0.978 [ 4828] | ...
Read more

How to put a lock and transaction on table using spring 4 or above using jdbcTemplate and annotations like @Transactional? -

i trying put lock on table while writing on table , if happened in between roll-back . trying convert below code lock table test_g1 read; lock table test_g write; -- begin; start transaction; insert test_g1 values(143); insert test_g values(145); select * test_g1; select * test_g; rollback; select * test_g; unlock tables; how convert above code @transactional spring jdbctemplate code? @transactional(rollbackfor={dataaccessexception.class}) public void test(){ jdbctemplate.execute("insert test1 (id, nam) values (4, 'a')"); throw new dataaccessexception("error") { }; } here trying throw error, insert statement should rollback it's not happening . thanks edit-1 attaching code , doing in jdbcdaoimpl.java , mentioned problem comment above test() . app.java package com.cgiri.javabrains.spring4; import org.springframework.beans.factory.annotation.autowired; import org.springframework.context.applic...
Read more