apache zookeeper - Kafka throwing an error for which a Google search has no results -


i have stand-alone kafka 0.9 service running on single-node hdp 2.3.4.7 hadoop cluster (this development set-up).

recently ran out of disk space (logging component had been set way verbose!) , kafka crashed. before restarting wanted clear of topics, did following:

  • cleared out tmp/kafka-logs folder.
  • wiped /consumers, /brokers, /admin , /config nodes zookeeper.
  • cleared out /tmp/zookeeper/version-2 folder.
  • restarted zookeeper.
  • restarted kafka.

kafka did 2 strange things.

firstly, recreated topics had deleted. have no idea how did had believed state stores in /tmp/kafka-logs folder , in zk.

secondly, throws string of errors of following form:

error processor got uncaught exception. (kafka.network.processor) kafka.common.kafkaexception: number of topics has value -1 not in range (0,2147483647).     @ kafka.api.apiutils$.readintinrange(apiutils.scala:87)     @ kafka.api.topicmetadatarequest$.readfrom(topicmetadatarequest.scala:43)     @ kafka.api.requestkeys$$anonfun$4.apply(requestkeys.scala:51)     @ kafka.api.requestkeys$$anonfun$4.apply(requestkeys.scala:51)     @ kafka.network.requestchannel$request.<init>(requestchannel.scala:66)     @ kafka.network.processor$$anonfun$run$11.apply(socketserver.scala:426)     @ kafka.network.processor$$anonfun$run$11.apply(socketserver.scala:421)     @ scala.collection.iterator$class.foreach(iterator.scala:727)     @ scala.collection.abstractiterator.foreach(iterator.scala:1157)     @ scala.collection.iterablelike$class.foreach(iterablelike.scala:72)     @ scala.collection.abstractiterable.foreach(iterable.scala:54)     @ kafka.network.processor.run(socketserver.scala:421)     @ java.lang.thread.run(thread.java:745)

which no amount of googling sheds light on. kafka server not crash if attempt connect console consumer error of form:

error in fetch kafka.consumer.consumerfetcherthread$fetchrequest@2cb1cc1c (kafka.consumer.consumerfetcherthread)  java.net.sockettimeoutexception

the console producer will let me post messages however!

does have ideas to:

1) why kafka able recover topics? (did miss out step in deletion process?)

2) error might mean? have corrupted config somewhere need rid of?


Comments

Post a Comment

Popular posts from this blog

javascript - Knockout pushing observable and computed data to an observable array -

i trying push multiple data (firstname , lastname), along when compute firstname , lastname , try push data in same array thrown error. below code. viewmodel: var viewmodel = function () { var self = this; self.gameofthrones = ko.observablearray ([ {firstname: 'jon', lastname: 'snow'}, {firstname: 'robb', lastname: 'stark'} ]); self.firstname = ko.observable(''); self.lastname = ko.observable(''); (var i=0; i<self.gameofthrones().length; i++) { self.gameofthrones()[i].fullname = ko.computed (function () { return self.gameofthrones()[i].firstname+" "+self.gameofthrones()[i].lastname; }) }; $('#classic').click( function() { self.gameofthrones.push( {firstname: $('#fn').val(), lastname: $('#pr').val()} ); }); } ko.applybindings(new viewmodel()); html view: <form class="" action="index.html" method="post"...
Read more

'hasOwnProperty' in javascript -

i use obj.hasownproperty judge whether object has property, when replaced obj[prop] !== undefined , not normal implementation, ask, why behind method can not use it? object.hasownproperty(prop); object[prop] !== undefined; obj[prop] !== undefined wrong 2 reasons: you can explicitly set property undefined , obj[prop] = undefined; . obj.hasownproperty(prop) return true in case. obj[prop] follow prototype chain, return property that's inherited. obj.hasownproperty(prop) returns true if property exists directly in object, returns false inherited properties.
Read more

Trouble making a JSON string -

i'm trying upgrade existing json structure more complex one. the original idea bunch of x animals , each 1 having bunch of caracteristics: animals animal 1 claws:4 eyes:2 animal 2 claws:0 eyes:6 etc. the json this: { "animals":[ {"claws":"4", "eyes":"2"}, {"claws":"0", "eyes":"6"}, etc. ] } so can see, don't name each animal object, caracteristics of animal element of array. can use them in loop animals[x].claws now want add nest each animal, like: animals animal 1 head eyes:2 ears:2 body claws:4 tails:1 legs:4 animal 2 head eyes:6 ears:0 body claws:0 tails:0 legs:8 but didn't manage without naming each animal object (with same name "animal") , using arrays what's in animal: { "animals":[ {"animal":[ {"head": ...
Read more