java - Kafka Log4j appender not sending messages -


i quite new ot apache kafka , log4j. trying send log messages kafka. here log4j properties file

log4j.rootlogger=info, stdout  log4j.appender.stdout=org.apache.log4j.consoleappender log4j.appender.stdout.layout=org.apache.log4j.patternlayout log4j.appender.stdout.layout.conversionpattern=%d{yyyy-mm-dd hh:mm:ss} %-5p %c{1}:%l %% %m%n  log4j.appender.kafka=kafka.producer.kafkalog4jappender log4j.appender.kafka.brokerlist=localhost:9092 log4j.appender.kafka.topic=kfklogs   log4j.appender.kafka.serializerclass=kafka.producer.defaultstringencoder log4j.appender.kafka.layout=org.apache.log4j.patternlayout log4j.appender.kafka.layout.conversionpattern=%d{yyyy-mm-dd hh:mm:ss} %-5p %c{1}:%l %% - %m%n  log4j.logger.loggen=debug, kafka

however, not able receive messages in consumer. have tested consumer other producer code , works fine.

also, warning

log4j:warn no such property [serializerclass] in kafka.producer.kafkalog4jappender.

edit

and here code generates log messages

    package loggen;  import org.apache.log4j.logger;  public class testlog4j {      static logger log = logger.getlogger(testlog4j.class.getname());      public static void main(string[] args) {          log.debug("debug message");          log.info("info message");          log.error("error message");          log.fatal("fatal message");          log.warn("warn message");          log.trace("trace message");     }  }

also, if write log messages file using like

log4j.appender.kafka=org.apache.log4j.dailyrollingfileappender log4j.appender.kafka.datepattern='.'yyyy-mm-dd-hh log4j.appender.kafka.file=logs/server.log

i can see log messages in server.log file

thanks suggestions everyone. think weird behavior see might related kafka set up. here contents of server.properties file use start kafka server. can see odd ?

broker.id=0  port=9092  num.network.threads=3  num.io.threads=8  socket.send.buffer.bytes=102400  socket.receive.buffer.bytes=102400  socket.request.max.bytes=104857600  log.dirs=/users/xyz/kafka/kafka-logs  num.partitions=1  num.recovery.threads.per.data.dir=1  log.retention.hours=168  log.segment.bytes=1073741824  log.retention.check.interval.ms=300000  log.cleaner.enable=false  zookeeper.connect=localhost:2181  zookeeper.connection.timeout.ms=6000  delete.topic.enable=true

i have took @ source code of kafkalog4jappender.scala , here valid , exhaustive properties kafka log4j appender of version 0.8.2.1 : topic, brokerlist, compressiontype, requirednumacks, syncsend.

the log4j.properties worked me below :

log4j.rootlogger=error, stdout  log4j.logger.loggen=debug, kafka  log4j.appender.stdout=org.apache.log4j.consoleappender log4j.appender.stdout.layout=org.apache.log4j.patternlayout log4j.appender.stdout.layout.conversionpattern=%d{yyyy-mm-dd hh:mm:ss} %-5p %c{1}:%l %% %m%n  log4j.appender.kafka=kafka.producer.kafkalog4jappender log4j.appender.kafka.topic=log log4j.appender.kafka.brokerlist=localhost:9092 log4j.appender.kafka.compressiontype=none log4j.appender.kafka.requirednumacks=0 log4j.appender.kafka.syncsend=true log4j.appender.kafka.layout=org.apache.log4j.patternlayout log4j.appender.kafka.layout.conversionpattern=%d{yyyy-mm-dd hh:mm:ss} %-5p %c{1}:%l %% - %m%n

-

Comments

Post a Comment

Popular posts from this blog

c# - Binding a comma separated list to a List<int> in asp.net web api -

the default binder in web api expecst http://url.com/webapi/report/?pageids=3243&pageids=2365 to bind public ihttpactionresult report(list<int> pageids){ // exciting webapi code} i wish bind http://url.com/webapi/report/?pageids=3243,2365 as running out of space in url get . i have created class public class commaseparatedmodelbinder : system.web.http.modelbinding.imodelbinder { public bool bindmodel(httpactioncontext actioncontext, modelbindingcontext bindingcontext) { //binding in here } } and registered in webapiconfig.cs var provider = new simplemodelbinderprovider( typeof(list<int>), new commaseparatedmodelbinder()); config.services.insert(typeof(modelbinderprovider), 0, provider); i have altered method signature use model binder so public ihttpactionresult report( [modelbinder] list<int> pageids){ // exciting webapi code} however break point in binder not being
Read more

Delphi 7 and decode UTF-8 base64 -

in delphi 7, have widestring encoded base64(that received web service widestring result) : pd94bwwgdmvyc2lvbj0ims4wij8+dqo8c3ryaw5nptiq2lpyqjwvc3ryaw5npg== when decoded it, result not utf-8: <?xml version="1.0"?> <string>طھط³طھ</string> but when decoded base64decode.org, result true : <?xml version="1.0"?> <string>تست</string> i have use encddecd unit decodestring function. the problem have using decodestring . function, in delphi 7, treats decoded binary data being ansi encoded. , problem text utf-8 encoded. to continue encddecd unit have couple of options. can switch decodestream . instance, code produce utf-8 encoded text file data: {$apptype console} uses classes, encddecd; const data = 'pd94bwwgdmvyc2lvbj0ims4wij8+dqo8c3ryaw5nptiq2lpyqjwvc3ryaw5npg=='; var input: tstringstream; output: tfilestream; begin input := tstringstream.create(data); try output := tfilestream.
Read more

html - Is there any way to exclude a single element from the style? (Bootstrap) -

so, have img logo, overlaid on div styled background-image: url("...") , , both elements inside 2 div classes .to-color , .to-overlay respectively, black transparent overlay. is there way exclude logo style given these 2 classes? here's jsfiddle example: link html , css example: - html - <div class="to-color"> <div class="to-overlay"> <div class="respo"> <div class="row"> <div class="col-xs-4 col-xs-offset-4 text-center"> <img src="http://ansonalex.com/wp-content/uploads/2011/06/google-logo-768x260.png" alt="..." class="img-responsive"> </div> </div> </div> </div> </div> - css - .to-color { background-color: #000; } .to-overlay { opacity : 0.5; } .respo { background-image: url("https://source.unsplash.com/category/objects/1600x900"); background-position: center center;
Read more