zoukankan      html  css  js  c++  java
  • hadoop kafka import/export data (8)

    reference: http://kafka.apache.org/quickstart 

    need to solve issue  

    ISSUE 1:

    [2019-01-29 15:59:39,272] ERROR Failed to commit offsets for WorkerSourceTask{id=local-file-source-0} (org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter:109)

    [2019-01-29 15:59:54,272] ERROR Failed to flush WorkerSourceTask{id=local-file-source-0}, timed out while waiting for producer to flush outstanding 1 messages (org.apache.kafka.connect.runtime.WorkerSourceTask:289)

    [2019-01-29 15:59:54,273] ERROR Failed to commit offsets for WorkerSourceTask{id=local-file-source-0} (org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter:109)

    [2019-01-29 16:00:09,273] ERROR Failed to flush WorkerSourceTask{id=local-file-source-0}, timed out while waiting for producer to flush outstanding 1 messages (org.apache.kafka.connect.runtime.WorkerSourceTask:289)

    [2019-01-29 16:00:09,273] ERROR Failed to commit offsets for WorkerSourceTask{id=local-file-source-0} (org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter:109)?

    ISSUE 2:

    org.apache.kafka.connect.errors.ConnectException: Failed to create consumer
    at org.apache.kafka.connect.runtime.WorkerSinkTask.createConsumer(WorkerSinkTask.java:348)
    at org.apache.kafka.connect.runtime.WorkerSinkTask.initialize(WorkerSinkTask.java:108)
    at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:278)
    at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.createConnectorTasks(StandaloneHerder.java:263)
    at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.updateConnectorTasks(StandaloneHerder.java:287)
    at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.putConnectorConfig(StandaloneHerder.java:163)
    at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:96)
    Caused by: org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:703)
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:553)
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:536)
    at org.apache.kafka.connect.runtime.WorkerSinkTask.createConsumer(WorkerSinkTask.java:346)
    ... 6 more
    Caused by: org.apache.kafka.common.KafkaException: org.apache.kafka.common.KafkaException: Jaas configuration not found
    at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:86)
    at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:70)
    at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:85)
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:644)
    ... 9 more
    Caused by: org.apache.kafka.common.KafkaException: Jaas configuration not found
    at org.apache.kafka.common.security.kerberos.KerberosLogin.getServiceName(KerberosLogin.java:299)
    at org.apache.kafka.common.security.kerberos.KerberosLogin.configure(KerberosLogin.java:103)
    at org.apache.kafka.common.security.authenticator.LoginManager.<init>(LoginManager.java:45)
    at org.apache.kafka.common.security.authenticator.LoginManager.acquireLoginManager(LoginManager.java:68)
    at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:78)
    ... 12 more
    Caused by: java.io.IOException: Could not find a 'KafkaClient' entry in this configuration.
    at org.apache.kafka.common.security.JaasUtils.jaasConfig(JaasUtils.java:50)
    at org.apache.kafka.common.security.kerberos.KerberosLogin.getServiceName(KerberosLogin.java:297)
    ... 16 more
    [2019-01-29 16:10:22,287] INFO Created connector local-file-sink (org.apache.kafka.connect.cli.ConnectStandalone:93)

  • 相关阅读:
    BZOJ#2820. YY的GCD
    BZOJ#3771. Triple(FFT+生成函数)
    BZOJ#4503. 两个串
    HDU#4609. 3-idiots
    UVA 12298 Super Poker II(FFT+母函数)
    HDU#1402. A×B
    树状数组的区间修改与区间查修
    COCI. DIFERENCIJA(序列处理中的小技巧)
    dt.select默认不区分大小写
    缓存,缓存算法和缓存框架
  • 原文地址:https://www.cnblogs.com/lianghong881018/p/10334656.html
Copyright © 2011-2022 走看看