zoukankan      html  css  js  c++  java
  • Springboot kafka 集成过程中的问题

    Q1:Failed to start bean 'org.springframework.kafka.config.internalKafkaListenerEndpointRegistry'

    A1:是因为没有在注入时未对其进行配置导致,注册参照如下

    /**
     * Created by wolf   2018/12/1
     */
    @Configuration
    @EnableKafka
    public class kafkatemplateConfig {
    
        @Value("${spring.kafka.bootstrap-servers}")
        private String bootstrapServers;
    
        @Bean
        public KafkaListenerContainerFactory<ConcurrentMessageListenerContainer<String,String>> kafkaListenerContainerFactory(){
            ConcurrentKafkaListenerContainerFactory<String,String> factory = new ConcurrentKafkaListenerContainerFactory<>();
            factory.setConsumerFactory(consumerFactory());
            factory.setConcurrency(3);
            factory.getContainerProperties().setPollTimeout(5000);
            return factory;
        }
    
        @Bean
        public ConsumerFactory<String,String> consumerFactory(){
            return new DefaultKafkaConsumerFactory<>(consumerConfigs());
        }
    
        @Bean
        public Map<String,Object> consumerConfigs(){
            Map<String,Object> propsMap = new HashMap<>();
            propsMap.put(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG,this.bootstrapServers);
            propsMap.put(ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG,false);//自行控制提交offset
            propsMap.put(ConsumerConfig.AUTO_COMMIT_INTERVAL_MS_CONFIG,"100");//提交延迟毫秒数
            propsMap.put(ConsumerConfig.SESSION_TIMEOUT_MS_CONFIG,"15000");//执行超时时间
            propsMap.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
            propsMap.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
            propsMap.put(ConsumerConfig.GROUP_ID_CONFIG,"dsafas");
            propsMap.put(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG,"latest");//开始消费位置
            return propsMap;
        }
    
        @Bean
        public Consumer listener(){
            return new Consumer();
        }
    }
    

     Q2:a:Could not instantiate class org.springframework.kafka.support.serializer.JsonDeserializer

      b:org.springframework.kafka.support.serializer.JsonDeserializer with modifiers "protected"

      c:If the serializationyou can also enable trust all (*)   

    A2:看下是因为要为监听者得到的对象 在进行序列化与反序列化 要进行设置在上述配置类中如下两列针对该问题

    参考1    参考2

        propsMap.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
        propsMap.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
    

    Q3:java.lang.IllegalArgumentException: Magic v1 does not support record headers

      A3:版本问题 我其实遇到时是用的 springboot.version: 2.1.0.RELEASE 部署的kafka组件版本为较新版kafka_2.11-2.1.0    与旧版kafka_2.12-0.10.2.1 最终将springboot.version换成1.5.10.RELEASE

     

      

    nhz94259@163.com
  • 相关阅读:
    HDU 6191 Query on A Tree ( 2017广西邀请赛 && 可持久化Trie )
    BZOJ 4318 OSU! ( 期望DP )
    洛谷 P2473 [SCOI2008]奖励关 ( 期望DP )
    Codeforces #499 E Border ( 裴蜀定理 )
    HDU 6444 Neko's loop ( 2018 CCPC 网络赛 && 裴蜀定理 && 线段树 )
    HDU 6438 Buy and Resell ( 2018 CCPC 网络赛 && 贪心 )
    Nowcoder Hash Function ( 拓扑排序 && 线段树优化建图 )
    Nowcoder Playing Games ( FWT 优化 DP && 博弈论 && 线性基)
    js中的深拷贝与浅拷贝
    nrm 源管理器
  • 原文地址:https://www.cnblogs.com/nhz-M/p/10048047.html
Copyright © 2011-2022 走看看