zoukankan      html  css  js  c++  java
  • 05_Kafka Python_Consumer模拟

    Python客户端:  Kafka-python

    安装:  pip install kafka-python

    Consumer端模拟代码

    """
    Kafka Consumer Test
    Client: Kafka-Python
    """
    # Consumer
    from kafka import KafkaConsumer
    
    
    def main():
    
        # A message iterator generated, start reading message from the beginning of the topic
        consumer = KafkaConsumer("ctopic", group_id="cg-1", bootstrap_servers=["192.168.229.100:9092", "192.168.229.101:9092"],
                                 auto_offset_reset='earliest')
    
        for msg in consumer:
            topic = msg.topic
            partiton = msg.partition
            # can explained as msg id, starting from 0
            offset = msg.offset
            key = str(msg.key, encoding='utf-8')
            value = str(msg.value, encoding='utf-8')
    
            print("Topic: "+ topic + "From Partion: " + str(partiton))
            print("Offset: " + str(offset))
            print("Msg key: " + key + " Msg value: " + value)
            print("*"*20)
    
        consumer.close()
    
    if __name__ == "__main__":
        main()

     启动该Consumer,并多次运行Producer, 由于消息的key相同,会被存入同一个partition, 从Consumer端解析出的partition也可以确认

  • 相关阅读:
    <LinkedList> 61
    <LinkedList> (hard + 高)25
    <DP> (高频)322
    <BackTracking> (dfs hard) 291
    <Tree> (高频)236
    <Math> 29 365
    <String> 161 358
    <Array> 309 (高)334
    <Array> 54 (高频+hard )45
    <Design> 359 346
  • 原文地址:https://www.cnblogs.com/shay-zhangjin/p/8012869.html
Copyright © 2011-2022 走看看