zoukankan      html  css  js  c++  java
  • kafka delete topic

    Don't think it is supported yet. Take a look at this JIRA tracking Delete Topic. For delete manually

    1. Shutdown the cluster
    2. Clean kafka log dir (specified by the log.dir attribute in kafka config file ) as well the zookeeper data
    3. Restart the cluster

    For any given topic what you can do is

    1. Stop kafka
    2. Clean kafka log specific to partition, kafka stores its log file in a format of "logDir/topic-partition" so for a topic named "MyTopic" the log for partition id 0 will be stored in /tmp/kafka-logs/MyTopic-0 where /tmp/kafka-logs is specified by the log.dir attribute
    3. Restart kafka

    This is NOT a good and recommended approach but it should work. In the Kafka broker config file the log.retention.hours.per.topic attribute is used to define The number of hours to keep a log file before deleting it for some specific topic

    bin/kafka-run-class.sh kafka.admin.DeleteTopicCommand --zookeeper localhost:2181 --topic test

    命令删除后数据文件依然存在,上边的方法是根本删除

    create kafka-delete-topic.sh file

    #!/bin/bash
    # Licensed to the Apache Software Foundation (ASF) under one or more
    # contributor license agreements.  See the NOTICE file distributed with
    # this work for additional information regarding copyright ownership.
    # The ASF licenses this file to You under the Apache License, Version 2.0
    # (the "License"); you may not use this file except in compliance with
    # the License.  You may obtain a copy of the License at
    # 
    #    http://www.apache.org/licenses/LICENSE-2.0
    # 
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS,
    # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    # See the License for the specific language governing permissions and
    # limitations under the License.
    base_dir=$(dirname $0)
    export KAFKA_OPTS="-Xmx512M -server -Dcom.sun.management.jmxremote -Dlog4j.configuration=file:$base_dir/kafka-console-consumer-log4j.properties"
    $base_dir/kafka-run-class.sh kafka.admin.DeleteTopicCommand $@

    https://issues.apache.org/jira/browse/KAFKA-330

    http://stackoverflow.com/questions/17730905/is-there-a-way-to-delete-all-the-data-from-a-topic-or-delete-the-topic-before-ev

    kafka delete topic 问题跟进

    https://issues.apache.org/jira/browse/KAFKA-330

  • 相关阅读:
    04--Spring知识汇总
    01--Java集合知识
    03-Servlet 体系结构知识梳理
    02--Tomcat总体结构分析一
    01--Java开发中文乱码问题分析
    HTTP05--HTML常用知识
    3--Java NIO基础1
    02--Java Socket编程--IO方式
    01--TCP状态转换
    java之泛型理解(高效java之泛型)
  • 原文地址:https://www.cnblogs.com/sunxucool/p/3833065.html
Copyright © 2011-2022 走看看