zoukankan      html  css  js  c++  java
  • Brokers类型配置

     
     
    模块
    配置项
    作用域
    备注

    DynamicConnectionQuota

    max.connections
    max.connections.per.ip
    max.connections.per.ip.overrides

    All brokers或brokerId

    服务端最大连接数限制

    客户端每个ip最大连接数限制

    客户端每个具体ip最大连接数量限制,格式为:100.127.0.0.1:200,100,127.0.0.2:200,...

    DynamicListenerConfig

    Listener configs
    listeners
    advertised.listeners
    listener.security.protocol.map

    SSL configs

    principal.builder.class
    ssl.protocol
    ssl.provider
    ssl.cipher.suites
    ssl.enabled.protocols
    ssl.keystore.type
    ssl.keystore.location
    ssl.keystore.password
    ssl.key.password
    ssl.truststore.type
    ssl.truststore.location
    ssl.truststore.password
    ssl.keymanager.algorithm
    ssl.trustmanager.algorithm
    ssl.endpoint.identification.algorithm
    ssl.secure.random.implementation
    ssl.client.auth

    SASL configs
    sasl.mechanism.inter.broker.protocol
    sasl.jaas.config
    sasl.enabled.mechanisms
    sasl.kerberos.service.name
    sasl.kerberos.kinit.cmd
    sasl.kerberos.ticket.renew.window.factor
    sasl.kerberos.ticket.renew.jitter
    sasl.kerberos.min.time.before.relogin
    sasl.kerberos.principal.to.local.rules
    sasl.login.refresh.window.factor
    sasl.login.refresh.window.jitter
    sasl.login.refresh.min.period.seconds
    sasl.login.refresh.buffer.seconds

    All brokers或brokerId  
    DynamicLogConfig

    log.segment.bytes (segment.bytes)
    log.roll.ms, log.roll.hours (segment.ms)
    log.roll.jitter.ms, log.roll.jitter.hours (segment.jitter.ms)
    log.index.size.max.bytes (segment.index.bytes)
    log.flush.interval.messages (flush.messages)
    log.flush.interval.ms (flush.ms)
    log.retention.bytes (retention.bytes)
    log.retention.ms, log.retention.minutes, log.retention.hours (retention.ms)
    message.max.bytes(max.message.bytes)
    log.index.interval.bytes (index.interval.bytes)
    log.cleaner.delete.retention.ms (delete.retention.ms)
    log.cleaner.min.compaction.lag.ms (min.compaction.lag.ms)
    log.cleaner.min.cleanable.ratio (min.cleanable.dirty.ratio)
    log.cleanup.policy (cleanup.policy)
    log.segment.delete.delay.ms (file.delete.delay.ms)
    unclean.leader.election.enable (unclean.leader.election.enable)
    min.insync.replicas (min.insync.replicas)
    max.message.bytes (max.message.bytes)
    compression.type (compression.type)
    log.preallocate (preallocate)
    log.message.timestamp.type (message.timestamp.type)
    log.message.timestamp.difference.max.ms (message.timestamp.difference.max.ms)
    log.message.downconversion.enable(message.downconversion.enable)

    All brokers或brokerId

    log.segment.bytes (segment.bytes)

    log.segment.bytes为brokers类型配置

    segment.bytes为topics类型配置,其他同理

    DynamicLogCleaner

    log.cleaner.threads
    log.cleaner.dedupe.buffer.size
    log.cleaner.io.buffer.load.factor
    log.cleaner.io.buffer.size
    log.cleaner.io.max.bytes.per.second
    log.cleaner.backoff.ms

    All brokers或brokerId  
    DynamicMetricsReporters metric.reporters All brokers或brokerId

    Kafka提供了Metrics Reporter的插件扩展功能,默认提供了JmxReporter实现,也即我们已经可以通过JMX工具来查看Kafka的Metrics。所以我们可以自己实现一套Metrics Reporter(实现org.apache.kafka.common.metrics.MetricsReporter),来自定义获取这些Metrics。

    DynamicThreadPool

    num.io.threads
    num.network.threads
    num.replica.fetchers
    num.recovery.threads.per.data.dir
    background.threads

    All brokers或brokerId

    新线程池数量公式:

    newValue > oldValue / 2 && newValue <= oldValue * 2

    当指定线程池数量大于运行时,就会创建扩容,当小于时,就会销毁收缩

    DynamicReplicationQuota

    leader.replication.throttled.rate
    follower.replication.throttled.rate
    replica.alter.log.dirs.io.max.bytes.per.second

    仅用于brokerId

    限制leader副本端处理FETCH请求的每秒流量上限,单位为bytes/sec,表示最高为xxx bytes/sec
    限制follower副本发送FETCH请求的每秒流量上限,单位为bytes/sec,表示最高为xxx bytes/sec
    限制磁盘内目录之间拷贝迁移每秒流量上限,单位bytes/sec,表示最高为xxx bytes/sec

  • 相关阅读:
    这个我过滤概述UIPickerView键盘处理
    父子控制器
    源码0501-10-掌握-单粒模式
    源码0501-07-GCD的基本使用
    源码0501-04-了解-线程的状态
    源码-0501-01-处理耗时操作
    源码03-02-10-导航控制器简单使用
    spring在ssh框架中到底起到什么作用
    ssh整合
    spring整合hibernate
  • 原文地址:https://www.cnblogs.com/lizherui/p/12056760.html
Copyright © 2011-2022 走看看