如何优雅的采集activeMQ性能指标

如何优雅的采集activemq

使用telegraf 可以很好的采集相关的所有数据，而且是非入侵式

基本主流的应用都能采，插件式的

分为input 和 output 插件
平台说明
input 使用 jolokia telegraf 工具提供jolokia相关插件去获取activemq自带的api暴露的指标信息
output 我用的是prometheus client0，这是一个Prometheus客户端，会建立一个自己的socket。

部署Telegraf

部署在被采集机器

下载安装包

wget https://dl.influxdata.com/telegraf/releases/telegraf-1.12.0-1.x86_64.rpm&& yum install -y telegraf-1.12.0-1.x86_64.rpm

测试activeMQ是否能访问api

curl -u <你的用户>:<你的密码> http://127.0.0.1:8161/api/jolokia/
和mq控制台的用户密码信息一样

配置修改

修改 /etc/telegraf/telegraf.conf

…
…
  ## Log file name, the empty string means to log to stderr.
  logfile = "/var/log/telegraf/telegraf.log" #填写


  ## The logfile will be rotated after the time interval specified.  When set
  ## to 0 no time based rotation is performed.  Logs are rotated only when
  ## written to, if there is no log activity rotation may be delayed.
  logfile_rotation_interval = "0d" #填写

  ## The logfile will be rotated when it becomes larger than the specified
  ## size.  When set to 0 no size based rotation is performed.
  logfile_rotation_max_size = "50MB" #填写


  ## Maximum number of rotated archives to keep, any older logs are deleted.
  ## If set to -1, no archives are removed.
  logfile_rotation_max_archives = 50 #填写

…
…
#[[outputs.influxdb]]  #注释
#增加注释[[outputs.influxdb]]

生成telegraf out配置文件

cd /etc/telegraf/telegraf.d.
vim output-prometheus-telegraf.conf

###############################################################################
#                            OUTPUT PLUGINS                                   #
###############################################################################


# Configuration for the Prometheus client to spawn
[[outputs.prometheus_client]]
  ## Address to listen on
  listen = ":30013"

  ## Use HTTP Basic Authentication.
  # basic_username = "Foo"
  # basic_password = "Bar"

  ## If set, the IP Ranges which are allowed to access metrics.
  ##   ex: ip_range = ["192.168.0.0/24", "192.168.1.0/30"]
  # ip_range = []

  ## Path to publish the metrics on.
  # path = "/metrics"

  ## Expiration interval for each metric. 0 == no expiration
  # expiration_interval = "60s"

  ## Collectors to enable, valid entries are "gocollector" and "process".
  ## If unset, both are enabled.
  # collectors_exclude = ["gocollector", "process"]

  ## Send string metrics as Prometheus labels.
  ## Unless set to false all string metrics will be sent as labels.
  # string_as_label = true

  ## If set, enable TLS with the given certificate.
  # tls_cert = "/etc/ssl/telegraf.crt"
  # tls_key = "/etc/ssl/telegraf.key"

  ## Set one or more allowed client CA certificate file names to
  ## enable mutually authenticated TLS connections
  # tls_allowed_cacerts = ["/etc/telegraf/clientca.pem"]

  ## Export metric collection time.
  # export_timestamp = false

创建input配置文件

vim input-amq.conf

###############################################################################
#                            INPUT PLUGINS                                    #
###############################################################################


# Read JMX metrics from a Jolokia REST agent endpoint

[[inputs.jolokia2_agent]]
  urls = ["http://localhost:20097/api/jolokia"]
  name_prefix = "activemq."
  username = "system"
  password = "manager"

  ### JVM Generic

  [[inputs.jolokia2_agent.metric]]
    name  = "OperatingSystem"
    mbean = "java.lang:type=OperatingSystem"
    paths = ["ProcessCpuLoad","SystemLoadAverage","SystemCpuLoad"]

  [[inputs.jolokia2_agent.metric]]
    name  = "jvm_runtime"
    mbean = "java.lang:type=Runtime"
    paths = ["Uptime"]
  
[[inputs.jolokia2_agent.metric]]
    name  = "jvm_threading"
    mbean = "java.lang:type=Threading"
    paths = ["ThreadCount"]


  [[inputs.jolokia2_agent.metric]]
    name  = "jvm_memory"
    mbean = "java.lang:type=Memory"
    paths = ["HeapMemoryUsage", "NonHeapMemoryUsage", "ObjectPendingFinalizationCount"]

  [[inputs.jolokia2_agent.metric]]
    name     = "jvm_garbage_collector"
    mbean    = "java.lang:name=*,type=GarbageCollector"
    paths    = ["CollectionTime", "CollectionCount"]
    tag_keys = ["name"]

  [[inputs.jolokia2_agent.metric]]
    name       = "jvm_memory_pool"
    mbean      = "java.lang:name=*,type=MemoryPool"
    paths      = ["Usage", "PeakUsage", "CollectionUsage"]
    tag_keys   = ["name"]
    tag_prefix = "pool_"

  ### ACTIVEMQ

  [[inputs.jolokia2_agent.metric]]
    name     = "queue"
    mbean    = "org.apache.activemq:brokerName=*,destinationName=*,destinationType=Queue,type=Broker"
    paths    = ["QueueSize","EnqueueCount","ConsumerCount","DispatchCount","DequeueCount","ProducerCount","InFlightCount"]
    tag_keys = ["brokerName","destinationName"]

  [[inputs.jolokia2_agent.metric]]
    name     = "topic"
    mbean    = "org.apache.activemq:brokerName=*,destinationName=*,destinationType=Topic,type=Broker"
    paths    = ["ProducerCount","DequeueCount","ConsumerCount","QueueSize","EnqueueCount"]
    tag_keys = ["brokerName","destinationName"]

  [[inputs.jolokia2_agent.metric]]
    name     = "broker"
    mbean    = "org.apache.activemq:brokerName=*,type=Broker"
    paths    = ["TotalConsumerCount","TotalMessageCount","TotalEnqueueCount","TotalDequeueCount","MemoryLimit","MemoryPercentUsage","StoreLimit","StorePercentUsage","TempPercentUsage","TempLimit"]
    tag_keys = ["brokerName"]

启动

systemctl start telegraf

或者
/usr/bin/telegraf -config /etc/telegraf/telegraf.conf -config-directory /etc/telegraf/telegraf.d

检查进程

#启动多个采集进程的示例
# ps -ef|grep telegraf
root      4176 27285  0 14:23 pts/0    00:00:03 telegraf --config 2-jolokia2_agent-telegraf.conf
root      4755 27285  0 14:24 pts/0    00:00:00 telegraf --config jolokia2_agent-telegraf.conf
root      5720 27285  0 14:25 pts/0    00:00:00 telegraf --config temp-telegraf.conf
#实际应用
# ps -ef|grep tele
root       558 29131  0 15:07 pts/1    00:00:00 grep --color=auto tele
telegraf 11443     1  0 14:57 ?        00:00:03 /usr/bin/telegraf -config /etc/telegraf/telegraf.conf -config-directory /etc/telegraf/telegraf.d

验证有没有数据

curl -s http://127..0.0.1:9275/metrics

配置Prometheus

vim /data/prometheus/prometheus.yml
追加内容
  - job_name: 'activemq'
    file_sd_configs:
    - files: ['/data/prometheus/sd_config/activemq-endpoint.yml']
      refresh_interval: 30s
vim /data/prometheus/sd_config/activemq-endpoint.yml
新增内容
- targets:
  - 172.16.0.61:30013
  labels:
    service: activemq

展示（Grafana）

添加相关数据源，修改下实际的指标就能使用

扩展篇

会写一下怎么调试和新增jolokia的指标