zoukankan      html  css  js  c++  java
  • Elasticsearch同步出现timed out when collecting data的解决办法

      elasticsearch集群其中源es使用虚拟机CentOS搭建,新的node使用k8s搭建,同步速度慢

      elsasticsearch同步慢,出现以下提示的解决版本

    [ERROR][o.e.x.m.c.n.NodeStatsCollector] [9OfhjwS] collector [node_stats] timed out when collecting data
    

       

       修改配置文件

    /etc/sysctl.conf 
    

       增加以下两行

    vm.max_map_count = 655360
    vm.dirty_ratio = 10
    

       设置生效

    # sysctl -p
    net.ipv6.conf.all.disable_ipv6 = 1
    vm.max_map_count = 655360
    vm.dirty_ratio = 10
    vm.dirty_background_ratio = 5
    

       增加k8s配置文件的资源配置

      完整配置文件如下

    # cat es-statefulset.yaml 
    apiVersion: apps/v1
    kind: StatefulSet
    metadata:
      labels:
        app: es-kibana
      name: es-kibana
      namespace: dev
    spec:
      replicas: 1
      selector:
        matchLabels:
          app: es-kibana
      serviceName: "es-kibana"
      template:
        metadata:
          labels:
            app: es-kibana
        spec:
          imagePullSecrets:
          - name: registry-pull-secret
          containers:
          - image: 192.168.1.11/project/elasticsearch:6.6.2
            imagePullPolicy: Always
            name: elasticsearch
            resources:
              requests:
                memory: "4Gi"
                cpu: "1000m"
              limits:        
                memory: "8Gi"
                cpu: "2000m"
            volumeMounts:
            - name: es-config
              mountPath: /usr/share/elasticsearch/config/elasticsearch.yml
              subPath: elasticsearch.yml
            - name: es-persistent-storage
              mountPath: /usr/share/elasticsearch/data
          - image: 192.168.1.11/project/kibana:6.6.2
            imagePullPolicy: Always
            name: kibana
            volumeMounts:
            - name: kibana-config
              mountPath: /usr/share/kibana/config/kibana.yml
              subPath: kibana.yml
          volumes:
          - name: es-config
            configMap:
              name: es-config
          - name: kibana-config
            configMap:
              name: kibana-config
          - name: es-persistent-storage
            persistentVolumeClaim:
              claimName: es-pv-claim
          hostNetwork: true
          dnsPolicy: ClusterFirstWithHostNet
          nodeSelector:
           kubernetes.io/hostname: 172.16.30.1
    

       增加了资源配置

       重新应用配置文件

  • 相关阅读:
    pickle示例
    Python 升级致yum 问题,pip 异常
    jdk 环境
    zookeeper
    Kafka-Monitor
    Kafka
    nxlog 日志采集
    elasticsearch 基本配置
    elasticsearch 单机多实例
    Elaticsearch 集群
  • 原文地址:https://www.cnblogs.com/minseo/p/13151740.html
Copyright © 2011-2022 走看看