zoukankan      html  css  js  c++  java
  • ambari安装Zeppelin Notebook提示ES源找不到问题解决

    说明:因为曾经在ambari集成metron hcp,安装有ES。这样ES的yum源同时写入配置文件保存在数据库(表:repo_version中)

    这造成在安装其他组件是一直提示下面问题:

    stderr:   /var/lib/ambari-agent/data/errors-9286.txt
    
    Traceback (most recent call last):
      File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package/scripts/master.py", line 448, in <module>
        Master().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package/scripts/master.py", line 49, in install
        self.install_packages(env)
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 693, in install_packages
        retry_count=agent_stack_retry_count)
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
        self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
        self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
        provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
        self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 51, in install_package
        self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 86, in checked_call_with_retries
        return self._call_with_retries(cmd, is_checked=True, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 98, in _call_with_retries
        code, out = func(cmd, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
        result = function(command, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
        tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
        result = _call(command, **kwargs_copy)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
        raise ExecutionFailed(err_msg, code, out, err)
    resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install zeppelin_2_6_0_3_8' returned 1.  One of the configured repositories failed (ES-Curator-5.x),
     and yum doesn't have enough cached data to continue. At this point the only
     safe thing yum can do is fail. There are a few ways to work "fix" this:
    
         1. Contact the upstream for the repository and get them to fix the problem.
    
         2. Reconfigure the baseurl/etc. for the repository, to point to a working
            upstream. This is most often useful if you are using a newer
            distribution release than is supported by the repository (and the
            packages for the previous distribution release still work).
    
         3. Disable the repository, so yum won't use it by default. Yum will then
            just ignore the repository until you permanently enable it again or use
            --enablerepo for temporary usage:
    
                yum-config-manager --disable ES-Curator-5.x
    
         4. Configure the failing repository to be skipped, if it is unavailable.
            Note that yum will try to contact the repo. when it runs most commands,
            so will have to try and fail each time (and thus. yum will be be much
            slower). If it is a very temporary problem though, this is often a nice
            compromise:
    
                yum-config-manager --save --setopt=ES-Curator-5.x.skip_if_unavailable=true
    
    failure: repodata/repomd.xml from ES-Curator-5.x: [Errno 256] No more mirrors to try.
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30178 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30027 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30177 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30026 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30678 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30026 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30025 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30179 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30028 milliseconds')
    http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: [Errno 12] Timeout on http://packages.elastic.co/curator/5/centos/7/repodata/repomd.xml: (28, 'Connection timed out after 30175 milliseconds')
    

    查看ambri HDP-2.6 stackversion配置,多出如下项(红框):

    查看/var/lib/ambari-server/resources/stacks/HDP/2.6/repos/repoinfo.xml没有相关配置信息

    查看数据库ambari->repo_version的filed repositories信息如下:

    [{"OperatingSystems/ambari_managed_repositories":"true","OperatingSystems/stack_name":"HDP","OperatingSystems/stack_version":"2.6","repositories":[{"Repositories/default_base_url":"","Repositories/base_url":"","Repositories/mirrors_list":"","Repositories/repo_name":"CURATOR","Repositories/unique":"false","Repositories/repo_id":"ES-Curator-5.x","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/ES-Curator-5.x","hasError":"false","Repositories/initial_base_url":"http://packages.elastic.co/curator/5/centos/7"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/hcp/","Repositories/mirrors_list":"","Repositories/repo_name":"METRON","Repositories/unique":"false","Repositories/repo_id":"HCP-1.4.0.0-38","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HCP-1.4.0.0-38","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/hcp/"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/HDF/centos7/","Repositories/mirrors_list":"","Repositories/repo_name":"HDF","Repositories/unique":"false","Repositories/repo_id":"HDF-3.0","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HDF-3.0","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/HDF/centos7/"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/HDP/centos7/","Repositories/mirrors_list":"","Repositories/repo_name":"HDP","Repositories/unique":"false","Repositories/repo_id":"HDP-2.6","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HDP-2.6","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/HDP/centos7/"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/HDP-UTILS-1.1.0.21/","Repositories/mirrors_list":"","Repositories/repo_name":"HDP-UTILS","Repositories/unique":"false","Repositories/repo_id":"HDP-UTILS-1.1.0.21","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HDP-UTILS-1.1.0.21","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/HDP-UTILS-1.1.0.21/"},{"Repositories/default_base_url":"","Repositories/base_url":"","Repositories/mirrors_list":"","Repositories/repo_name":"ELASTICSEARCH","Repositories/unique":"false","Repositories/repo_id":"elasticsearch-5.x","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/elasticsearch-5.x","hasError":"false","Repositories/initial_base_url":"https://artifacts.elastic.co/packages/5.x/yum"},{"Repositories/default_base_url":"","Repositories/base_url":"","Repositories/mirrors_list":"","Repositories/repo_name":"KIBANA","Repositories/unique":"false","Repositories/repo_id":"kibana-5.x","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/kibana-5.x","hasError":"false","Repositories/initial_base_url":"https://artifacts.elastic.co/packages/5.x/yum"}],"OperatingSystems/repository_version_id":"2","OperatingSystems/os_type":"redhat7","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7","selected":"true"}]
    

    删除es的对应项

    [{"OperatingSystems/ambari_managed_repositories":"true","OperatingSystems/stack_name":"HDP","OperatingSystems/stack_version":"2.6","repositories":[{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/hcp/","Repositories/mirrors_list":"","Repositories/repo_name":"METRON","Repositories/unique":"false","Repositories/repo_id":"HCP-1.4.0.0-38","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HCP-1.4.0.0-38","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/hcp/"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/HDF/centos7/","Repositories/mirrors_list":"","Repositories/repo_name":"HDF","Repositories/unique":"false","Repositories/repo_id":"HDF-3.0","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HDF-3.0","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/HDF/centos7/"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/HDP/centos7/","Repositories/mirrors_list":"","Repositories/repo_name":"HDP","Repositories/unique":"false","Repositories/repo_id":"HDP-2.6","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HDP-2.6","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/HDP/centos7/"},{"Repositories/default_base_url":"","Repositories/base_url":"http://172.17.0.160/HDP-UTILS-1.1.0.21/","Repositories/mirrors_list":"","Repositories/repo_name":"HDP-UTILS","Repositories/unique":"false","Repositories/repo_id":"HDP-UTILS-1.1.0.21","Repositories/repository_version_id":"2","Repositories/stack_name":"HDP","Repositories/latest_base_url":"","Repositories/os_type":"redhat7","Repositories/stack_version":"2.6","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7/repositories/HDP-UTILS-1.1.0.21","hasError":"false","Repositories/initial_base_url":"http://172.17.0.160/HDP-UTILS-1.1.0.21/"}],"OperatingSystems/repository_version_id":"2","OperatingSystems/os_type":"redhat7","href":"http://172.17.0.160:8080/api/v1/stacks/HDP/versions/2.6/repository_versions/2/operating_systems/redhat7","selected":"true"}]
    

    重启ambari-server,在查看:

      

      

      

  • 相关阅读:
    calico 网络流量 过程 分析 apt-get install telnet
    calico 排错记录 apt-get install telnet
    kubernetes 限制网络带宽 annotation -- 注解 -- 类似 label
    vxlan 简单理解 vs calico 网络模型
    ssh配置公私钥远程登录Linux主机 + scp 免密登录ssh-copy-id 如何使用非22端口 + rsync 同步远程机器的文件到本地
    架构图+kubernetes 问题理解 -- kube-pproxy
    声明式API replica controller vs replica set 对比
    Kubernetes哪一点最打动你?或者,它发布过的哪一项特性让你认为最厉害?
    statefulSet + headless service 学习记录 service :selector --> template :label
    nodeSelector + deamonset
  • 原文地址:https://www.cnblogs.com/idvcn/p/9104122.html
Copyright © 2011-2022 走看看