centos7 安装kubernetes1.4

192.168.251.9 master
192.168.251.231 node

建议可以搭建etcd集群来做数据库存储，并搭建kube-dns，然后把k8s的日志落地到/var/log/kubernetes目录

1.关闭防火墙

查看防火墙状态firewalld
systemctl status firewalld.service
关闭防火墙
systemctl stop firewalld.service
systemctl disable firewalld.service
安全设置

setenforce 0

关闭Selinux
/etc/selinux/config
SELINUX=disabled


查看iptables
systemctl status iptables.service
systemctl stop iptables.service


设置主机名
hostnamectl k8s-1
hostnamectl k8s-2

 

设置ntp
yum -y install ntp 
systemctl start ntpd 
systemctl enable ntpd

reboot重启机器

2.加入yum源

cd /etc/yum.repos.d

wget http://mirrors.163.com/.help/CentOS7-Base-163.repo

wget http://mirrors.aliyun.com/repo/Centos-7.repo

rpm -ivh http://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-9.noarch.rpm

3.安装

master 需要安装 kubernetes-master etcd flannel docker
node需要安装 kubernetes-node flannel docker

4.安装master

yum install docker libdevmapper* ntp etcd flannel kubernetes-master -y

(1)配置 etcd
所有的etcd都统一配置

cat /etc/etcd/etcd.conf

ETCD_NAME=default

ETCD_DATA_DIR="/var/lib/etcd/default.etcd"

ETCD_LISTEN_CLIENT_URLS="http://0.0.0.0:2379"

ETCD_ADVERTISE_CLIENT_URLS="http://192.168.163.148:2379" //masterIP端口

(2)配置apiserver

/etc/kubernetes/apiserver

KUBE_API_ADDRESS="--insecure-bind-address=0.0.0.0"

KUBE_ETCD_SERVERS="--etcd-servers=http://192.168.251.9:2379"

KUBE_SERVICE_ADDRESSES="--service-cluster-ip-range=192.168.0.0/16"

(3)配置controller-manager

/etc/kubernetes/controller-manager

KUBE_CONTROLLER_MANAGER_ARGS="--node-monitor-grace-period=10s --pod-eviction-timeout=10s"

(4)配置config

/etc/kubernetes/config

KUBE_MASTER="--master=http://192.168.251.9:8080"

启动 注意先启动kubernetes，再启动docker

systemctl enable docker

systemctl restart flanneld docker

systemctl enable etcd kube-apiserver kube-scheduler kube-controller-manager

systemctl start etcd kube-apiserver kube-scheduler kube-controller-manager


systemctl stop etcd kube-apiserver kube-scheduler kube-controller-manager

5.node安装

yum -y install docker kubernetes-node flannel

systemctl start docker
systemctl enable docker

(1)修改kube-node

[root@localhost ~]# vi /etc/kubernetes/config

KUBE_LOGTOSTDERR="--logtostderr=true"

# journal message level, 0 is debug
KUBE_LOG_LEVEL="--v=0"

# Should this cluster be allowed to run privileged docker containers
KUBE_ALLOW_PRIV="--allow-privileged=false"

# How the controller-manager, scheduler, and proxy find the apiserver
#KUBE_MASTER="--master=http://127.0.0.1:8080"
KUBE_MASTER="--master=http://192.168.251.9:8080"

(2)配置kubelet

[root@localhost ~]# vi /etc/kubernetes/kubelet

###
# kubernetes kubelet (minion) config

# The address for the info server to serve on (set to 0.0.0.0 or "" for all interfaces)
KUBELET_ADDRESS="--address=127.0.0.1"

# The port for the info server to serve on
# KUBELET_PORT="--port=10250"

# You may leave this blank to use the actual hostname
KUBELET_HOSTNAME="--hostname-override=192.168.251.231"

# location of the api-server
KUBELET_API_SERVER="--api-servers=http://192.168.251.9:8080"

# pod infrastructure container
KUBELET_POD_INFRA_CONTAINER="--pod-infra-container-image=registry.access.redhat.com/rhel7/pod-infrastructure:latest"

# Add your own!
#KUBELET_ARGS=""
KUBELET_ARGS="--pod-infra-container-image=kubernetes/pause"

(3)配置flanneld

/etc/sysconfig/flanneld

FLANNEL_ETCD_ENDPOINTS="http://192.168.251.9:2379"

FLANNEL_ETCD_PREFIX="/coreos.com/network"

(4) 启动服务

systemctl restart flanneld docker

systemctl start kubelet kube-proxy

systemctl enable flanneld kubelet kube-proxy docker

(5)在master上验证服务.

# kubectl get nodes ## 获取k8s客户端


registry.alauda.cn/googlecontainer/kubernetes-dashboard-amd64

6.在master上安装web ui kubernetes-dashboard：

cd /opt/docker

wget https://rawgit.com/kubernetes/dashboard/master/src/deploy/kubernetes-dashboard.yaml

获取 kubernetes-dashboard.yaml文件 修改，

将google的替换本地的镜像
image: docker.io/ist0ne/kubernetes-dashboard-amd64
不要去google拉取镜像
imagePullPolicy: IfNotPresent
配置apiserver的ip和端口
- --apiserver-host=http://192.168.251.9:8080


修改完成后上传至master
运行 kubectl create -f kubernetes-dashboard.yaml

验证

# kubectl get pods --namespace=kube-system
NAME READY STATUS RESTARTS AGE
kubernetes-dashboard-747085828-0r767 0/1 ContainerCreating 0 33s


查看该容器的详细过程:

# kubectl describe pods kubernetes-dashboard-747085828-0r767 --namespace=kube-system
Name: kubernetes-dashboard-747085828-0r767
Namespace: kube-system
Node: 192.168.251.231/192.168.251.231
Start Time: Thu, 02 Mar 2017 14:51:55 +0800
Labels: app=kubernetes-dashboard
pod-template-hash=747085828
Status: Running
IP: 172.17.40.2
Controllers: ReplicaSet/kubernetes-dashboard-747085828
Containers:
kubernetes-dashboard:
Container ID: docker://5ac9c56ae81ceb37dae1c15e9a0d5b4d87cea5556c9cd92f5e667ac4659d815a
Image: docker.io/ist0ne/kubernetes-dashboard-amd64
Image ID: docker-pullable://docker.io/ist0ne/kubernetes-dashboard-amd64@sha256:faf7362425df7c542c65280ae15f2ba8e56a188d6999f4870b6821bb3ef5c637
Port: 9090/TCP
Args:
--apiserver-host=http://192.168.251.9:8080
State: Running
Started: Thu, 02 Mar 2017 14:52:39 +0800
Ready: True
Restart Count: 0
Liveness: http-get http://:9090/ delay=30s timeout=30s period=10s #success=1 #failure=3
Volume Mounts: <none>
Environment Variables: <none>
Conditions:
Type Status
Initialized True 
Ready True 
PodScheduled True 
No volumes.
QoS Class: BestEffort
Tolerations: dedicated=master:Equal:NoSchedule
Events:
FirstSeen LastSeen Count From SubobjectPath Type Reason Message
--------- -------- ----- ---- ------------- -------- ------ -------
2m 2m 1 {default-scheduler } Normal Scheduled Successfully assigned kubernetes-dashboard-747085828-0r767 to 192.168.251.231
<invalid> <invalid> 1 {kubelet 192.168.251.231} spec.containers{kubernetes-dashboard} Normal Pulling pulling image "docker.io/ist0ne/kubernetes-dashboard-amd64"
<invalid> <invalid> 2 {kubelet 192.168.251.231} Warning MissingClusterDNS kubelet does not have ClusterDNS IP configured and cannot create Pod using "ClusterFirst" policy. Falling back to DNSDefault policy.
<invalid> <invalid> 1 {kubelet 192.168.251.231} spec.containers{kubernetes-dashboard} Normal Pulled Successfully pulled image "docker.io/ist0ne/kubernetes-dashboard-amd64"
<invalid> <invalid> 1 {kubelet 192.168.251.231} spec.containers{kubernetes-dashboard} Normal Created Created container with docker id 5ac9c56ae81c; Security:[seccomp=unconfined]
<invalid> <invalid> 1 {kubelet 192.168.251.231} spec.containers{kubernetes-dashboard} Normal Started Started container with docker id 5ac9c56ae81c

当有多个node,可以用该命令中看到容器被分配到哪个node上,启动后分配的ip地址等信息.
如果在结果中看到"State: Running"时,请移步到node查看容器运行状态,应该也是up的状态.

 此时可以通过http://kube-apiserver:port/ui访问

http://192.168.251.9:8080/ui

7.监控之Docker监控——cadvisor k8s自带的单机版监控，每个node都有界面，

http://192.168.251.9:4194
http://192.168.251.231:4194/containers/

api接口 http://192.168.251.9:8080/swaager-ui

8. 注意点&遇到的问题:
1). 注意服务的启动顺序,特别是master,在确保etcd启动的情况下,先启动apiserver
2). 注意yaml文件的格式缩进.
3). 如果发现刚创建的pod的status是depening,原因可能有几点:其一,客户端配置有listen 127.0.0.1的服务,master无法与其建立连接;其二,环境初始化没有做好;其三,移步node,使用docker logs 查看日志
4). kubernetes-dashboard.yaml文件中的containers images地址目前为公开的,09月30日会关闭.
5). 如果自己有国外vps,可在服务器上创建docker registry;先pull下google的k8s dashboard,然后push到自己的registry,自己修改下yaml中的image即可.

9.参考文档：

https://kubernetes.io/docs/tutorials/
http://blog.csdn.net/dream_broken/article/details/52954069
http://blog.csdn.net/swcj/article/details/54969234
http://www.jb51.net/article/94343.htm
http://www.cnblogs.com/softlin/p/5675890.html
http://blog.csdn.net/freewebsys/article/details/52685592