单机运行k8s以及e2e

 

1.在本机启动单机版k8s

 

/home/opama/workspace/k8s/src/k8s.io/kubernetes# hack/local-up-cluster.sh

Go version: go version go1.6.2 linux/amd64
+++ [1004 21:39:33] Building the toolchain targets:
    k8s.io/kubernetes/hack/cmd/teststale
+++ [1004 21:39:33] Building go targets for linux/amd64:
    cmd/kubectl
    cmd/hyperkube
+++ [1004 21:41:08] Placing binaries
curl: (7) Failed to connect to 127.0.0.1 port 8080: 拒绝连接
API SERVER port is free, proceeding...
Detected host and ready to start services.  Doing some housekeeping first...
Using GO_OUT /home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/bin/linux/amd64
Starting services now!
Starting etcd
etcd -addr 127.0.0.1:4001 -data-dir /tmp/tmp.S62jgzua1y --bind-addr 127.0.0.1:4001 --debug > "/dev/null" 2>/dev/null
Waiting for etcd to come up.
+++ [1004 21:41:09] On try 1, etcd: :
{"action":"set","node":{"key":"/_test","value":"","modifiedIndex":3,"createdIndex":3}}
Waiting for apiserver to come up
+++ [1004 21:41:11] On try 2, apiserver: : {
  "kind": "PodList",
  "apiVersion": "v1",
  "metadata": {
    "selfLink": "/api/v1/pods",
    "resourceVersion": "10"
  },
  "items": []
}
Local Kubernetes cluster is running. Press Ctrl-C to shut it down.

Logs:
  /tmp/kube-apiserver.log
  /tmp/kube-controller-manager.log
  /tmp/kube-proxy.log
  /tmp/kube-scheduler.log
  /tmp/kubelet.log

To start using your cluster, open up another terminal/tab and run:

  export KUBERNETES_PROVIDER=local

  cluster/kubectl.sh config set-cluster local --server=http://127.0.0.1:8080 --insecure-skip-tls-verify=true
  cluster/kubectl.sh config set-context local --cluster=local
  cluster/kubectl.sh config use-context local
  cluster/kubectl.sh

 

 

2.看一下是否运行成功

/home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/bin# mkdir /home/opama/kube-release
/home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/bin# mv linux /home/opama/kube-release/
/home/opama/kube-release/linux/amd64# cp -p kubectl /bin/
/home/opama/kube-release/linux/amd64# kubectl get node

NAME        STATUS    AGE
127.0.0.1   Ready     11m

 

 

3.本机运行下e2e用例

 

/home/opama/workspace/k8s/src/k8s.io/kubernetes# KUBERNETES_PROVIDER=local go run hack/e2e.go -v -test  --test_args='"--host=http://127.0.0.1:8080" --ginkgo.focus="Secrets"'

2016/10/04 22:14:42 e2e.go:212: Running: get status
Local doesn't need special preparations for e2e tests
Client Version: version.Info{Major:"1", Minor:"3+", GitVersion:"v1.3.1-dirty", GitCommit:"fe4aa01af2e1ce3d464e11bc465237e38dbcff27", GitTreeState:"dirty", BuildDate:"2016-09-15T15:47:40Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}
error: server version (&version.Info{Major:"1", Minor:"3", GitVersion:"v1.3.1.1+9ec21ad3522752", GitCommit:"9ec21ad3522752415c2f82db9f6aa1117dbe583d", GitTreeState:"clean", BuildDate:"2016-10-04T13:39:33Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}) differs from client version (version.Info{Major:"1", Minor:"3+", GitVersion:"v1.3.1-dirty", GitCommit:"fe4aa01af2e1ce3d464e11bc465237e38dbcff27", GitTreeState:"dirty", BuildDate:"2016-09-15T15:47:40Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"})!
2016/10/04 22:14:42 e2e.go:218: Error running get status: exit status 1
2016/10/04 22:14:42 e2e.go:214: Step 'get status' finished in 49.723737ms
2016/10/04 22:14:42 e2e.go:189: Testing requested, but e2e cluster not up!
exit status 1

发现是版本不符合，手动指定kubectl，中间还会遇到node数目检查，我直接修改e2e.go中的minNodeCount=1了

 

/home/opama/workspace/k8s/src/k8s.io/kubernetes# export KUBECTL_PATH=/bin/kubectl
/home/opama/workspace/k8s/src/k8s.io/kubernetes# cluster/kubectl.sh version
Client Version: version.Info{Major:"1", Minor:"3", GitVersion:"v1.3.1.1+9ec21ad3522752", GitCommit:"9ec21ad3522752415c2f82db9f6aa1117dbe583d", GitTreeState:"clean", BuildDate:"2016-10-04T13:39:33Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"3", GitVersion:"v1.3.1.1+9ec21ad3522752", GitCommit:"9ec21ad3522752415c2f82db9f6aa1117dbe583d", GitTreeState:"clean", BuildDate:"2016-10-04T13:39:33Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}version
Client Version: version.Info{Major:"1", Minor:"3+", GitVersion:"v1.3.1-dirty", GitCommit:"fe4aa01af2e1ce3d464e11bc465237e38dbcff27", GitTreeState:"dirty", BuildDate:"2016-09-15T15:47:40Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"3", GitVersion:"v1.3.1.1+9ec21ad3522752", GitCommit:"9ec21ad3522752415c2f82db9f6aa1117dbe583d", GitTreeState:"clean", BuildDate:"2016-10-04T13:39:33Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}

 

 

创建config文件

 

vim /root/.kube/config
{
  "User": "root",
  "Password": ""
}

 

本机运行Conformance的e2e用例

/home/opama/workspace/k8s/src/k8s.io/kubernetes# KUBERNETES_PROVIDER=local go run hack/e2e.go -v -test  --test_args="--host=http://127.0.0.1:8080 --ginkgo.focus=[Conformance] --ginkgo.skip=[Serial]"

2016/10/04 23:09:41 e2e.go:212: Running: get status
Local doesn't need special preparations for e2e tests
Client Version: version.Info{Major:"1", Minor:"3", GitVersion:"v1.3.1.1+9ec21ad3522752", GitCommit:"9ec21ad3522752415c2f82db9f6aa1117dbe583d", GitTreeState:"clean", BuildDate:"2016-10-04T13:39:33Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"3", GitVersion:"v1.3.1.1+9ec21ad3522752", GitCommit:"9ec21ad3522752415c2f82db9f6aa1117dbe583d", GitTreeState:"clean", BuildDate:"2016-10-04T13:39:33Z", GoVersion:"go1.6.2", Compiler:"gc", Platform:"linux/amd64"}
2016/10/04 23:09:42 e2e.go:214: Step 'get status' finished in 49.630847ms
Local doesn't need special preparations for e2e tests
2016/10/04 23:09:42 e2e.go:212: Running: Ginkgo tests
Conformance test: not doing test setup.
I1004 23:09:42.300288    7565 e2e.go:243] Starting e2e run "93b93584-8a44-11e6-ba64-2c768adbb5f8" on Ginkgo node 1
Running Suite: Kubernetes e2e suite
===================================
Random Seed: 1475593782 - Will randomize all specs
Will run 95 of 324 specs

Oct  4 23:09:42.319: INFO: >>> kubeConfig: /root/.kube/config

Oct  4 23:09:42.322: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready
Oct  4 23:09:42.327: INFO: Waiting for pods to enter Success, but no pods in "kube-system" match label map[name:e2e-image-puller]
Oct  4 23:09:42.328: INFO: 0 / 0 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
Oct  4 23:09:42.328: INFO: expected 0 pod replicas in namespace 'kube-system', 0 are Running and Ready.
Oct  4 23:09:42.329: INFO: Waiting for pods to enter Success, but no pods in "kube-system" match label map[name:e2e-image-puller]
Oct  4 23:09:42.329: INFO: Dumping network health container logs from all nodes
SSSSSS
------------------------------
[k8s.io] Pods

注意的是，很多默认的gcr.io镜像是下载不下来的，所以会出错，还是需要去改的

 

运行自己的用例如把ReplicasSet复制重命名为ReplicaSetMali保存在rs_mali.go

export KUBERNETES_PROVIDER="local" 
export KUBE_MASTER_IP="127.0.0.1:8080"
export KUBE_MASTER="opama-HP-EliteBook-8560w"

执行

go run hack/e2e.go -v -test  --test_args="--host=http://127.0.0.1:8080 --ginkgo.focus=ReplicaSetMali"

修改后重新编译e2e 

go install ./test/e2e
make WHAT=test/e2e/e2e.test 

 会遇到一些错误，如解析版本号失败：

 

? Failure [17.150 seconds]
[k8s.io] ReplicaSetMali
/home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:685
  should serve a basic image on each replica with a public image [mali] [It]
  /home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/rs_mali.go:40
 
  Expected error:
      <*errors.errorString | 0xc8203ed530>: {
          s: "Unable to parse server version "v1.3.1.1+9ec21ad3522752": Invalid character(s) found in patch number "1.1"",
      }
      Unable to parse server version "v1.3.1.1+9ec21ad3522752": Invalid character(s) found in patch number "1.1"
  not to have occurred

 

 如取到的podname含特殊字符：

Oct  5 12:50:29.746: INFO: Controller my-hostname-basic-f2fde265-8ab6-11e6-85bb-2c768adbb5f8: Replica 2 [my-hostname-basic-f2fde265-8ab6-11e6-85bb-2c768adbb5f8-ekio4] expected response "my-hostname-basic-f2fde265-8ab6-11e6-85bb-2c768adbb5f8-ekio4" but got "my-hostname-basic-f2fde265-8ab6-11e6-85bb-2c768adbb5f8-ekio4
"

 

修改了函数的实现

err = wait.Poll(retryInterval, retryTimeout, framework.PodProxyResponseChecker(f.Client, f.Namespace.Name, label, name, true, pods).CheckAllResponses)

 

 最后运行成功

P [PENDING]
[k8s.io] ReplicaSetMali
/home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:685
  should serve a basic image on each replica with a private image
  /home/opama/workspace/k8s/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/rs_mali.go:47
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
Ran 1 of 326 Specs in 17.141 seconds
SUCCESS! -- 1 Passed | 0 Failed | 1 Pending | 324 Skipped PASS