问题描述
最近部署的k8s集群中的一个节点出现了问题,查询节点状态为
该问题节点能正常ssh登录,在上面执行 kubectl get pod 结果为:
[root@k8s-node1 kubernetes]# kubectl get pod
The connection to the server localhost:8080 was refused - did you specify the right host or port?
查找问题
查询日志
[root@k8s-node1 kubernetes]# journalctl -f -u kubelet
……
……
……
4月 13 16:00:29 k8s-node1 kubelet[35061]: F0413 16:00:29.657603 35061 server.go:273] failed to run Kubelet: failed to create kubelet: misconfiguration: kubelet cgroup driver: "systemd" is different from docker cgroup driver: "cgroupfs"
4月 13 16:00:29 k8s-node1 systemd[1]: kubelet.service: main process exited, code=exited, status=255/n/a
4月 13 16:00:29 k8s-node1 systemd[1]: Unit kubelet.service entered failed state.
4月 13 16:00:29 k8s-node1 systemd[1]: kubelet.service failed.
定位到问题:kubelet cgroup driver: “systemd” is different from docker cgroup driver: “cgroupfs”
解决方案
方案一(推荐)
将 /var/lib/kubelet/kubeadm-flags.env 文件中的–cgroup-driver=systemd 修改为
–cgroup-driver=cgroupfs
也就是docker配置项和kubelet的一致都是systemd。
方案二
临时将/etc/docker/daemon.json中的对应参数修改为cgroupfs
[root@node1 ~]# cat /etc/docker/daemon.json
{
"exec-opts": ["native.cgroupdriver=cgroupfs"],
"registry-mirrors": ["http://hub-mirror.c.163.com"]
}