Rook-Ceph v1.8 部署指南

0478yhl

如果你想加块盘

确保你的盘是原始盘，且没分区格式化
1.如果不是让他变为没分区格式化
wipefs --all /dev/sdb
#dd删除数据谨慎操作
#dd if=/dev/zero of=/dev/sdb bs=1M count=10
2.修改 cephcluster.rook-ceph
kubectl edit cephcluster rook-ceph -n rook-ceph
...
 - name: "10.0.0.1"
        devices:
          - name: "sdc"
          - name: "你加盘的路径/dev/xxxx"
      - name: "10.0.0.1"
        devices:
          - name: "sdc"
...
#类似这样修改
3.重启operator等待即可
如何要添加新增节点的盘(!!!!)
记得加标签
 kubectl label nodes 10.5.1.66  ceph-osd=enabled

Gitxuxu99

rook-ceph csi-cephfsplugin-2l2wc 3/3 Running 0 10m 10.233.48.41 k8s-3-master-songxu-test.novalocal <none> <none>
rook-ceph csi-cephfsplugin-6r224 3/3 Running 0 10m 10.233.48.18 k8s-2-node-songxu-test.novalocal <none> <none>
rook-ceph csi-cephfsplugin-c7vm9 3/3 Running 0 10m 10.233.48.19 k8s-2-master-songxu-test.novalocal <none> <none>
rook-ceph csi-cephfsplugin-provisioner-5959d46646-bdp5j 6/6 Running 0 10m 192.168.248.182 k8s-2-node-songxu-test.novalocal <none> <none>
rook-ceph csi-cephfsplugin-provisioner-5959d46646-r8229 6/6 Running 0 10m 192.168.109.244 k8s-1-master-songxu-test.novalocal <none> <none>
rook-ceph csi-cephfsplugin-wmfbq 3/3 Running 0 10m 10.233.48.37 k8s-1-node-songxu-test.novalocal <none> <none>
rook-ceph csi-cephfsplugin-z8w2x 3/3 Running 0 10m 10.233.48.13 k8s-1-master-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-4pjcw 3/3 Running 0 10m 10.233.48.13 k8s-1-master-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-7fzz2 3/3 Running 0 10m 10.233.48.37 k8s-1-node-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-g64zh 3/3 Running 0 10m 10.233.48.19 k8s-2-master-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-provisioner-5475ccfd56-cgqc6 6/6 Running 0 10m 192.168.82.130 k8s-1-node-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-provisioner-5475ccfd56-nh4xw 6/6 Running 0 10m 192.168.143.35 k8s-3-master-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-qjpk6 3/3 Running 0 10m 10.233.48.18 k8s-2-node-songxu-test.novalocal <none> <none>
rook-ceph csi-rbdplugin-sskl8 3/3 Running 0 10m 10.233.48.41 k8s-3-master-songxu-test.novalocal <none> <none>
rook-ceph rook-ceph-mon-a-76cf69966d-q8bl5 1/1 Running 0 10m 192.168.0.199 k8s-2-master-songxu-test.novalocal <none> <none>
rook-ceph rook-ceph-mon-b-8df84f4b8-gzglc 1/1 Running 0 6m23s 192.168.143.37 k8s-3-master-songxu-test.novalocal <none> <none>
rook-ceph rook-ceph-operator-65557ccf4-sbj4n 1/1 Running 0 10m 192.168.109.250 k8s-1-master-songxu-test.novalocal <none> <none>

为啥我只创建出这些pod，osd初始化没有，mgr也没有

Gitxuxu99

3.10.0-862.11.6.el7.x86_64 我是这个版本内核
有可能是内核问题吗？

SmallQi

Gitxuxu99
Image description

Gitxuxu99

SmallQi 我升级下内核试试

Gitxuxu99

SmallQi 感谢大佬

Gitxuxu99

SmallQi 内核升级到5.4.13 k8s版本v1.20.9 还是装了mon就没往下走了

Gitxuxu99

Image description

Gitxuxu99

版主有时间帮忙看看？
Image description

Gitxuxu99

解决了，没有删除旧的配置， rm -rf /var/lib/rook/*

Gitxuxu99

Image description
版主遇到过这种问题吗？

Gitxuxu99

Gitxuxu99 搞定
ceph config set mgr.a mgr/dashboard/server_addr 10.0.0.95
需要创建一个mgr地址

Gitxuxu99

Gitxuxu99 这个需要部署monitoring

Gitxuxu99

Gitxuxu99 这个是把dashboard 端口暴露了以后web无法访问设置的

SmallQi

Gitxuxu99 默认应该是没开启monitor的，开启monitor还有配置其他很多东西

Gitxuxu99

SmallQi 你有配置文档吗

SmallQi

Gitxuxu99 可以通过 rainbond 第三方组件代理访问