Alexandre DERUMIER
2015-10-13 12:20:37 UTC
Hi,
I have finished to migrate a small 5 nodes cluster from proxmox3 to proxmox4,
using qemu live migration.
Here the howto:
requirements:
-------------
external storage (nfs,ceph).
don't have tested with clvm + iscsi, or local ceph(which should work)
1)Upgrade a first node to proxmox 4.0 and recreate cluster
------------------------------------------------------------
Have an empty node,
then upgrade it to proxmox 4.0, folowing the current wiki
# apt-get update && apt-get dist-upgrade
# apt-get remove proxmox-ve-2.6.32 pve-manager corosync-pve openais-pve redhat-cluster-pve pve-cluster pve-firmware
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list.d/pve-enterprise.list
# apt-get update
# apt-get install pve-kernel-4.2.2-1-pve
# apt-get dist-upgrade
reboot
# apt-get install proxmox-ve
# apt-get remove pve-kernel-2.6.32-41-pve
# pvecm create <clustername>
2) upgrade second node
----------------------
# apt-get update && apt-get dist-upgrade
# apt-get remove proxmox-ve-2.6.32 pve-manager corosync-pve openais-pve redhat-cluster-pve pve-cluster pve-firmware
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list.d/pve-enterprise.list
# apt-get update
# apt-get install pve-kernel-4.2.2-1-pve
# apt-get dist-upgrade
---> here no reboot
# apt-get install proxmox-ve
if, apt return an error like:
"Setting up pve-manager (4.0-48) ...
Failed to get D-Bus connection: Unknown error -1
Failed to get D-Bus connection: Unknown error -1
dpkg: error processing package pve-manager (--configure):
subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of proxmox-ve:
proxmox-ve depends on pve-manager; however:
Package pve-manager is not configured yet.
dpkg: error processing package proxmox-ve (--configure):
dependency problems - leaving unconfigured
Errors were encountered while processing:"
then,
# touch /proxmox_install_mode
# apt-get install proxmox-ve
# rm /proxmox_install_mode
now the tricky part
mount /etc/pve
# /usr/bin/pmxcfs -l
add node to cluster
# pvecm add ipofnode1 -force
close old corosync and delete old config
# killall -9 corosync
# /etc/init.d/pve-cluster stop
# rm /var/lib/config.db*
start new corosync and pve-cluster
# corosync
# /etc/init.d/pve-cluster start
verify than you can write in /etc/pve/ and that's is correctly replicate on other proxmox4 nodes
#touch /etc/pve/test.txt
#rm /etc/pve/test.txt
migrate vms (do it for each vmid)
# qm migrate <vmid> <target_proxmox4_server> -online
(migrate must do done with cli, because pvestatd can't start without systemd, so gui is not working)
# reboot node
3) do the same thing for next node(s)
4) when all nodes are migrated, remove
# rm /etc/pve/cluster.conf
I have finished to migrate a small 5 nodes cluster from proxmox3 to proxmox4,
using qemu live migration.
Here the howto:
requirements:
-------------
external storage (nfs,ceph).
don't have tested with clvm + iscsi, or local ceph(which should work)
1)Upgrade a first node to proxmox 4.0 and recreate cluster
------------------------------------------------------------
Have an empty node,
then upgrade it to proxmox 4.0, folowing the current wiki
# apt-get update && apt-get dist-upgrade
# apt-get remove proxmox-ve-2.6.32 pve-manager corosync-pve openais-pve redhat-cluster-pve pve-cluster pve-firmware
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list.d/pve-enterprise.list
# apt-get update
# apt-get install pve-kernel-4.2.2-1-pve
# apt-get dist-upgrade
reboot
# apt-get install proxmox-ve
# apt-get remove pve-kernel-2.6.32-41-pve
# pvecm create <clustername>
2) upgrade second node
----------------------
# apt-get update && apt-get dist-upgrade
# apt-get remove proxmox-ve-2.6.32 pve-manager corosync-pve openais-pve redhat-cluster-pve pve-cluster pve-firmware
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list.d/pve-enterprise.list
# apt-get update
# apt-get install pve-kernel-4.2.2-1-pve
# apt-get dist-upgrade
---> here no reboot
# apt-get install proxmox-ve
if, apt return an error like:
"Setting up pve-manager (4.0-48) ...
Failed to get D-Bus connection: Unknown error -1
Failed to get D-Bus connection: Unknown error -1
dpkg: error processing package pve-manager (--configure):
subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of proxmox-ve:
proxmox-ve depends on pve-manager; however:
Package pve-manager is not configured yet.
dpkg: error processing package proxmox-ve (--configure):
dependency problems - leaving unconfigured
Errors were encountered while processing:"
then,
# touch /proxmox_install_mode
# apt-get install proxmox-ve
# rm /proxmox_install_mode
now the tricky part
mount /etc/pve
# /usr/bin/pmxcfs -l
add node to cluster
# pvecm add ipofnode1 -force
close old corosync and delete old config
# killall -9 corosync
# /etc/init.d/pve-cluster stop
# rm /var/lib/config.db*
start new corosync and pve-cluster
# corosync
# /etc/init.d/pve-cluster start
verify than you can write in /etc/pve/ and that's is correctly replicate on other proxmox4 nodes
#touch /etc/pve/test.txt
#rm /etc/pve/test.txt
migrate vms (do it for each vmid)
# qm migrate <vmid> <target_proxmox4_server> -online
(migrate must do done with cli, because pvestatd can't start without systemd, so gui is not working)
# reboot node
3) do the same thing for next node(s)
4) when all nodes are migrated, remove
# rm /etc/pve/cluster.conf