Most of the commands in LVM are very similar to each other. Nov 1, 2016 · Running kernel seems to be up-to-date. <sid>: <type>:<name>. Virtual machine images can either be stored on one or several local storages or on shared storage like NFS and on SAN. I recovered the cluster like this on each server : killall -9 corosync systemctl restart pve-cluster systemctl restart pvedaemon systemctl restart pvestatsd But Apr 26, 2014 · Hi All, today i tried to edit my interfaces config and after i edited the file i tried to reload the configuration with the command service networking restart, at that point all my vm's froze and didn't respond…. 4 to version 8. service Note that a reboot is cleaner and really recommended. Jan 12, 2017. Under Datacenter → Cluster, click on Create Cluster. Click on the vmbr0 interface and then click on edit. shutdown all VMs as per the order specified in the options. From the ceph doc : 'sudo /etc/init. These three servers are configured in a cluster and have high availability using CEPH. root@proxmox00:~#. pve-restart. Oct 22, 2010 · I had to electrically restart the server too, it won't gently stop or reboot (waiting endlessly for the zfs pool to stop/detach). To activate these settings, you need to restart the multipath daemon with: # systemctl restart multipath-tools. Now "qm shutdown VMID" works fine. The migration works fine. 1:82. NOTE: The daemon listens to a local address only, so you cannot access it from outside. I would expect that realtek card to be enp4s0f(0-3) with ip a if a 4 port card. TLS versions below 1. 'sudo service ceph -a stop' but there is no ceph service defined. Should solve the issue. For those of us that don't know all Apr 25, 2024 · Maximal number of service relocate tries when a service failes to start. Proxmox 7 with all updates. 168. Enable IPv6 Forwarding. start all VMs in order specified in the options. 10-1-pve Mon Aug 30 14:29 still running Aug 30 14:23:22 node1 pmxcfs[2262]: [status] notice Dec 24, 2021 · auto lo iface lo inet loopback iface eno1 inet manual auto vmbr0 iface vmbr0 inet static address 192. First, login to the Proxmox web console. # systemctl status proxmox-backup. I have a 3 node setup. 99. Apr 24, 2013 · Feb 10, 2020. It runs as root and has permission to do all privileged operations. We recommend leaving all settings at the provided defaults. 4 running and I want to apply some network changes without rebooting my proxmox host. Description. 11 Upgrade all CephFS MDS daemons. service Prioritizing a Certain TCP/IP Path. docker restart. lamprecht said: Restart those pve-ha-lrm services (under Node → System) where the HA Status ( Datacenter → HA) shows something else than "idle". pveversion -v output proxmox-ve: 7. I was able to safely shut down my KVMs on the same box, using the qm shutdown commands via SSH. See Debian Appliance Builder. Dec 13, 2020 · I recently changed the IP and hostname of a pve server. Backing up and restoring Proxmox configuration files is crucial for ensuring the integrity of your virtualization environment. Buy now! Sep 17, 2023 · Check to ensure that you can log into the NEW Proxmox server with the restored configurations. apt install promox-backup-server. 10 Disallow pre-Octopus OSDs and enable all new Octopus-only functionality. Hi everybody, I'm getting an issue with my Proxmox v5, I create a new interface to use the nat method, however, after restarting the network all VMS is disconnected to the internet. As of Proxmox VE 7, chrony is used as the default NTP daemon, while Proxmox VE 6 uses systemd-timesyncd. We would like to show you a description here but the site won’t allow us. Oct 27, 2023 · Nov 08 15:55:38 P-SRV01 systemd[1]: Failed to start pve-cluster. #1. Then restart all managers on all nodes systemctl restart ceph-mgr. If you upgrade your system to Proxmox VE 7, it is recommended that you manually install Maximal number of service relocate tries when a service failes to start. Restarting services systemctl restart pve-firewall. 6. Containers are tightly integrated with Proxmox VE. cnf ). If it does not, this implies that one or more monitors haven’t been upgraded and restarted, and/or that the quorum doesn't include all monitors. Nov 2, 2023. Now, after a reboot I cannot access to web interface from any server: login to ssh its ok but from web interface (tested in many browser) always return connection refued. ha-manager set<sid>[OPTIONS] Update resource configuration. Sep 12 14:13:06 prox systemd[1]: Condition check resulted in Corosync Cluster Engine being skipped. 19-4 (Mon, 29 Nov 2021 12:10:09 +0100) x86_64 based on when I ssh in. Time synchronization between nodes can be achieved using the “Network Time Protocol” ( NTP ). Everything seems to work almost fine. Connecting to any of the nodes via SSH, I can confirm Network is set up right but Jan 17, 2022 · I installed Proxmox on 3 new server and all the procedure from the iso went ok. service No containers need to be restarted. Mar 25, 2021 · VM is disconected the internet after restart network. Good afternoon. Oct 20, 2011 · A. Cluster has ceph filesystem (nodes proxmox0-7 plus an additional ceph-monitor machine). 1 bridge-ports eno1 bridge-stp off bridge-fd 0 iface enp4s0 inet manual iface wlp3s0 inet manual . The “Proxmox Container Toolkit” ( pct) simplifies the usage and management of LXC, by providing an interface that abstracts complex tasks. service pveproxy. conf (5) snippet file and setting the proper sysctls , for example adding /etc/sysctl Dec 30, 2012 · ksm-control-daemon: 1. Best regards, Dietmar. It defaults to the IP resolved via the node’s hostname. No user sessions are running outdated binaries. 1 are disabled by default on recent OpenSSL versions, which is honored by pveproxy (see /etc/ssl/openssl. Keep going, they all must die ;) Restarting Proxmox services. “service networking restart” “service pveproxy restart” Aug 1, 2011 · Jun 15, 2012. Select your node and then click on Network. Jul 1, 2021 · Here are the commands to restart proxmox services for troubleshooting purposes. Firewall - Proxmox VE. Also restarting VM’s fails with error: TASK ERROR: storage 'proxmox-images' is not online. Especially when (also) using PCI passthrough and VMs that start automatically on boot, which tend to freeze or restart the host when the wrong devices are chosen. If periodic updates and unattended upgrades are enabled, the start of. it installs, I go to the IP addresses for each of these servers and there's nothing there, I can ping the devices so they're up but the pinwheel just spins then times out. May 24, 2012 · The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. This absolutely was happening frequently on other CTs on that other host I figure is broken somehow. 2 Add the Proxmox Backup Server 3 Package Repository. HA resource ID. Of course replace $WHATEVERNAMEGOESHERE with the actual name of each service you want to restart. service. 0 is there, but not showing up with ip a. 1-2 from the official download. While not necessary Sep 28, 2021 · Staff member. Dump the partition table. Proxmox VE Firewall provides an easy way to protect your IT infrastructure. One cluster (cluster A) was updated from version 5 to 8, the other (cluster B) was initially already version 7. 6 Upgrade on each Ceph cluster node. proxmox. Dear all, We have a 8 node proxmox cluster running badly. Also I had to kill all proxmox-backup-client processes to get by PVE instance work like it should again, because the Backup Job could not be stopped by the GUI. Thank you. As a workaround, add proper entries for PRMX1 (and PRMX2) and restart the service. I have tried to stop it though the GUI/Web but it still keeps going. Restarting some of the proxmox services, will briefly start updating KVM's again, but after about 30 seconds, it stops again. Note: Do not select the physical interface! The insecure SSL versions 2 and 3 are unconditionally disabled for pveproxy. If I try from ssh console to connect Apr 20, 2015 · The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. 2. In the meantime, run "mount proc /proc -t proc". The full featured mail proxy can be easily deployed between the firewall and your internal mail server in just a few minutes. 4 Check Result & Reboot Into Updated Kernel. service systemctl restart pvedaemon. service pvestatd. so the last one is systemctl ? Aug 4, 2008 · Double click on it, change it to "Enabled". Dec 22, 2016 · The Proxmox interface stoped updating all VM and container data. Most of the time it requires some services to be restarted, usually after the culprit is found and eredicated, be that some STOP tasks never stopping but putting the CT in iowait, rbd which was screwed by outside factors (in the last month usually pbs Proxmox VE version info - Print version information for Proxmox VE packages. Sep 2, 2022 · Hi, On my proxmox cluster, every nodes were red in the webUI, like if something went wrong with multicast, anyway every VMs were OK. target Verify that the ceph-mgr daemons are running by checking ceph -s ceph -s Aug 28, 2022 · While the cluster information is removed; when attempting to join the cluster, I get the following: Code: detected the following error(s): * this host already contains virtual guests. Than try to reinstall. Linux 5. service; IPv4 Cluster Note: Assign /32 IPv4 addresses to the loopbacks instead of the fc00::x/128 addresses . check version: apt list hp-ams should return: hp-ams/stretch,now 2. 22-3-pve add proxmo backup repo apt install promox-backup-server Dec 17, 2021 · In the "Cluster Configuration" dialog, set the "Quorum Policy" option to "ignore". Nov 14, 2019 · At 14:29 and 14:46 All nodes restart automatically at the same time； last | grep -i boot reboot system boot 5. Discover the tasks by issuing ps aux | grep vzdump and kill them off one by one by issuing kill -9 PID. The job identifier is 12193 and the job result is failed. Sep 12, 2021 · Sep 12 14:13:06 prox systemd[1]: Failed to start The Proxmox VE cluster filesystem. NiKaro said: When i restart pvedaemon service (which in fact is done by needrestart utility after apt upgrade) my LXC containers does not restart. When forwarding USB to a virtual machine (cluster B), the changes Nov 2, 2021 · Have cluster with 4 nodes. Oct 18, 2019 · The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. With these steps, you can confidently create backups and recover your Proxmox server configurations when needed. Nov 2, 2023 · 1. I have made the following investigation: 1. I noticed that in order to forward a USB device to a virtual machine (cluster A), you need to reboot the machine to accept the changes. 4-3 My scheduled backups will not run unless I run the following on my proxmox server: systemctl stop pvescheduler systemctl start pvescheduler After I do this the scheduled backup triggers and runs but it will not run daily as it is set to do. You can use all storage technologies available for Debian Linux. Question - is there a simple way to restart all ceph services on a node? May 7, 2021 · For virtual machines and containers, you can simply use the VM or CT id as a shortcut (example: 100). 4. May 7, 2021 · Create via Web GUI. conf. 99 should be prioritized (where other IP routes will be used as failover), the default section should be as follows: By using Proxmox Mail Gateway, all your email traffic is forwarded to the Proxmox Mail Gateway instance, which filters the email traffic and removes unwanted emails. Previously before we managed to add a HA Resource, the list only contained the quorum. com. service systemctl restart pveproxy. ) temporarily set something really high for the node-wide start delay at "YourNode -> System -> Options -> Start on boot delay". 3 Following the Proxmox Backup Server upgrade. 19-2-pve #1 SMP PVE 5. service systemctl restart pve-cluster. 13. service - The Proxmox VE cluster filesystem. There’s no explicit limit for the number of nodes in a cluster. ) kill the "Starting all guests" task so it will only try to start the first VM and skip all the other ones. Find the entry named "Display Shutdown Event Tracker". An external SAS storage is used as the main shared storage in LVM mode. Specifically, these nodes would disconnect and reconnect until we restarted the pve-cluster service. Considering your scenario, restarting one service at a time may be prudent. Mar 12, 2013 · www. systemctl restart pveproxy. that's how fencing works - each node has Nov 24, 2022 · Nov 24, 2022. 10-1-pve Mon Aug 30 14:46 still running reboot system boot 5. or, respectively: DISABLE_TLS_1_3=1. go ahead and install the package: apt-get install hp-ams. e. Get yours easily in our online shop. The Proxmox VE cluster manager pvecm is a tool to create a group of physical servers. add proxmo backup repo. Each valid command is preceded by one of the following: Physical Volume = pv; Volume Group = vg; Logical Volume = lv; Debian Appliance Builder dab. 1 installed. May 24, 2012 · Hello, currently we reboot each node when there are ceph package upgrades. a) fencing should be different, i. It is commonly used to apply changed to the virtual hardware configuration (which Proxmox does in between the shutdown and start) without having to shutdown and wait for it Jan 15, 2014 · To mount /proc at boot you need an /etc/fstab line like: proc /proc proc defaults. Proxmox doesn't support any dependency tracking between VMs. Dec 19, 2023 · Backup Server 2. Dec 8, 2019 · Unfortunately, I cannot access the web GUI on startup. . Nov 26, 2020 · The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. You can setup firewall rules for all hosts inside a cluster, or define rules for virtual machines and containers. All virtual machines on the node are Jan 3, 2014 · I just tried the Tuxis PBS and ran into kinda the same issue. Adding nodes in the future Mar 30, 2022 · Hi, I did an update of my server and after the reboot, cannot access the web gui. #6. Apr 12, 2021. 3, set the following in /etc/default/pveproxy: DISABLE_TLS_1_2=1. 0. We use the Corosync Cluster Engine for reliable group communication. I tried to restart the pveproxy service and the log shows “permission Feb 21, 2015 · The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. glusterfs-client: 3. Restart the manager daemons on all nodes. An other, but unsupported, way to bring the changes in effect would be to restart all related services, like: systemctl restart corosync. Proxmox is nothing more than Debian Linux. and I had to ssh into it instead. max_restart: <integer> (0 - N) (default = 1) Maximal number of tries to restart the service on a node after its start failed. systemctl restart pvedaemon. Oct 28, 2019 · Jan 9, 2020. We experienced problems on the cluster and now ceph is down. The proxmox-backup-proxy daemon exposes the API to the outside world. service after install PBS. 1/8 scope May 21, 2020 · Jan 2, 2021. 2-1. Jan 6, 2006 · But when I am looking at proxmox webpage (the gateway) I can see the folowing under "Server administration": "SMTP stopped Simple Mail Tranfer Protocol" when I try to restart service I still get "SMTP stopped" When I try just to start I still get "SMTP stopped" All other services is working when I press stop/start. 5 Set the 'noout' flag. Grow faster together. Restart the cluster service by running the following command on all nodes in the cluster: systemctl restart pve-cluster After making these changes, your Proxmox cluster will be quorate even if only one node is present. 192/24 gateway 192. May 14, 2020 · But what you can try is , if you still want to reinstall again, take the disks out and clear them on enouther machine with gdisk or fdisk. An alias is a short or memorable alternative for a longer command. I've got Proxmox 4. t. so i tried rebooting the server to try if they worked after, well they didn't work Apr 11, 2024 · So I have 5 Dell Poweredge R415s. sh This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. Jan 10, 2022 · All VMs are setup to start and shutdown in a specific order. Oct 15, 2008 · 83. We changed from chrony to the time synchronization like described in the wiki and get the output like shown in the wiki: Code: The Proxmox VE cluster manager pvecm is a tool to create a group of physical servers. 3 Upgrade the System. Be aware that restarting network stack kills of the tap (virtual network) interfaces to the VMs. apt (1. To review, open the file in an editor that reveals hidden Unicode characters. :rolleyes: now I can't get the pve-cluster to start. Hi ! I would like to reboot all ceph daemons after a config change. The problem is that sometimes (once or twice a week) one of the nodes (the same one) becomes red. Half of the 11 cluster nodes stopped functioning properly, which has caused significant problems for our infrastructure. pve-cluster: root@DC-BS7-PM4:~# systemctl status pve-cluster -n 30 Jan 30, 2018 · Feb 1, 2018. A start job for unit pve-cluster. Jan 30, 2020 · Feb 3, 2020. Apr 11, 2021 · 6,024. In practice, the actual possible node count may be limited by the host and network performance. Enter the cluster name and select a network connection from the dropdown to serve as the main cluster network (Link 0). 1 Check Status of Services. 1,566. B. Proxmox server send me email. Proxmox Mail Gateway provides a powerful and affordable server solution to eliminate spam, viruses and blocking undesirable content from your e-mail system. my interface configure below auto lo iface lo inet loopback iface ens33 inet manual auto vmbr0 iface vmbr0 May 30, 2019 · Hi All, I restarted my proxmox server that has been running fine for a few months and now the proxmox services don't seem to be starting. Hello, Has anyone in the community ever made a restart all services script for Proxmox, a core services restart, or service status script or even a debug script to show pveversion, ifconfig, lock status on the vm, etc and other information that the proxmox team would need right off the bat. Buy now! The Proxmox VE storage model is very flexible. You will either see the blue box of grub or the simple black on white systemd-boot. Proxmox node finds itself isolated, understands that has to "suicide" then stops/kills all KVM processes (or LXC or whatever), logs the fact, syncs the local storage (where logs are located) then does a clean "reboot" or if you think is risky, a "reset". It happened 2 times in four days on different VMs, in my case there is no backup tasks yet on the VMs running on that server. Restart one or more containers. systemctl restart pve-cluster. Jun 19, 2019 · it may also be important: - our Firewall has a "deny all" rule, for time sync only the default udp port 123 is open. Apr 18, 2012 · Feb 1, 2013. 7 Restart the monitor daemon. There are no limits, you may configure as many storage definitions as you like. 22-3-pve. Click the "Save" button to apply the changes. 1 Update Debian Base Repositories to Bookworm. state: <disabled | enabled | ignored | started | stopped> (default = started) Requested resource state. May 17, 2022 · The next step is to get rid of all the backup jobs currently frozen in time. Anyway, what you actually want to track is that service B Jun 29, 2023 · hello all i prepare the upgrade to proxmox 8 and run the script pve7to8. Both come preconfigured to use a set of public servers. 2. The exact commands I used are below. Yesterday at 4 node, some of pve services failed to start. Other useful tools Feb 14, 2024 · I have encountered an issue after upgrading our Proxmox cluster from version 7. 11. service pvedaemon. Drill into Computer Configuration / Administrative Templates / System. Such a group is called a cluster. service: Scheduled restart job, restart counter is at 2. 2) unstable; urgency=medium. 00. killall -9 corosync. Buy now! failed to start proxmox-backup-proxy. A Reboot is a (graceful) Shutdown followed by a Start, much like rebooting a physical machine using the "shutdown and restart" option. systemctl restart pvestatd. Nov 08 15:55:39 P-SRV01 systemd[1]: Stopped pve-cluster. Oct 5, 2022 · 2. service - Proxmox Backup API Server. restart proxmox server. Output from # ip -a 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127. Make your changes and then click the apply button (if you have ifupdown2 installed, otherwise you will need to reboot the server to apply the settings). All it allows is a simple ordering and staggering, so all VMs won't try to start simultaneously, to protect a shared storage from overloading by huge burst of I/O which happens during VM startup. - the time synchronization in Proxmox is only for itself. 1 cluster becomes unavailable into the web interface and it's icon becomes grey with a question mark, like in the following screenshots: This happened three times on three different nodes (on node01 and node02, I rebooted them to solve the problem). Tens of thousands of happy customers have a Proxmox subscription. Have all idle now except one "master". service pve-ha-crm. 9 Restart the OSD daemon on all nodes. Once all services come online, the webGUI should probably work. Double click on it, change it to "Disabled". This should yield an empty install. The CRM reads this state and acts accordingly. 04. This daemon exposes the Proxmox Backup Server management API on 127. #2. 2-2551. Usage. 4-1 Virtual Environment 7. 1. Nov 1, 2016 · hp-ams - Agentless Management Service for HP ProLiant servers with iLO4. This means that they are aware of the cluster setup, and they can use the same network and storage resources as virtual machines. Conclusion . Hi, by default, Proxmox tries to shutdown guests by sending an ACPI shutdown (which is basically the same thing as pressing the physical power button on a machine), or by sending a shutdown command to qemu-guest-agent running inside the virtual machine, depending on the setting of "QEMU guest agent" in the VM configuration. With delay of 600000 you should get a week to do your maintainance before it tries to start the first guest. I am running Linux pve 5. This allows you to manage incoming and outgoing mail traffic. Dec 8, 2008 · There are numerous times when PVE chokes, the UI become gray, all tasks stuck, system gets in iowait, unresponsive, gets on fire and explode. All products are self-installing and can be used without Oct 24, 2023 · 2. 228. 4 Preparation on each Ceph cluster node. Should you still need to disable support for IPv6 on your node, do so by creating an appropriate sysctl. In practice, the actual possible node count may be limited by the host and network Mar 19, 2023 · Hello All, My Proxmox VE Web Interface stopped working all of a sudden. 8 Restart the manager daemons on all nodes. d/ceph -a stop' but ceph is not in here. 0-2 (running kernel Sep 14, 2022 · Well looks like a realtek ethernet controller card at PCI 0000. Jun 1, 2016 · Without knowing what you changed, it's hard to tell, but cleaning up /etc/pve should work. Many email filtering solutions do not scan outgoing mails. 3. 10. Buy now! proxmox-backup ¶. The final step is to restart the Proxmox VE services required to kick everything back in motion. The simplest and most reliable way to determine which bootloader is used, is to watch the boot process of the Proxmox Backup node. Storage LVM. Determining the bootloader from a running system might not be 100% accurate. docker container restart [OPTIONS] CONTAINER [CONTAINER] Aliases. also it seems it stop taking backups so it seems the system is waiting for this backup to stop before starting a new. It is a small disaster that PCIe IDs shift when adding devices, which causes the modern way of named the network devices to shift also. #7. pvestatd "stops working" until a service restart. It would be best to have another empty proxmox ready for comparison. If, for example, the path to destination IP address 192. Feb 5, 2018. And honestly, it shouldn't. Can someone please confirm that if I ssh onto my proxmox server and issue "restart" command that will: 1. Jun 28, 2024 · There are two proxmox clusters. 13 amd64 [installed] now where i get hung up on is trying to install the hp-snmp-agents & hp-health. May 1, 2020 · Proxmox 7 with all updates Linux 5. After a few nights utilizing the help of the /r/home lab discord, I discovered I was able to access the web GUI after I restarted the networking service on proxmox, directly from the server. Nov 08 15:55:39 P-SRV01 systemd[1]: pve-cluster. docker container restart. Filtering Outgoing Emails. and change the repositories also the repositories may updagrade the system to last version, I have access web now but the VM show stop but its running. Failed to check for processor microcode upgrades. 2-3 and in the last 4 weeks the three physical servers have been restarting unexpectedly. When the cluster ring is broken, some of the nodes will need to communicate with each other by routing through a neighbor node. Why should they restart? The pvedaemon service is part of the REST API, not directly related to running containers. To disable TLS version 1. otherwise it looks like we need to restart each of the 40 osd services + mons etc. 3. Restart network services to apply the changes: systemctl restart networking. This consists of a resource type followed by a resource specific name, separated with colon (example: vm:100 / ct:100). Buy now! Proxmox Mail Gateway is an open-source email security solution that protects your mail server against all email threats from the moment they emerge. service has finished with a failure. But the web gui doesn't start and the screen is black when I hook a monitor into it. I installed Proxmox VE 8. Hi, suddenly one node in my Proxmox 5. #3. the result of the test script: INFO: Checking for supported & active NTP service. I hereby request your help with a case that is happening, I have 3 DELL PowerEgde R720 physical servers with Proxmox 7. for some reason my backup won't stop. 2 Optional: Disable Maintenance Mode Again. Sep 11, 2023 · Whenever I try to access the ftp server or to the computer's file in general from my file explorer the proxmox server reboots, shutting down all the active VM; In fact sometimes it even reboots doing nothing. Proxmox VE works correctly in all environments, irrespective of whether IPv6 is deployed or not. apparently i did it wrong and not completely. I configured cluster and tested it, all work like a charm. TASK ERROR: Check if node may join a cluster failed! I attempted the following: Code: root@pve:~# pvecm nodes. Jul 10, 2019 · Hi, I suspect your PRMX4 doesn't have an entry in /etc/hosts for PRMX1. Your needs are specific, and Proxmox not only Mar 5, 2024 · Proxmox reload services This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. 1-1. Do a DD with null on full disk. proxmox-backup. Features like firewall macros, security groups, IP sets and aliases help to make that task easier. Hi, I have three nodes in a cluster with Proxmox ve 2. Once all nodes are quorate, the fix is to convert the node ring0_addr entries for PRMX1 and PRMX2 to IP addresses (like the other nodes) by carefully editing the /etc/pve/corosync. service pve-ha-lrm. 2 or 1. Alternative: uninstall all proxmox related stuff with --purge and reinstall it. You may need to restart the networking on the VMs or possibly VMs. WARN: systemd-timesyncd is not the best choice for time-keeping on servers, due to only applying updates on boot. rv oo lk at ei ou hw mf sf wu