Going nuts with networking of VMs on Proxmox
from trilobite@lemmy.ml to selfhosted@lemmy.world on 30 May 13:01
https://lemmy.ml/post/48054883

Hi, so I have a little Proxmox box with two VMs: VM1 and VM2 which is a clone of VM1. I change the mac of VM2 to avoid conflict and I reset the machine ID of VM1. I then have a seperate pfSense machine machine that that acts as router, firewall and DHCP server. Proxmox is on the 192.168.20.1/24 domain. In the DHCP server, Proxmox get IP 192.168.20.8 explicitly assigned. All good to this point. I’ve set VMs on pfSense to get the 192.168.20.9X addresses assigned. VM1 gets 192.168.20.91 assigned, while VM2 should be getting 192.168.20.92.

But this is what actually happens:

Is this something to do with the bridge configuration on Proxmox? Iv’e added a screenshot of what I see. It doesn’t seem to be that complicated to setup a bridge?

I can’t get my head around this so tips are welcome.

EDIT: I’ve just run ‘sudo ip’ on the VM and i see the ens18 interface with the MAC I assigned to it and the 106 IP assigned to this interface. There are then seven of ‘vethXXX’ interfaces. Not sure what these are. There are also four ‘brXXXX’ interfaces, one ‘loXXXX’ interface and one ‘docker0’ interface, the latter probably used by the docker subsystem running on the VM. I imagine the ‘brXXXX’ interfaces are the docker containers themselves (I think I have four running). But what are the ‘vethXXXX’ interfaces? Sounds like its something to do with “virtual interface”. Why so many and what is creating these?

#selfhosted

threaded - newest

FapFlop@lemmy.world on 30 May 13:26 next collapse

It sounds like you’ve got another DHCP server running on that segment.

blarth@thelemmy.club on 30 May 13:27 next collapse

Do you have proxy arp setup on PVE? If not, try flushing the arp table in your pfSense.

TheMuffinMan@piefed.world on 30 May 13:43 next collapse

Having additional virtual network interfaces on VMs is completely normal, ens18 does indeed sound like the right one you should be looking at.

Seconding the other commenter who mentioned the possibility of a second DHCP server.

Is your Proxmox host wired via ethernet to the pfsense? Or are there WiFi APs in the mix anywhere

Eggymatrix@sh.itjust.works on 30 May 13:59 next collapse

Is there a reason you sre using dhcp instead of assigning ips manually?

Dhcp is great if you don’t care about stuff, in my experiece as soon as you start caring you should do it manually

plateee@piefed.social on 30 May 15:13 collapse

I had this exact fucking problem. Check if you’re using cloud-init and if there’s a holdover entry that may be overlooked.

For me, it was under the /var/run/ folder’s netplan, not the usual /etc/netplan.