u/AgreeableIron811

I have a Proxmox cluster with a Layer 3 underlay using FRR OpenFabric. The Proxmox nodes act as VXLAN VTEPs, and Proxmox SDN provides overlay VNets for VM connectivity across the cluster. Ceph runs over the underlying routed fabric.

I switched over to VLANs for my network, and when switching and starting my VMs, I noticed that I was no longer able to ping the network from my VPN connection or from any VM that doesn’t have the myvnet1 bridge. Before, I was able to ping it from anywhere.

I have a pfSense firewall running as a VM in my cluster, and it has the myvnet gateway. I have also added the tagged VLAN to its double-NAT interface, which is vmbr0, the same as on my Proxmox nodes.

What’s interesting, though, is that if I add the route in Proxmox, I’m able to ping it from Proxmox correctly.

The test

pve$ ip addr add 10.16.1.254/24 dev myvnet1

pve$ ping 10.16.1.1

So I have planned a maintenance for this weekend .

Replace firewall add some services to be accessed outside and migrate isc dhcp to kea dhcp and some more stuff like migrating 3 networks to vlan. I have done documentation mapping prep and been stressing alot about changes being made. Fast forward I did it today and it went shit. I got stuck on so stupid things. That I spent almost 24 hours on. Now I am going home and I will continue in some hours. Need some sleep. Then I will try to solve on how to access tagged vlans through my untagged migration network or vpn.

I am a bit worried about my switch topology. i am replacing my fw and migrating our 3 subnets to vlans using unifi switches.

My untagged 10.1.1.0 network cant ping or reach 192.168.0.10 network tagged with vlan 10 or at least my proxmox. I hav been up whole night troubleshooting please help

So I have gone through all my networks. DHCP leases, DNS leases, and my switches.

I have documented all connections for my Proxmox cluster. Then connections on my switch. Then how all switches are connected. Then I have documented my DHCP and then DNS zones, also what is forwarding and etc.

Then I have left is documenting every IP on my network. It’s annoying because I am doing hell of a mistakes in my documentation and sometimes I feel like I need to redo as I am thinking is this really accurate.

Right now when doing IP inventory, can I combine DHCP, DNS, and Nmap -sV and some manual lookups to get the most accurate?

https://preview.redd.it/utap588wtihh1.png?width=442&format=png&auto=webp&s=65a813c0ddd59a24b988f4a3ca608e19f5a874bf

I have a BIND DNS server that I need to migrate to OPNsense. I have 2 master authoritative zones with a lot of records. I am thinking of using the API for that, but where do I put them manually? I also have forwarders there as well and the same question here.

I have done some research and for master authorative zones I add it on override and then for forward zones just query forwarding? Or do I just the bind plugin? I am forwarding my dns to some AD DNS servers

Every youtube video I watch shows that basically vxlan solves scalability issues.. So I am wondering if there is any benefits of using it in small infrastructure. Maybe in a promxox cluster of 200 vms on the same location?

I have a Proxmox cluster and my nodes are using ceph. What I don't understand in my setup is that my nodes are interconnected with sfp and 25 gbs links between them directly. So there is not a switch between them and this is used for ceph traffic but then at the same time I have a myvnet network on the same links. How is that possible?

vxlan: myVxlanZ
        peers 192.168.25.1,192.168.25.2,192.168.25.3
        ipam pve
        mtu 8950`

----------------------------------------------------------------------------

frr defaults traditional
hostname node1
log syslog warning
ip forwarding
no ipv6 forwarding
service integrated-vtysh-config
!
interface lo
 ip address 192.168.25.1/32
 ip router openfabric 1
 openfabric passive
!
interface ens3f0np0
 ip router openfabric 1
 openfabric csnp-interval 2
 openfabric hello-interval 1
 openfabric hello-multiplier 2
!
interface ens3f1np1
 ip router openfabric 1
 openfabric csnp-interval 2
 openfabric hello-interval 1
 openfabric hello-multiplier 2
!
line vty
!
router openfabric 1
 net 49
 lsp-gen-interval 1
 max-lsp-lifetime 600
 lsp-refresh-interval 180`


------------------------------------------------------------------------
at ceph/ceph.conf
[global]
         auth_client_required = cephx
         auth_cluster_required = cephx
         auth_service_required = cephx
         cluster_network = 192.168.25.0/24
         fsid = 00000000-0000-0000-0000-000000000000
         mon_allow_pool_delete = true
         mon_host = 192.168.25.1 192.168.25.2 192.168.25.3
         ms_bind_ipv4 = true
         ms_bind_ipv6 = false
         osd_pool_default_min_size = 2
         osd_pool_default_size = 3
         public_network = 192.168.25.0/24

[client]
         keyring = /etc/pve/priv/$cluster.$name.keyring

[mon.node1]
         public_addr = 192.168.25.1

[mon.node2]
         public_addr = 192.168.25.2

[mon.node3]
         public_addr = 192.168.25.3`

I'm migrating a 400-VM Proxmox cluster from a flat network with IP aliases and multiple subnets to a planned VLAN-based network.

My plan is to write a script that checks which subnet each VM belongs to and then has Proxmox assign the correct VLAN tag accordingly. It will probably cover around 200 VMs. I'll need the QEMU Guest Agent for that, but it still feels a bit messy. Are there any better ideas?

Some personal notes:

For VMs with multiple NICs, I'll need to assign multiple VLANs to the VM, one for each NIC.

I havent really built an inventory with ip adresses for each vm should I prioritise that first and really spend time on it.

I hav rewatched the show 10 times. Both atlantis and sg1

I am trying to save money and in one year I should have at least saved 10 k euro. I don't honestly understand how budgeting would help me save money. I have tried excel and whatever budgeting there is out there. Currently I am using ynab which does me no good honestly.

I get salary from another country and live in another country. So this confuses more then I think. I earn around 3,547 after tax euro and I have saved in one year around
2000.

I have been able to save 500 most of the months. Now this latest months I have had to spend money on health and clothes for wedding and vacation.

Food is a big problem for me. I shop alot of food. I have had a problem with food. If I dont buy food for a day in the store or restaurant i feel hungry. I have tried not eating at work or prepare food. But honestly I really hate homecooked food in my fridge and eating it next 3 days. And my cooking is not that good.

I can eat a whole portion of 500 g bolognese with spaghetti that I cook for a day. 15 euro total and then feel full. Otherwise with certain foods I feel that I have no energy. Fiber I react badly with but I can eat it

Should i bulk create vpn certs for 30 users using the csv option in proxmox or create manually? How would an expert do this?

I am using VS Code + JupyterLab and a password manager (KeePass) for myself.

VS Code is for larger automation tasks and IaC, while JupyterLab is for documenting step-by-step what I do at work. It works as a kind of lightweight documentation system where I paste and run commands, and then I have a history of everything I’ve done. Next time, I can just follow it or trace what I did. It looks super good and is very lightweight almost more lightweight than VS Code, which is also already lightweight.

I use a password manager to store passwords and keys because nothing is more annoying than not having that in place.

I also use a local LLM to format XML and YAML by providing it with data.

BUT YOU NEED TO START USING jupyter

My ibs returned after 10 years. Its all mental

I have asked everyone for advice on what I should buy to keep it neat. Everybody says Velcro ties, which I already knew. But that doesn’t make the job easier. I bought vertical D-rings, which I have on the side to route the cables.

I also have data cables on both sides of the server, and on some I have power cables on both sides, so it makes it look messy. I try to separate data and power on each side as best as I can.

I have a horizontal cable manager where you take the cables from the inside or middle, but what should I buy? What is most commonly used?

The cables or premade.. Maybe I should replace d rings with duct cover instead and is there a patchpanel for premade cables?

Here is an ai generated image similar to how it looks..

Its a 42 u rack and there are some dell servers below that you cant see in the image and ups

https://preview.redd.it/lfu80vua308h1.png?width=896&format=png&auto=webp&s=f29cf631a854eca3b49e25dfeaa2a9538502923f

I have tried doing this. Never really succeeded validating an idea. I reallly want to start something meaningful. I dont need to do it because of money because I could prob just rely on my career in tech. But i have wanted to start a company … like really build something for 5 years. i just dont know what to do? Like who am I to compete with all the existing software and business models out there…

Waste of money honestly. Bought it to save money and get decent rice. It just so unclear to use. Like is there not timer directly when you start it?

Also I have never managed to get good rice with it. I have tried with different sorts and settings. It such a waste and I am so disappointed.

Only good thing with it is that it keeps the rice warm.

Never buying a ricecooker again!

Edit:
I will try again and document my steps.

I have an issue where I want to access an unifi switch without a jumphost. Is there a hidden functionality I am not aware of that wouldn't make this work even though fw,routes,subnets and adoption is already been made correctly

I want to add a static ip to openvpn in opnsense so I am able to adopt my unifi switch through vpn connection