u/techtornado

That reminds me of a story...

From Whirlwind Computing - a fictional service provider so good it will really blow your socks off

The company affected is one we can regiomize is a care-home of sorts...

Actors:
$Me - Calling the shots... remotely
$Nerds - My minions... experts in their craft
$Phone - Calling the shots... onsite
$Director - Also calling the shots... onsite

Scene:
This place started bubbling up to the top of the support queue with multiple requests of something is just really off with the network with reports of it being slow, dragging, and just being an absolute dog when it comes to being on wifi.

That's weird because wifi coverage was very good as the wire-flavoured spark wranglers made sure it passed muster and the mustard.

We sent techs multiple times to bless the creaking network and also to make an assuring presence that nothing was being a problem.

Murphy clearly had other plans as we were wrong about what was wrong the first four times they went out.

The Director got involved and told the reps to fix the network or he's replacing everything as it's impeding actual business operations and making the whole team very hot, cross, and bothered.

I grabbed the laptop and camped out staring at the all-knowing Shark of the Wires, filtering by Arp, Dns (always DNS) then Dhcp... wait a second!

Why is 192.168.4.27 sending out DHCP ACKS to DHCP requests?

I took a closer look at the Mac address which showed it was a phone, but why on earth would it be doing the DHCP thing?

I assembled the Nerd Herd^(TM) and they swept the building with the precision of a highly trained black-ops team as there were 20 of them to check, so I give them full credit for finding it within 7 minutes.

One reboot later and things started to swim back into service while the phone was off-hook and strangely, it hasn't been a problem ever since.

We have well 1500 phones deployed, this is the first and hopefully last time one of them became the embodiment of DHCP with a flair for the dramatic.

The lesson here is that if there's ever an event for what feels like a rogue DHCP server, check the phones, you never know what you might find.

PS:
If it helps, I did remember the lessons from previous stories of various laptop docks randomly becoming port mirrors and how they wreaked havoc on the network, so we covered both in that sweep.

I want to level up the garage and deck in a renovation project, but my interviews with the credit unions and local banks has not gone well.

My regional bank only does Equity-Mortgage options at 7.9% or whole-home/new build construction loans which sounds like I'm going to be paying a lot more than needed.

With that, who is a good lender for this kind of construction loan?

$15,000 is the reported build price from the garage team and $7000 is from the decking crew

We all know that Marsha is not a viable option...

Right now, I'm not asking for people's opinions on the candidates as it will not be a productive time.

Objectivity is key, describe the candidate that has what it takes or advertises to that degree based on X, Y, and Z criteria - like time in the political sphere, campaign promises that are reasonable, legitimate tax plans, etc.

Nebulous warm-fuzzies mean there is no plan, we need to see who has put the work into seeing what Tennessee needs and what it would take to keep things moving

For example, Monty Fritts has a tagline of liberty and less government

Awesome!

But what is the actual plan in order to achieve this?

Background:
Running a file server as a staging ground to drop data ingests by a set of servers, process-massage the data into something cute and adorable, and then export off into the database of wonders and miracles called /dev/null

The service account has full SMB access to the share to Read/Write/Delete the data and it's supposed to automagically remove post-process, and it does mostly until we get in these weird folders with a strange set of permissions and attributes that are completely unreadable by the Local/Remote/Domain/Super Admins.

We've tried setting the owner and granting the privs to the folder, but it kicks back with access denied.

Escalating things to takeown/icacls on the offending folders & files with every /force /recursive switch still gets permission denied

I even ran PSexec as NT/System and I still get permission denied on those two commands.

With that, what is the nuclear option for this kind of force-delete or attribute replacement where Windows does not ask questions, it just does it.

Two hosts are fine, the third one just drops the Netapp (AFF220) the moment I try to vMotion to it or create new VM's

They all have the latest round of 8.0.3 updates

Replaced the DAC cable on Host3 to resolve if it was a Layer1 issue, but no improvement, the MTU is 9000 on all VMK + Netapp interfaces and all plugged into the same 10gig switch

VMKlogs complain about massive I/O latency and a constant loop of dropping and reconnecting to the datastore

NFS41VolumeLatencyUpdate:7622: NFS41 volume VM Data performance has deteriorated. I/0 latency increased

Average value of 0(us) to 2749149(us).

Exceeded threshold 10000(us)

cpu2:2098343 opID=ec9b475)WARNING: NFS41: NFS41FileIOSync:790: Synchronous IO on obj 0x43093df9b00 (fh 0x4314eee13aa8) failecon #0

NFS41: NFS41_ConnectionRemove:1307: Connection: 0x43171020c040 [1] addr: tcp 10.10.20.20.8.1

NFS41: NFS41ClusterDestroy:2578: Destroying cluster: 0x43171020d690 flags: 0x10

WARNING: NFS41: NFS41FileIOSync:790: Synchronous IO on obj 0x4309e3dc5940 (fh 0x431710210a7) failed

WARNING: SunRPC: 4847: fail all pending calls for client 0x4310b8601370 IP 10.10.20.21.8.1 (socket half closed)

2026-06-1718: 33:11.998Z Wa(180) vmkwarning: cpu9:2097761)WARNING: NFS41: NFS41FSAPDNotify:6856: Lost connection to the server 10.10.20.20,10.10.20.21 mount point VM Data,

mounted as 371560c8-ba89eb8b-0000-000000000000 ("/VM Data")

cpu®: 2097759)NFS41: NFS41ProcessSessionReset:3942: Session Reset - XPRT UP, Issuing EXCHANGE_ID with Random Backoff

cpu®: 2097759)NFS41: NFS41IssueExid:1899: Issuing EXCHANGE_ID on Connection tcp:10.10.20.20.8.1 with 13834 US delay cpu2: 2097759)NFS41: NFS41ProcessExidResult:2397: clientid fbd5d30000004e20 roles 0x60000

cpu9:2097761)NFS41: NFS41ProcessClusterProbeResult:4349: Reclaiming state, cluster 0x431710204d80 [0]

cpu9:2097761)NFS41: NFS41ClusterReclaimState:3934: Reclaiming state for fs 0x4317102058c0 on cluster 0x431710204d80 [0]

vmkwarning: cpu3:2097764)WARNING: NFS41: NFS410penReclaimDoneWork:6138: Failed to reclaim objDesc 0x43093d5770 open status: Failure; rqst

0x43171020c0f8 cmpd status: NFS4ERR NO GRACE

vmkwarning: cpu3:2097764)WARNING: NFS41: NFS410penReclaimDoneWork:6138: Failed to reclaim objDesc 0x4309e3de6ff0 open status: Failure; rqst

0x43171020c918 cmpd status: NFS4ERR_NO_GRACE

vmkwarning: cpu11:2097766)WARNING: NFS41: NFS410penReclaimDoneWork:6138: Failed to reclaim objDesc 0x43093d5940 open status: Failure; ras t 0x431710215198 cmpd status: NFS4ERR_NO_GRACE

vmkernel: cpu11:2097766)NFS41: NFS410penReclaimDoneWork:6158: FS:0x4317102058c® reclaim completed on cluster:0x431710204d80[®]

vmkernel: cpu9:2097761)StorageApdHandler: 1304: APD exit for 0x43171020320 [371560c8-ba89eb8b-0000-000000000000]

vmkernel: cpu9:2097761)NFS41: NFS41FSAPDNotify:6921: Restored connection to the server 10.10.19.21,10.10.19.22 mount point VM Data, mounted as 371560c8-ba89eb8b-0000-000000000000 ("/VM Data")

vmkernel: cpu3:2097358)StorageApdHandler: 500: APD exit event for 0x43171020320 [371560c8-ba89eb8b-0000-000000000000, 01

vmkwarning: cpu1:2098357)WARNING: NFS41: NFS41FileOpGetFileAttributes:4681: Failed to get file attributes for object 0x43093de1380 name 37

1560c8-ba89eb8b-0000-000000000000: I0 was aborted

Two hosts are fine, the third one just drops the Netapp (AFF220) the moment I try to vMotion to it or create new VM's

They all have the latest round of 8.0.3 updates

Replaced the DAC cable on Host3 to resolve if it was a Layer1 issue, but no improvement, the MTU is 9000 on all VMK + Netapp interfaces and all plugged into the same 10gig switch

VMKlogs complain about massive I/O latency and a constant loop of dropping and reconnecting to the datastore

NFS41VolumeLatencyUpdate:7622: NFS41 volume VM Data performance has deteriorated. I/0 latency increased

Average value of 0(us) to 2749149(us).

Exceeded threshold 10000(us)

cpu2:2098343 opID=ec9b475)WARNING: NFS41: NFS41FileIOSync:790: Synchronous IO on obj 0x43093df9b00 (fh 0x4314eee13aa8) failecon #0

NFS41: NFS41_ConnectionRemove:1307: Connection: 0x43171020c040 [1] addr: tcp 10.10.20.20.8.1

NFS41: NFS41ClusterDestroy:2578: Destroying cluster: 0x43171020d690 flags: 0x10

WARNING: NFS41: NFS41FileIOSync:790: Synchronous IO on obj 0x4309e3dc5940 (fh 0x431710210a7) failed

WARNING: SunRPC: 4847: fail all pending calls for client 0x4310b8601370 IP 10.10.20.21.8.1 (socket half closed)

2026-06-1718: 33:11.998Z Wa(180) vmkwarning: cpu9:2097761)WARNING: NFS41: NFS41FSAPDNotify:6856: Lost connection to the server 10.10.20.20,10.10.20.21 mount point VM Data,

mounted as 371560c8-ba89eb8b-0000-000000000000 ("/VM Data")

cpu®: 2097759)NFS41: NFS41ProcessSessionReset:3942: Session Reset - XPRT UP, Issuing EXCHANGE_ID with Random Backoff

cpu®: 2097759)NFS41: NFS41IssueExid:1899: Issuing EXCHANGE_ID on Connection tcp:10.10.20.20.8.1 with 13834 US delay cpu2: 2097759)NFS41: NFS41ProcessExidResult:2397: clientid fbd5d30000004e20 roles 0x60000

cpu9:2097761)NFS41: NFS41ProcessClusterProbeResult:4349: Reclaiming state, cluster 0x431710204d80 [0]

cpu9:2097761)NFS41: NFS41ClusterReclaimState:3934: Reclaiming state for fs 0x4317102058c0 on cluster 0x431710204d80 [0]

vmkwarning: cpu3:2097764)WARNING: NFS41: NFS410penReclaimDoneWork:6138: Failed to reclaim objDesc 0x43093d5770 open status: Failure; rqst

0x43171020c0f8 cmpd status: NFS4ERR NO GRACE

vmkwarning: cpu3:2097764)WARNING: NFS41: NFS410penReclaimDoneWork:6138: Failed to reclaim objDesc 0x4309e3de6ff0 open status: Failure; rqst

0x43171020c918 cmpd status: NFS4ERR_NO_GRACE

vmkwarning: cpu11:2097766)WARNING: NFS41: NFS410penReclaimDoneWork:6138: Failed to reclaim objDesc 0x43093d5940 open status: Failure; ras t 0x431710215198 cmpd status: NFS4ERR_NO_GRACE

vmkernel: cpu11:2097766)NFS41: NFS410penReclaimDoneWork:6158: FS:0x4317102058c® reclaim completed on cluster:0x431710204d80[®]

vmkernel: cpu9:2097761)StorageApdHandler: 1304: APD exit for 0x43171020320 [371560c8-ba89eb8b-0000-000000000000]

vmkernel: cpu9:2097761)NFS41: NFS41FSAPDNotify:6921: Restored connection to the server 10.10.19.21,10.10.19.22 mount point VM Data, mounted as 371560c8-ba89eb8b-0000-000000000000 ("/VM Data")

vmkernel: cpu3:2097358)StorageApdHandler: 500: APD exit event for 0x43171020320 [371560c8-ba89eb8b-0000-000000000000, 01

vmkwarning: cpu1:2098357)WARNING: NFS41: NFS41FileOpGetFileAttributes:4681: Failed to get file attributes for object 0x43093de1380 name 37

1560c8-ba89eb8b-0000-000000000000: I0 was aborted

This guy highlights The Flock Problem in detail

This guy was able to realize the errors of the hate-first religion

It also highlights how fact-checking unverified claims goes a long way in establishing a moral boundary with logic

The Youtube Algo was kind to me tonight, the Hawkstone Choir did a thing and knocked it out of the park

Ammorillo

The guy that built deflock needs his own private security now.

They also interviewed the Big Brother architect of Flock and he denies everything

I'm exploring the ecosystem for water leak detection and basic AQI monitoring, but according to the docs, it needs Protect and buying all that kit is a minimum of $700 just to enable two air quality sensors...

Is there a way to set Superlink up by itself to be managed standalone in the UniFi app?

They didn’t put any effort into the Flock flags and nabbed the first car they found instead of the actual guilty party

Time to take the cameras down

Let's just say the state's grants page is a bit overwhelming/complicated...

I am curious to see what it takes to start a 1 acre farm from scratch and what the red tape looks like year after year and any steps to minimize it.

I can garden all day long, but being able to network with the community, sell the fruits & veggies, and getting grants to improve the land is a level up that has me curious what the option are. (+/- any tax benefits)

The goals are simple, grow interesting heirloom fruits and veggies like what Baker creek has to offer

If it helps. Sugar Bon peas are doing really well right now and the barley has rocketed out of the ground, any faster and it will reach the moon in about a fortnight...