Am I cooked?
Kind of in disbelief right now, can yall let me know? am i fully cooked? any way to rescue the pool? If not, someone might give me some insights on why this happened or what even happened exactly? Logs and Problem summary below. Thanks for everyone looking into this issue.
The Pool in question is named 'Speznas'. After using the NAS and therefor the pool, i woke up to the message on my screen seen above. Rebooted - issue persisted. Tried manually importing the pool via zpool - no success. Pool is stated as online as well as the 2 HDDs within. Ran SMART Test on both - no issues found. Tried manually importing again - no success. Tried rolling back to the last successful transaction - no success "device in use / busy". That's when I tried force importing - no success. Something somehow seems to have severly corrupted the pools metadata at 07:00am Eastern causing the pool to go offline. That's my current state.
---
root@truenas[~]# zpool import
pool: Speznas
id: 4904614166775644449
state: ONLINE
action: The pool can be imported using its name or numeric identifier.
config:
Speznas ONLINE
74fcf1fd-9e85-455f-8ff0-21f8e5f02621 ONLINE
1caf2f6c-4a41-49a0-819a-a05e9ba0b9e1 ONLINE
root@truenas[~]#
Welcome to TrueNAS
truenas_admin@truenas[~]$ sudo -i
[sudo] password for truenas_admin:
root@truenas[~]# zpool status -v Speznas
cannot open 'Speznas': no such pool
root@truenas[~]# zpool status
pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:08 with 0 errors on Mon Aug 3 03:45:10 2026
config:
NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
nvme1n1p3 ONLINE 0 0 0
errors: No known data errors
pool: nvme-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:40 with 0 errors on Sun Jul 12 00:00:41 2026
config:
NAME STATE READ WRITE CKSUM
nvme-pool ONLINE 0 0 0
1a27d877-087d-4dad-9810-19a4972e6a5b ONLINE 0 0 0
errors: No known data errors
root@truenas[~]# zpool import -f -F Speznas
cannot import 'Speznas': I/O error
Destroy and re-create the pool from
a backup source.
root@truenas[~]# zpool import -f -F -X Speznas
cannot import 'Speznas': one or more devices is currently unavailable
root@truenas[~]# dmesg -T | grep -iE "ata|sata|reset|error|drop" | tail -n 20
[Sat Aug 8 17:00:36 2026] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[Sat Aug 8 17:00:36 2026] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[Sat Aug 8 17:00:36 2026] ata2.00: ATA-11: ST20000NM007D-3DJ103, SN06, max UDMA/133
[Sat Aug 8 17:00:36 2026] ata1.00: ATA-11: ST20000NE000-3G5101, EN01, max UDMA/133
[Sat Aug 8 17:00:36 2026] ata1.00: 39063650304 sectors, multi 16: LBA48 NCQ (depth 32), AA
[Sat Aug 8 17:00:36 2026] ata2.00: 39063650304 sectors, multi 16: LBA48 NCQ (depth 32), AA
[Sat Aug 8 17:00:36 2026] ata1.00: Features: DIPM NCQ-sndrcv
[Sat Aug 8 17:00:36 2026] ata2.00: Features: DIPM NCQ-sndrcv
[Sat Aug 8 17:00:36 2026] ata1.00: configured for UDMA/133
[Sat Aug 8 17:00:36 2026] ata2.00: configured for UDMA/133
[Sat Aug 8 17:00:36 2026] scsi 0:0:0:0: Direct-Access ATA ST20000NE000-3G5 EN01 PQ: 0 ANSI: 5
[Sat Aug 8 17:00:36 2026] scsi 1:0:0:0: Direct-Access ATA ST20000NM007D-3D SN06 PQ: 0 ANSI: 5
[Sat Aug 8 17:00:39 2026] systemd[1]: systemd-hwdb-update.service - Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc).
[Sat Aug 8 17:00:40 2026] Error: Driver 'pcspkr' is already registered, aborting...
[Sat Aug 8 17:01:16 2026] prefetch_dnode_metadata+0x11b/0x130 [zfs]
[Sat Aug 8 17:01:16 2026] ? traverse_prefetch_metadata+0x130/0x170 [zfs]
[Sat Aug 8 17:01:16 2026] spa_ld_verify_pool_data+0x28/0x60 [zfs]
[Sat Aug 8 17:01:16 2026] ? __do_sys_newfstatat+0x4a/0x80
[Sat Aug 8 17:01:48 2026] ioatdma: Intel(R) QuickData Technology Driver 5.00
[Sat Aug 8 17:02:01 2026] nvme nvme0: using unchecked data buffer
root@truenas[~]# zdb -l /dev/sda
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
root@truenas[~]# zdb -l /dev/sdb
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
root@truenas[~]#
root@truenas[~]# dmesg | grep -iE "sata|ata|nvme|error|i/o" | tail -n 20
[ 1.838732] ata1.00: 39063650304 sectors, multi 16: LBA48 NCQ (depth 32), AA
[ 1.842202] ata1.00: Features: DIPM NCQ-sndrcv
[ 1.883271] ata1.00: configured for UDMA/133
[ 1.892350] ata2.00: 39063650304 sectors, multi 16: LBA48 NCQ (depth 32), AA
[ 1.895162] ata2.00: Features: DIPM NCQ-sndrcv
[ 1.918782] scsi 0:0:0:0: Direct-Access ATA ST20000NE000-3G5 EN01 PQ: 0 ANSI: 5
[ 1.936964] ata2.00: configured for UDMA/133
[ 1.972118] scsi 1:0:0:0: Direct-Access ATA ST20000NM007D-3D SN06 PQ: 0 ANSI: 5
[ 1.986177] sd 0:0:0:0: [sda] Preferred minimum I/O size 4096 bytes
[ 1.986370] sd 1:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes
[ 4.612132] systemd[1]: Starting modprobe@nvme_fabrics.service - Load Kernel Module nvme_fabrics...
[ 4.658302] systemd[1]: modprobe@nvme_fabrics.service: Deactivated successfully.
[ 4.658445] systemd[1]: Finished modprobe@nvme_fabrics.service - Load Kernel Module nvme_fabrics.
[ 4.672116] systemd[1]: systemd-hwdb-update.service - Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc).
[ 5.108436] Error: Driver 'pcspkr' is already registered, aborting...
[ 42.872043] prefetch_dnode_metadata+0x11b/0x130 [zfs]
[ 42.873608] ? traverse_prefetch_metadata+0x130/0x170 [zfs]
[ 42.877663] spa_ld_verify_pool_data+0x28/0x60 [zfs]
[ 71.479932] ioatdma: Intel(R) QuickData Technology Driver 5.00
[ 81.344659] nvme nvme0: using unchecked data buffer
root@truenas[~]#
u/West-Beautiful1249 — 9 days ago
