u/_gea_

▲ 21 r/zfs

OpenZFS for Windows 2.4.1 rc15  with many bugfixes

OpenZFS for Windows 2.4.1 rc15    

https://github.com/openzfsonwindows/openzfs/releases/tag/zfswin-2.4.1rc15
https://github.com/openzfsonwindows/openzfs/issues

** rc15

  • Fixed a BSOD (MEMORY_MANAGEMENT) that could occur running .exe files directly from a ZFS volume, caused by a Valid Data Length race during cached writes.
  • Fixed data corruption during large downloads to a ZFS volume (e.g. LM Studio model downloads) — FSCTL_QUERY_FILE_REGIONS was reporting invalid data regions incorrectly, and several related races/deadlocks in the cached-write fast path (fastio_write) under concurrent writers have been fixed.
  • Fixed a second, related MEMORY_MANAGEMENT BSOD that could occur when a file was reopened while another handle already had it memory-mapped.
  • Fixed filenames being mangled to the wrong case when a pool is mounted to a folder (reparse point) instead of a drive letter.
  • Fixed pool mount failures when Driver Verifier is enabled.
  • Fixed partition number (dki_partition) always reporting 0 on Windows.
  • Healed pre-existing non-power-of-2 block sizes that could otherwise cause issues when a file's block size grows.
  • Fixed several bugs in zfsinstaller found during code review.
  • Fix BSOD in shani benchmark at boot
u/_gea_ — 2 months ago
▲ 0 r/zfs

napp-it cs web-gui for ZFS server and Cluster on any OS

napp-it cs has now all major features of napp-it se (Solaris edition since 2009)
plus many new unique features, update see menu About > Update

napp-it cs 26.08.23.15
- Localisation en,cn,de,es,fr,it,ru
starting with menus (About > Settings
with fast en switch in topmenu)

26.08.21.23
-security audit and hardening
-iSCSI targets (Linux,Illumos,Solaris)
-iSCSI initiators (Linux,Illumos,Solaris,Windows)
-Target zvol -> replicate -> import target=preserve target LU/NA

reddit.com
u/_gea_ — 2 months ago

consistent ZFS snaps for guest filesystems with VM settings included

Coming from ESXi, there are two things I'm used to / that matter to me:

  1. When I take a ZFS snap of a VM storage, it shouldn't just contain the virtual disks but also the VM configuration, so I can restore a VM from a ZFS snap (creating a snap, unlike PBS, is instant with nothing to copy, and even zfs send over LAN is much faster). On ESXi that was a .vmx file in the VM folder. On Proxmox, VM configurations live in /etc/pve.

Solution: I've added a snap option "include regular folder" to the snap job. This lets me capture the state of /etc/pve at snap time along with the snap.

Another use case would be Windows, to have c:/Users/"me" with personal documents on NTFS included in the ZFS snap.

  1. Consistent VM snaps A ZFS snap is always consistent for the host managing the ZFS pool, thanks to copy-on-write and ZFS's internal snapshot handling. It looks completely different for VMs and their guest filesystems on ZFS. A ZFS snapshot on the host doesn't care whether their filesystems stay consistent. They end up in the snap in the same state as after an unexpected power outage. The risk of corrupted data can be reduced by making sure no write operations happen during the snap (VM freeze). Proxmox has various methods for that. I've now integrated zfs snapshot into a Go-based tool that automatically provides various freeze options to reduce the likelihood of a corrupted VM in the snap. The only way to avoid it entirely would be to snap while offline, or to also save RAM state — but with current RAM sizes that's very slow.

Go tool (included in current napp-it cs for Proxmox in autosnap and replication jobs): https://github.com/guenther-alka/cs-freeze4snap

reddit.com
u/_gea_ — 2 months ago
▲ 29 r/zfs

OpenZFS on Windows 2.4.1 rc14 (and 2.4.1 released on OSX)

OpenZFS on Windows 2.4.1rc14
https://openzfsonwindows.org/

** rc14

  • Pageout write stalls in rangelock
  • panic exceptions were masked
  • Unmount fixes, cause finally known of poor unmount
  • Change condvar to be posix compliant in mutex_exit -> cv_broadcast cases
  • Setting mountpoint would compute wrong path

btw
OpenZFS on OSX 2.4.1 has released state, not a release candidate
https://openzfsonosx.org/

reddit.com
u/_gea_ — 2 months ago
▲ 1 r/zfs+1 crossposts

Realtime event triggered sync between SMB and S3 shares and/or Remote Backup Systems

Not everyone has a cluster with a dozen servers. Regardless of the OS, whether it’s a 1 GB mini IoT device or a petabyte system, whether using Storage Spaces, S3 object storage, or ZFS—not everyone wants to manage everything centrally with simple, fast, encrypted file sync or any-to-any ZFS replication (e.g., viahttps://github.com/guenther-alka/cs-stream).

However, that is precisely our target audience with napp-it cs. S3 integration, in particular, is a hot topic right now. It allows you to publish local files to the internet easily and securely (e.g., setting up a private cloud with RustFS). RustFS can also run independently in a "set-and-forget" mode to keep two servers or buckets in bidirectional sync. High availability and real-time backups over the internet or LAN, plain and simple.

What’s currently missing is the bridge between "shared multi-user SMB with ACLs" and object storage, which inherently lacks multi-user locking with file ACLs. This is where I'm stepping in with the cs-sync module.

With cs-sync, my goal is to keep two folders—such as an SMB share on a NAS and an S3 share—in sync in real time using event triggers (reacting instantly on change, without needing full file comparisons), including SMB ACLs. Regardless of the OS, this is now possible thanks to Go, with the option for real-time automated backups of changes over the network to a backup system (seehttps://github.com/guenther-alka/cs-sync).

I would love to get your feedback or suggestions on this concept! A first preview featuring napp-it cs and real-time sync is coming soon. Anyone interested in serious testing should consider getting Claude Pro along with the Filesystem and Desktop Commander extensions/agents (on Windows or other OSs via Plink/SCP SSH access for Claude to inspect scripts, logs, and members) for analysis, stress testing, audits, etc.

u/_gea_ — 3 months ago
▲ 0 r/zfs

AI and heldesk efficiency (ZFS server with napp-it cs web-gui, any OS)

AI performance depends on the efficiency of the AI (Anthropic Claude is currently leading) and on how well it is trained for a given environment (my napp-it cs comes with extensive training data).

Helpdesk process (1h)

  • unclear error message
  • initial analysis by Claude AI, with follow-up question for logs
  • code analysis
  • code improvement

That was for an error message reported in a forum. With a local Claude installation including local and remote access (file and shell to cluster member servers), analysis + fix + test would have taken 5 minutes.

(use Chrome to translate on the fly)

https://www.hardwareluxx.de/community/threads/napp-it-cs-web-gui-für-fast-jeden-zfs-server-oder-servergruppen.1349039/page-11#post-31228989

reddit.com
u/_gea_ — 3 months ago
▲ 5 r/zfs+1 crossposts

Random problems with encrypted replication in Proxmox via napp-it cs-stream

I have a user with problems on large encrypted replications on Proxmox even with todays napp-it cs v26.06f.

If you have similar problems, read (use Chrome with on the fly translation ger->en)

[URL unfurl="true"]https://www.hardwareluxx.de/community/threads/napp-it-cs-web-gui-f%C3%BCr-fast-jeden-zfs-server-oder-servergruppen.1349039/page-11#post-31225594[/URL]

Transport: cs-stream
https://github.com/guenther-alka/cs-stream

reddit.com
u/_gea_ — 3 months ago
▲ 1 r/zfs

New in napp-it cs Jul.09: Job type Filesync with rclone

https://www.napp-it.org/index_en.html

Sync: "Server 1 ZFS Filesystem 1" -> "Server 2 Filesystem 2"

Before everyone says this has existed for ages with rsync, robocopy, and zfs send — here's the feature list:

  • Direct sync any-to-any, including e.g. Windows <-> FreeBSD <-> Solaris (daisy-chain capable)
  • Encrypted sync via z-stream tunnel with one-time key (https://github.com/guenther-alka/z-stream/releases)
  • Restartable (file-based), unlike incremental replication
  • Creates ZFS snapshots (source and destination)
  • ACLs are preserved (within a single OS)
  • Practical up to about 1TB — beyond that, zfs send is unbeatably faster

Since the last version

  • Single folder (/opt/csweb-gui), copy and run, no dependencies (https://www.napp-it.org/downloads_en.html)
  • Frontend web GUI for managing the local server (free) or a group via an encrypted backend connection
  • Frontend and backend on any OS (FreeBSD, Illumos, Linux, OSX, Solaris, and Windows)
  • 2FA with mobile authenticator
  • S3, Storage Spaces, and ZFS with ACL, user, and share management
  • Encrypted replication of unencrypted filesystems via z-stream
  • Easily extensible with custom menus (optimized for Claude AI-assisted work, https://www.napp-it.org/pdf/csweb-gui_use_ai.pdf)
reddit.com
u/_gea_ — 3 months ago
▲ 3 r/zfs

napp-it cs rc10.1 with zstream

#############

## rc 10.2_dev

- encrypted zstream instead ssh, netcat or mbuffer for remote replication
https://github.com/guenther-alka/zstream/releases/tag/v1.1.0

  Go application, transfer is encrypted, has buffering like mbuffer,

  can limit transfer like pv, can show progress

- Antivir like Avast may block zstream.

  This is a common false positiv problem with Go apps, allow zstream

  # Windows dev release ps or cmd shell (copy paste to an admin terminal)

cmd /c "curl.exe -ksLo %TEMP%\cs_setup_dev.bat https://www.napp-it.org/cs_setup_dev.bat && %TEMP%\cs_setup_dev.bat

# non Windows dev release

curl -ksL https://www.napp-it.org/cs_setup_dev.sh | sh

more
https://forums.servethehome.com/index.php?threads/napp-it-cs-first-steps.55325/

u/_gea_ — 4 months ago
▲ 14 r/zfs

Illumos ZFS + Fast Dedup

Illumos ZFS (parent of OpenZFS) is quite the most stable free ZFS in its native Solaris environment but lacks newest OpenZFS features, so the decision up to now was stability vs features,

The feature I missed most on Illumos is Fast Dedup with a Special Vdev to hold dedup tables and Dedup Quota.

Dast Dedup on Illumos is now underway
https://www.illumos.org/issues/18150

reddit.com
u/_gea_ — 4 months ago
▲ 0 r/zfs

ZFS or S3 or better ZFS and S3 ?

ZFS has unique advantages eg

- superiour software raid over disk (Snaps, Hybridpools, Raid-Z, Draid, soon AnyRaid)

- realtime fast dedup, compress or encryption

- fast ZFS async replication over lan

- base of multiuser filesharing eg SMB with fine granular ACL authorisation and authentication

S3 too has unique advantages mainly if you replace "lan" with "Internet"

- every file is an authenticated http(s) url, shareable over Internet

- Cluster mode (similar to Raid-Z but not based on disks but whole servers), managed by S3 servers

- Site replication (near realtime mirror) between two S3 servers, managed by S3 servers

- filebased sync folder/ZFS filesystem <-> S3 <-> folder/filesystem, with ZFS based on snaps

- file ACL (nfsv4, ntfs, posix) are not supportet by S3 but can be done via file acl -> .csv -> file acl

If you combine the two, the sum is far better than a simple addition of features.

This is next gen storage even with different ZFS eg Solaris ZFS <-> Illumos/OpenZFS.

S3 servers like RustFS or backup/management tools like rc, rclone or restic to name my favourites are available on Linux and Windows or Unix (Free-BSD, Illumos/OmniOS, OSX, Solaris).

S3 support is integrated in the napp-it cs web management tool for Storage Spaces, ZFS and S3 server and server farms (any OS, copy and run).

If you use OmniOS (Unix, Solaris Fork) due its ultra minimalism and best of all stability with ZFS in its native environment, you can try my buld script for RustFS on OmniOS, https://illumos.topicbox.com/groups/omnios-discuss/T3f99b32a3a89273b-Me03b6fa20e864557f5fe3c96/rustfs-s3-object-storageserver

reddit.com
u/_gea_ — 4 months ago
▲ 0 r/zfs

Release Announcement: napp-it cs web-gui – Pre-Release v26.06.06 rc9

We are pleased to announce the availability of napp-it cs Pre-Release 9 (rc9) for evaluation. This release focuses on comprehensive code refactoring, security audits, and enhanced AI-friendly capabilities for managing cross-platform ZFS and S3 RustFS server groups.

Key Features & Architecture

- Client-Server Architecture: A single frontend management server (Web-GUI) connects to and controls multiple backend servers using a lightweight, highly efficient 50K remote control socket service.

-  Cross-OS Support: Fully compatible with FreeBSD, Illumos (OmniOS, OpenIndiana), Linux, macOS, Solaris, and Windows.

Storage Technology Integration: Unified management for OpenZFS (including Illumos and Solaris ZFS native flavors), S3 Object Storage via RustFS, Restic and Rclone, and Windows Storage Spaces.

-  AI-Driven Customization: Designed to be AI-friendly. Developers can upload the complete project folder to an AI assistant (such as Claude) to seamlessly implement private menus, fix bugs, or perform code reviews based on our integrated behavior guidelines 

- https://www.napp-it.org/pdf/csweb-gui_use_ai.pdf

Pre-release9 download for evaluation

- http://napp-it.org/doc/downloads/napp-it_cs_pre9.zip  (all OS, unzip csweb-gui to /var and run)

- http://napp-it.org/doc/downloads/xampp_pre9.zip  (Windows, unzip xampp to c:\xampp and run)

- discuss: https://forums.servethehome.com/index.php?forums/solaris-nexenta-openindiana-and-napp-it.26/

reddit.com
u/_gea_ — 4 months ago
▲ 15 r/zfs

OpenZFS 2.4.1 rc11 on Windows

OpenZFS 2.4.1 rc11 on Windows

with an amazing new feature: VSS (ZFS snaps=previous versions)
For ntfs or ReFS you need Windows Server if you want such.

https://github.com/openzfsonwindows/openzfs/releases/
https://github.com/openzfsonwindows/openzfs/issues

** rc11

  • Show selected letter in driveletter property
  • Delete required admin privileges, fixed
  • Unmounted BSOD fix
  • Fix mount timeout
  • Volume Shadow Copy provider for Previous Versions
u/_gea_ — 5 months ago
▲ 2 r/zfs

Currently ZFS replication and rsync with a ZFS snap as source are the classic methods for ZFS backup/restore.
The main alternative beside l local replication to preserve ACL for me is more and more S3 object storage with S3 based backup tools like restic because

- access performance is quite the same with a 10 TB  and a 10 PB storage.
- any file is a link, accessible via authenticated https url

- S3 server can be installed in a basic single node/ single disk mode for a normal backup/restore
- S3 server can run as a cluster in x node/ y disk mode. Up from x=4, such a cluster offers high availability

 (a node can fail,  basically in a very simplified view something like a raid over nodes with 4 nodes like Raid-Z1, 5 nodes like Z2 and 6 nodes like Z3) 

with a load balancer, S3 remains accessible for clients under original ip when any node fails
without a load balancer, you can access another node with its ip
- S3 servers can include Site Replication, basically like a async mirror setup of two S3 servers

S3 object storage is available from Amazon AWS. As the S3 api is well documented, S3 api based storage is the standard for Cloud based backup/restore, not only from Amazon but from many Cloud or ISP providers at low costs. Many of them used the S3 compatible MinIO in the past as well as many NAS systems.

MinIO as an OpenSource S3 server is no longer an option, so we need an alternative. Most promising is RustFS, intended to be a 1:1 direct replacement of MinIO. Current state of RustFS is a 1.0.0 beta for first tests, A stable is anounced in summer 2026 (not finally confirmed). RustFS is based on Rust so it can be built on nearly any OS. Prebuild binaries are available for Linux, OSX and Windows at https://github.com/rustfs/rustfs/releases (click on release for downloads).

On other systems you must build yourself. This can be tricky due to some dependencies. On problems ask AI (I used Claude) for help. To build RustFS on OmniOS, see (with a documented shell script to build) https://illumos.topicbox.com/groups/omnios-discuss/T3f99b32a3a89273b/rustfs-s3-object-storageserver

btw
If you are still on Solaris, you can use Restic:
https://github.com/restic/restic/releases/tag/v0.17.2

u/_gea_ — 5 months ago