u/Stockdoodle

Small VM/LXCs backup fine. I have 3 large (1.5TB+) containers that fail to back up 100% of the time after roughly 5-30 minutes. PBS is running on separate hardware w/ a dedicated NIC for backup traffic. TCP segmentation on all NICs involved in backup is off. Backup datastore is a ZFS RAIDz array w/ three 6TB HDDs. Previously was a ZFS Mirror on two 14TB HDDs w/ same issues.

This has been a thorn in my side for weeks now. I'd appreciate any help.

PVE

INFO: processed 132.153 GiB in 19m, uploaded 132.111 GiB
INFO: HTTP/2.0 connection failed
INFO: unclosed encoder dropped
INFO: closed encoder dropped with state
INFO: unfinished encoder state dropped
INFO: finished encoder state with errors
INFO: catalog upload error - channel closed    
INFO: Error: error:0A0003FC:SSL routines:ssl3_read_bytes:ssl/tls alert bad record mac:../ssl/record/rec_layer_s3.c:918:SSL alert number 20
INFO: cleanup temporary 'vzdump' snapshot
  Logical volume "snap_vm-102-disk-0_vzdump" successfully removed.
ERROR: Backup of VM 102 failed - command 'lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- /usr/bin/proxmox-backup-client backup '--crypt-mode=encrypt' '--keyfd=15' pct.conf:/var/tmp/vzdumptmp3799871_102/etc/vzdump/pct.conf root.pxar:/mnt/vzsnap0 --include-dev /mnt/vzsnap0/./ --include-dev /mnt/vzsnap0/./media --skip-lost-and-found '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' --backup-type ct --backup-id 102 --backup-time 1787169166 --entries-max 1048576 --repository root@pam@192.168.5.3:bu_store' failed: exit code 255
INFO: Failed at 2026-08-19 15:12:07
INFO: Backup job finished with errors
INFO: notified via target `gmail`
TASK ERROR: job errors

PBS

2026-08-19T15:12:06-05:00: POST /dynamic_chunk
2026-08-19T15:12:06-05:00: upload_chunk done: 6249439 bytes, 09fd92d51ca90f8196dd33204bea6f14e6c07f7b3d8c714df018ffa259076433
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: backup failed: connection error
2026-08-19T15:12:06-05:00: removing failed backup
2026-08-19T15:12:06-05:00: removing backup snapshot "/mnt/datastore/bu_store/ct/102/2026-08-19T19:52:46Z"
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection
2026-08-19T15:12:06-05:00: TASK ERROR: connection error: error:0A000119:SSL routines:tls_get_more_records:decryption failed or bad record mac:../ssl/record/methods/tls_common.c:873:, error:0A000139:SSL routines::record layer failure:../ssl/record/rec_layer_s3.c:698: