u/Hades-Arcadius

Okay, so I posted into r/Handbrake with an issue, that seemingly since switching from Windows 11 to Mint 22.3 I can't use NVenc to encode video in handbrake. link to post.

Regardless it was brought to my attention through a question about secure boot and a bit of searching that it seemed that the RTX 3050 might not even being used when secure boot was enabled. I installed over-top of an existing installation and hadn't disabled secure boot prior to installing Mint. I guess I'm asking if I should have disabled secure boot prior to installing, then enabled it after if it's truly needed to have NVenc enabled as I'm guessing.

I'm sorry if this has indeed been answered before as I'm mostly just looking for some clarity before I blow away the drive and start over to correct this snafu.

I'm in the process of helping a friend set up a media server, I'm currently hitting a snag getting NVenc working after switching to Linux Mint. Verified that the hardware did in fact work for NVenc on Windows 11 which the computer originally came with but I wasn't going to leave that OS on there. Regardless I've gone through the steps of trying to install the nvidia-driver-595-open (version 595.58.03-0ubuntu0.24.04.01) / nvidia-driver-580-open (version 580.142-0ubuntu0.24.04.01) / nvidia-driver-535 (version 535.228.01-0ubuntu0.24.04.02) but none have populated the NVenc options in Handbrake most likely due to the libnvidia-encode.so.1 not loading for some reason (according to the activity log).

Did some additional digging in terminal and "ubuntu drivers devices" in reports: vendor - NVIDIA Corporation, model - GA107 [GeForce RTX 3050 6GB]. I was able to get an installation running with "apt-get install libnvidia-encode-595" as most of the existing pages that were talking about a missing libnvidia-encode.so.1 mention a similar command but any time I ran (apt-get install libnvidia-encode1) it would end in "has no installable candidate". At this point I'm unsure of where to go next and would love it if someone could give me some help in figuring out what I'm missing here.

Included is the activity log from within Handbrake:

HandBrake 1.11.1 (2011111100)
OS: GNOME 49 (Flatpak runtime)
Kernel: Linux 6.17.0-23-generic (x86_64)
CPU: Intel(R) Core(TM) i5-7500 CPU @ 3.40GHz x 4
Install Dir: /app/bin
Config Dir:  /home/igris/.var/app/fr.handbrake.ghb/config/ghb
_______________________________

[22:54:22] Compile-time hardening features are enabled
Cannot load libnvidia-encode.so.1
[22:54:22] vcn: not available on this system
libva info: VA-API version 1.22.0
libva info: Trying to open /app/extensions/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
[22:54:22] hb_display_init: attempting VA default driver
libva info: VA-API version 1.22.0
libva info: Trying to open /app/extensions/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
libva info: VA-API version 1.22.0
libva info: Trying to open /app/extensions/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
[22:54:22] hb_display_init: attempting VA default driver
libva info: VA-API version 1.22.0
libva info: Trying to open /app/extensions/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
[22:54:22] qsv: is available on this system
[22:54:22] hb_init: starting libhb thread
[22:54:22] hb_init: starting libhb thread
[22:54:22] hb_init: starting libhb thread

(fr.handbrake.ghb:2): Gdk-WARNING **: 22:54:23.308: vkCreateSwapchainKHR(): Initialization of an object could not be completed for implementation-specific reasons. (VK_ERROR_INITIALIZATION_FAILED) (-3)

(fr.handbrake.ghb:2): Gdk-WARNING **: 22:54:28.126: vkCreateSwapchainKHR(): Initialization of an object could not be completed for implementation-specific reasons. (VK_ERROR_INITIALIZATION_FAILED) (-3)

(fr.handbrake.ghb:2): Gdk-WARNING **: 22:54:31.517: vkCreateSwapchainKHR(): Initialization of an object could not be completed for implementation-specific reasons. (VK_ERROR_INITIALIZATION_FAILED) (-3)