OBS RTX SuperResolution v1.2

Bemjo submitted a new resource:

OBS RTX SuperResolution - nVidia RTX AI SuperResolution and upscaling as a source filter.

A plugin to enable nVidia RTX Video Super Resolution features as a source filter.

Allows the use of RTX AI SuperResolution or GPU accelerated Upscaling.
These can be combined with an RTX AI Artifact Reduction pre-pass mode as well to further process your source material.

See https://blogs.nvidia.com/blog/2023/02/28/rtx-video-super-resolution/ for more information about this.

Please see the github URLs for more information about features and usage.

Click to expand...

Read more about this resource...

great plugin! Good job keep it up!

An RTX 4090 loses at most 10% performance from a 4k source with Nvidia Upscaling 1.5x.

The quality seems similar to StreamFX or FreeFX 2x strong preset, but StreamFX loses 3 or 4 times more performance.

Now it is possible to use Nvidia rescaling on the same gaming PC or on a RTX 3080 on a dedicated streaming PC.

I would like to try the heavy SuperResolution mode but the 4090 goes up to 100%.

The only mode I have been able to use from 4k is the Nvidia Upscaling 1.5x . Not the Heavy Upscaling or Nvidia Upscaling 2x. Neither AI prepass

Very good plugin

Mine says no properties when adding it, ive downloaded the required sdk. How do i fix this?

DankSus said:

Mine says no properties when adding it, ive downloaded the required sdk. How do i fix this?

Click to expand...

okay i forgot to add the data folder lol. problem fixed but it dosent seem to do anything to my capture card source

oritxupolite said:

An RTX 4090 loses at most 10% performance from a 4k source with Nvidia Upscaling 1.5x.

The quality seems similar to StreamFX or FreeFX 2x strong preset, but StreamFX loses 3 or 4 times more performance.

Now it is possible to use Nvidia rescaling on the same gaming PC or on a RTX 3080 on a dedicated streaming PC.

I would like to try the heavy SuperResolution mode but the 4090 goes up to 100%.

The only mode I have been able to use from 4k is the Nvidia Upscaling 1.5x . Not the Heavy Upscaling or Nvidia Upscaling 2x. Neither AI prepass

Very good plugin

Click to expand...

My apologies for responding so late, I wasn't aware this submission was approved!

I have fixed an error with the resolution ranges dealing with 2x scaling. I had some wrong settings for it, and never noticed as I don't have a 4k monitor and never noticed the problem.

I've posted a new release, and you should be able to do 2x scaling from 4k now.

As for performance using super resolution (not upscaling) with my 2080 RTX I have noticed that going to 4k has a substantial impact. The multiplier itself isn't the biggest impact on performance, but the target resolution you end up at seems to be.

I cannot use super resolution to get anything to 4k at > 25 FPS with 100% GPU load, and going to 1440p uses 80%+ GPU load at 60 FPS.
I would expect significant GPU load trying to do 2x super resolution scaling on a 4k input source.

Upscaling is significantly less heavy in terms of performance and memory.

AI Prepass is limited to a maximum of 1080p sources, it cannot be used on anything larger.

The Super Resolution and AI Prepass resolutions are hard limits imposed by the nvidia VFX SDK that powers this plugin

Bemjo updated OBS RTX SuperResolution with a new update entry:

1.2 Release

Fixed an error with 2x scaling resolution range limiting it to 1080p. Should now correctly work for 2160p (4k) input sources.

Click to expand...

Read the rest of this update entry...

Very much appreciate you sharing this with us. Thank you.
-jesse

alright so i've tried just about everything, and honestly when it comes to manually installing OBS plugin's idk why but i get so damn lost/confused... i've put the Zipped folder including all of its contents .. inside of the OBS installation folder... Nothing ... put it inside the plugin folder.. inside program files... nothing... do i need to put it into the folder inside the %appdata% ? i'm hesitant to keep adding things without any real direction as to where to put it. maybe i'm a simple but "put in installation folder" is vague .. plus i've put it there and its done nothing :( wish the installation instructions were more then 1 line lmao. Any help would be appreciated

RisenNephalem said:

alright so i've tried just about everything, and honestly when it comes to manually installing OBS plugin's idk why but i get so damn lost/confused... i've put the Zipped folder including all of its contents .. inside of the OBS installation folder... Nothing ... put it inside the plugin folder.. inside program files... nothing... do i need to put it into the folder inside the %appdata% ? i'm hesitant to keep adding things without any real direction as to where to put it. maybe i'm a simple but "put in installation folder" is vague .. plus i've put it there and its done nothing :( wish the installation instructions were more then 1 line lmao. Any help would be appreciated

Click to expand...

As I have packaged the zip, it is not meant to be placed inside of the obs-studio folder, it is meant to be placed ontop of it.

If your default installation directory of OBS is in C:/Program Files/obs-studio
You want to unzip the contents into C:/Program Files
It will place everything as required.
If you have a folder C:/Program Files/obs-studio/obs-studio, you have installed it incorrectly.
I will make changes to ensure this is more clear under the installation instructions on the page.

Please ensure you have also installed the pre-requisite nVidia Video Effects SDK for your GPU, as is also required for the NVIDIA Background Removal filter included in OBS Studio itself. This can be obtained here https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-sdk/resources/
Otherwise the filter will not be available in the list.

Bemjo said:

As I have packaged the zip, it is not meant to be placed inside of the obs-studio folder, it is meant to be placed ontop of it.

If your default installation directory of OBS is in C:/Program Files/obs-studio
You want to unzip the contents into C:/Program Files
It will place everything as required.
If you have a folder C:/Program Files/obs-studio/obs-studio, you have installed it incorrectly.
I will make changes to ensure this is more clear under the installation instructions on the page.

Please ensure you have also installed the pre-requisite nVidia Video Effects SDK for your GPU, as is also required for the NVIDIA Background Removal filter included in OBS Studio itself. This can be obtained here https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-sdk/resources/
Otherwise the filter will not be available in the list.

Click to expand...

That was so much simpler lol yea the problem i was running into was i wasnt putting everything in the right folder, appreciate clarification... now i can push things to much higher lengths :D 4090!!! LETS WORK! Ty sir!

My plugin says the input size of my source is incorrect despite being within the listed res. Nothing I can do will fix it? Any solutions? Thanks

pieguy_99 said:

My plugin says the input size of my source is incorrect despite being within the listed res. Nothing I can do will fix it? Any solutions? Thanks

Click to expand...

Please ensure you have downloaded version 1.2. This is not something that is listed or viewable in the plugin. If in doubt, please redownload it.

What is the resolution of your untransformed source, as reported by OBS (you can verify this through the Edit Transform menu for a given source)?

If you are resizing the source in the scene preview, this does not affect the actual size of your source as processed by this plugin, and it must be resized using a separate filter placed before the super resolution filter.

It might also be the aspect ratio, as while the listed resolution range is 90p-2160p these are 16:9 ratios. This is taken from the nVidia documentation and does not 100% accurately reflect what is truly supported. Odd aspect ratios can cause rejection and the exact ranges given an aribrarty aspect ratio that are acceptable are not documented by nVidia, but I suspect it deals with total pixel count.

If your source is near the lower or upper limits of the bounds, and has a non 16:9 aspect ratio you can try making it larger or smaller by a not insignificant amount.

If your source is in a 16:9 aspect, and falls within the given bounds, there should be NvFX errors or obs-rtx-superresolution errors in your OBS log for this plugin that may describe better why this is failing if you can post them.

I am getting this error when I try to use the plugin:
02:49:12.448: [rtx-superresolution] Failed to load NvVFX AR effect -13: The file could not be found

02:49:12.448: [rtx-superresolution] Failed to load the artifact reduction NvVFX
Is there anyway for me to fix this?

Espioto said:

I am getting this error when I try to use the plugin:
02:49:12.448: [rtx-superresolution] Failed to load NvVFX AR effect -13: The file could not be found

02:49:12.448: [rtx-superresolution] Failed to load the artifact reduction NvVFX
Is there anyway for me to fix this?

Click to expand...

This is an error from nvidia SDK i'm using to implement this effect, documentation is a little scare about it, but I believe this means it cannot find the AI model that should have been installed when you installed the nVidia Video Effects redistributable.

Do you have any errors that contain the text "Super Resolution model directory", or any other rtx-superresolution errors?

Please try redownloading and re-installing the Video Effects redistributable for your specific video card from here: https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-sdk/resources/

Let me know if that helps.

Hey Bemjo, does this work with RTX 2060?

I understand this plugin works kinda like DLDSR, right?
Is it theoretically possible to make a similar plugin, but with DLSS?

Fan4eG said:

I understand this plugin works kinda like DLDSR, right?
Is it theoretically possible to make a similar plugin, but with DLSS?

Click to expand...

Not that I'm aware of.
DLSS requires addictional graphical data that a game engine or other application specifically would provide, such as motion vectors.
This works purely on direct image data which is the only thing OBS can provide.

Im having hard time installing the plugin. Mine canot read in filters i have installed the video effects plugin for nvidia and unzipeed the SUPERESOLUTION FILE IN THE DIRECTORY BUT FAILS TO SHOW UP

0769751170 said:

Im having hard time installing the plugin. Mine canot read in filters i have installed the video effects plugin for nvidia and unzipeed the SUPERESOLUTION FILE IN THE DIRECTORY BUT FAILS TO SHOW UP

Click to expand...

Please make sure you did not download the source code, and actually downloaded the release.

Do not extract the contents to a folder beside the obs-studio directory, extract them directly to your base installation path as the installation instructions say to do. You should not have a folder called OBS-RTX-SuperResolution, the zip file contains a folder called obs-studio.

ex/ If your OBS is installed to c:/program files/obs-studio, extract the contents of the zip to c:/program files, merging the folders.