Background Removal - Portrait Segmentation

Background Removal - Portrait Segmentation v0.4.0

Supported Bit Versions
  1. 64-bit
Source Code URL
https://github.com/royshil/obs-backgroundremoval
Minimum OBS Studio Version
27.0.0
Supported Platforms
  1. Windows
  2. Mac OS X
  3. Linux
This plugin makes it easy to replace the background in portrait images and video to create a virtual green screen. It uses a neural network to predict the mask of the portrait and remove the background pixels. It doesn't require a GPU and works in all OSs!
It's easily composable with other OBS plugins to replace the background with e.g. an image, a blurred background or a transparent color to create an overlay.

Demo
demo.gif


Blurred Background or Background Image
Add a chroma key to make the plugin make a transparent background, then add in the back a blurred view of the same camera or an image source.
bg_removal_blur.gif


(Icon made by https://www.flaticon.com/authors/bqlqn)
Author
royshilkrot
Downloads
333,664
Views
565,289
First release
Last update
Rating
3.40 star(s) 20 ratings

Latest updates

  1. v0.4.0 - OBS v27.1.3 and new RVM model

    In this release Upgrade to OBS v27.1.3 (latest) support New realtime model Robust Video Matting...
  2. v0.3.0 - New models! OBS v27!

    In this release Added 2 new lightweight segmentation models: Google Mediapipe "Meet" model...
  3. v0.2.4 Beta - MODNet model

    In this release Adding the MODNet segmentation model. Slightly better in segmentation and...

Latest reviews

the plugin helped me for my videos and my calls is fine the excellent plugin
In the portable version, you cannot call plugins. Any solution?
Hi there. Works pretty well for me. Can confirm the CPU usage, but not a real issue imo.
However I'm struggling with one thing: Since it's a video filter, I can only apply it directly to the camera source. This means once I've applied it, it's applied to all the copies of the camera source too. Since I would like to use the camera in another scene, but without the background removal, I'm running into an issue here. Applying the filter to a group or a scene doesn't work, since that only allows for effect filters. Do you have any suggestion on how to bypass this? Thank you very much!
It works but there are some points that should be fixed.
1. On a low end machine with 6GB ramit destroys the stream, it is laggy
2. On my High end machine (i7-11800H @ 2.30GHz 2.30 GH with 16GB) the touchpad stops responding in OBS. I am running windows 11. When using a normal mouse it wil work
It works goot, but it's not usable. The CPU (Intel I9-9900K) rises from around 2% to around 40%. The rendering time rises from 0,7-1ms to arond 130ms and the FPS dropping from 60fps to around 7-8fps.
The result with this plug is fine, but with an fps drop from 60fps to around 7-8fps means, that it is not usable acually.
There might be room for improvement (e.g. CPU load). I used MS Teams Meeting to create green background and captured screen with Chroma Key filter. This workaround consumed more resources and the result was only slightly better.
=>it might not be perfect but it's almost on the level of the feature from Microsoft -> clearly Excellent:)
It works great. But it also uses 40% CPU. When switch to GPU it still uses 40% cpu. Turn it off and obs cpu usage goes to 3%.
not perfect..

Reasons:
1. I don't know how, but most Video meeting Software does it better (Developers here wont have a professional Budget and Team - I am just objective). "Xsplit Vcam" in the free model has better BG removal, but it is limited to 720p and has a very present watermark.

2. with activated BG Removal, my CPU monitor inside OBS raises from 9% to 63% with "calculate mask every" 1 Frame, or 54% with every second frame.

3. Also, my webcam seems to loose FPS if BG Removal is activated.

I use:
LG 920C Webcam with OBS 27.2.1 64-bit.
Thank you, Thank you, Thank you for helping me break my dependence on ChromaCam and their 30fps limit...

Grabbed a logitech brio and the logitech litra glow and the background removal works fantastic.

I will say that in low-light situations the background removal will struggle. But that is going to be the same for any virtual background... Do yourself a favor, grab a diffused light source and help your camera out... you'll be surprised at the difference it makes.

I live in an apartment in queens and a physical green screen is not an option. Thank you royshilkrot, and also, f*ck chromacam...
Unfortunately, it doesn't work at all for me. Just crashes OBS when I try to select it. I'm using Linux if that means anything. Disappointing.
Top