Detect - Object Detection, Tracking built-in OBS v0.0.3

many PTZ cameras use similar control protocols, VISCA seems to be common but there is also HTTP and some others.. this page has example HTTP and VISCA API for a generic PTZ camera... https://www.prisual.us/pages/downloads

there is an existing OBS PTZ plugin for manual camera control.. if you were to try and add this support, would it be better to output control data from your plugin direct to the existing OBS PTZ plugin ? or better to send HTTP or VISCA directly from your plugin to the camera ? either way it would be a great feature to see added.. the user could create a "virtual camera man" which would help automate smaller productions..

hello m8, thanks for your great work!! I have a question, if i have for example 3 people talking in a video, is there a way to tell to the plugin zoom in on the first person from left, or zoom to the one on the center ecc? If not, it will be great to have that option available!

EB123 said:

many PTZ cameras use similar control protocols, VISCA seems to be common but there is also HTTP and some others.. this page has example HTTP and VISCA API for a generic PTZ camera... https://www.prisual.us/pages/downloads

there is an existing OBS PTZ plugin for manual camera control.. if you were to try and add this support, would it be better to output control data from your plugin direct to the existing OBS PTZ plugin ? or better to send HTTP or VISCA directly from your plugin to the camera ? either way it would be a great feature to see added.. the user could create a "virtual camera man" which would help automate smaller productions..

Click to expand...

Yeah that sounds like a feature that's not too hard to implement. I'll look into it after I take care of re-identification.

r3dd3vil said:

hello m8, thanks for your great work!! I have a question, if i have for example 3 people talking in a video, is there a way to tell to the plugin zoom in on the first person from left, or zoom to the one on the center ecc? If not, it will be great to have that option available!

Click to expand...

It's not yet possible to select single objects because their IDs are jumping around too much for a consistent tracking. I'm working on a stable tracking algorithm (called DeepSORT). It will be available soon and then I'll add the object selection option

royshilkrot said:

Yeah that sounds like a feature that's not too hard to implement. I'll look into it after I take care of re-identification.

Click to expand...

I installed the plugin last night.. from my quick tests it does an excellent job with identification of people and faces. if you end up adding PTZ control it could be very useful feature to help automate small productions.. I'll keep an eye on updates.. great work.

royshilkrot said:

royshilkrot submitted a new resource:

Detect - Object Detection, Tracking built-in OBS - Real-time Detect, Follow, Zoom or Blur/Mask over 80 categories of objects. No GPU required*



Read more about this resource...

Click to expand...

Very Nice and thank you very much for this tracking plugin I’m now trying to setup this for my billiard game to track all the snooker ball with different points but I’m curiously can it go sync with the scoreboard like track the ball goes into pocket it will automatically adding point on scoreboard ….

I’m wondering if it is possible to optimise for MacOS? Sorry if this is a silly idea. It is just that I feel that somehow it uses a lot of resources on my M1 MacBook Air and I can’t see any difference on face or person detection whether I use CoreML or CPU at the moment… doesn’t feel like it is optimised. Will using Metal help?

I am wondering if it is possible to build a plugin to help write in air, where the plugin follows a particular color in scene and traces a path. The color of the path can be changes using an hotkey and erasing every path using a hotkey. There are various examples of this done using openCV Here is link to one such project. https://www.geeksforgeeks.org/create-air-canvas-using-python-opencv/
Can you please build it as a plugin/script where it takes a source video and tracks the color (planning on using an led in ppt clicker).And overlays the path on to the original video.

I teach on youtube using green screen, this could help me highlight parts in the scene without having to buy a smart board.

Hey, I'd like to help implement PTZ movement through VISCA (UDP), just like PTZ Controls