Realtime Background Removal Mac TOP

Inspired by the Nvidia background removal on PC I’ve been working on a compatible TOP for mac. You can find it here. Release Alpha · medcelerate/BGRemoverTop · GitHub

It is in an alpha state and would love to get it working GPU-side as well as fix the issue with the outline on the mask but figured it would be a good example on working with some of the ML APIs on mac.

1 Like

Anyone know why this would be the output, the mask input looks white and correct.

Bumping this to see if anyone has thoughts on the source of the issue, colorspace looks correct on both sides.

Finally found the issue, Here is a release build. Release Initial Release · medcelerate/BGRemoverTop · GitHub

2 Likes

Hi, this is great unfortunatly I cant get it running do you also have it as a .tox?

Here is an example toe.
ParticleSegment.toe (4.9 KB)

1 Like

oh wow Thanks a lot!!

Hi I am not sure where to install the plugin.
I downloaded the toe, but i get an error saying that the plugin needed for this custom OP can’t be found.
Any help is appreciated

I get the same error. I dropped BGRemoverTOP.plugin in a “Plugins” folder in the same directory with the project toe as well as in the /Users//Library/Application Support/Derivative/TouchDesigner099/Plugins folder.
I have a 2019 MacBook Pro with Intel i9

See helpful installation instructions here: Custom Operators | Derivative

Also keep in mind that MacOS may complain about software installed from unknown developers. You might need to explicitly approve the .plugin file before it will load in TD.

According to the link in my previous response, you might just need to put the plugin alongside the .toe file. No need for a separate ‘Plugins’ folder.

@djevo1 This is very cool! It is a bit slow on my M1 MacBook Pro – a barebones .toe with just Video Device In and VX Background Removal runs at ~30 FPS.

I can improve the performance somewhat by reducing the resolution of Video Device In (set Output Resolution to Eighth), but that just gets me to ~35 FPS. Any other suggestions?

EDIT TO ADD: The ParticleSegment demo you provided runs ~11 FPS on my system, if that helps.

Hey, literally had built the same thing last week as a Cplusplus TOP. Take a look at it! GitHub - aaronmylespereira/AppleVisionMask-TouchDesigner: A native Apple Silicon video background remover

Works pretty well, used it live for a show. Gives me stable 30fps at a 1080p signal, and if I want the full 60fps, I use a resolution TOP to make the input to the Cpluplus TOP about quarter and use the output mask in the matte gives me a full 60fps of performance.

1 Like