I would love to use the NVIDIA background TOP instead of a Kinect for background removal, but all of the videos I’ve seen suggest that designed mostly for people sitting at desks. Does anyone know if it (NVIDIA Maxine Video Effects, I suppose) is capable of segmenting a full human? I don’t have an RTX card to test with, and I’d like to understand the capabilities before I drop $2k+
Full body segmentation does work, but I wouldn’t say that it’s a depth replacement just yet. Here are some examples pulling from stills - which has different performance than with video. Part of the challenge here is also the model that you’re working with. There are probably some models built off of standing figures that might yield better results here.
The other reminder here is that the output from the nvidia background TOP is a several frames behind realtime - so you need to use a cache to delay your feed by 3-6 frames to get a clean alignment between key and video. That’s a little different than working with a depth sensor, and if it’s a deal breaker it’s worth knowing about.
