Camera ZED

I’ve been playing with the ZED a bit. I’d be interested in seeing this work with Touch for MR work.

The recent SDK release has certainly made it easier to use with Unity. I’m still not hitting the quality of what’s shown in the marketing materials but it’s a promising bit of kit.

Hi there

any news about ZED TOP for touch?

thanks

With my collegue Tim Gerritsen we’ve made a C++ TOP for the Zed camera and it works very well in TouchDesigner. We’re not giving it away for free, but if you’re interested in buying a license, shoot me a private message via this forum and I’ll talk to the client to see if we can set something up to make everybody happy.

The ZedTOP outputs all the outputs the Zed has to offer: left camera, right camera, disparity map, depth map, confidence map, and point map, and as user parameters in the C++ TOP we implemented all the options & camera settings we could find in the Zed SDK. Also versions for both 088 and 099.
Zed-TD.png

Hi All,

Any updates on this? Would really like to see how the ZED can compare to Kinect v2.

Thx

We have some on the way, looking into adding support for it!

Great!

Hi Malcom,

looking at the z for a coming project. Should I hold off for an official top from TD or just dive in and write my own?

It’s probably 1-2 months away from being released. We just got a new co-op programmer in whose likely going to be doing the work.

Oooh might just scrape in on time. Wondering if i make a start anyway could I shoot through some queries and possibly contribute back to the project.

One request for the TD ZED implementation - play nicely with SteamVR

There seems to be some differences between the ZED SDK implementation for Unity and for UE4. Whereas in Unity you can access the ZED depth camera but still use a Vive setup for tracking, with UE4 this is blocked for some reason (forcing you to use ZED for tracking). Would be great if TD implementation behaves more like Unity than UE4 in this case! The inside out tracking via stereo binocular ZED is interesting but doesn’t compare to Vive.

Hi Malcom,
Any updates on zed for TD? I’m thinking about using the camera for a project and that would be super helpful

It seems like it’s 90% done so far. We are dealing with some lingering integration issues related to CUDA. Hopefully we’ll put out a build soon with it.

Awesome! I was just about to write my own. If you need a beta tester :slight_smile:

Yeah I’m having no joy on the 9.x cuda versions of the sdk so going to rollback to earlier firmware and sdk. See how it goes :confused:

Is there an approximation of what might be included in the top? Ie read depth, cam left / right, confidence maps. Or are other features planned.

We’re hoping to get a build out today with pretty full support, trying to tie up some remaining loose ends. We have a TOP, CHOP and SOP coming for this camera.

Thanks so much for your patience. Here is the build:

dropbox.com/s/yrx6gq7l596d4 … t.exe?dl=0

let us know how it works for you.
Note that since this required changing the CUDA version, this feature can’t make it into the 2018.20000 main branch. So you’ll need to use this build until the 2018.40000 comes out.

Fantastic timing Malcom. I just had a friend bring a ZED cam over to the studio this afternoon.

I was immediately able to see all of the image inputs from the drop down and could switch the resolutions and other parameters effectively.

The quality of the depth image i’m getting from my camera is pretty bad right now - objects end up having big blocky noisy shadows all around them - so i think i need to recalibrate it before I fully understand it’s capabilities.

Super helpful to have this top with so many parameters exposed. Will follow up once i’ve tested again after calibrating… hopefully that will tighten up the quality of the depth feed.

Thanks so much.

Amazing! Thanks team!

Currently the camera fps seems locked at 15fps (might upgrade my firmware though). No biggie for me actually for the near future it gets me where i need to go. If I use video device in top you can (even in the live release of TD) pick up the camera feed off the left in case anyone is interested.

Gotta say, Fill mode - wow! Really happy with those results. I was underwhelmed by the raw depth maps from the zed but this really kicks it up 10 notches :slight_smile:

Hi team,

updated to the latest zed sdk and firmware - getting great fps now :slight_smile:

Do you have a rough timeline for the next official release with zed support? Just factoring that into my current project needs.

It won’t make it into the main 2018.20000 builds, but this build is based off of those, so as stable (except for any ZED related stuff). If there are features that you need in 2018.20000 that arn’t in the current ZED camera build just ask, and I’ll make a new one that is up to date with the latest 2018.20000 + ZED support.

It’ll be in the main 2018.40000 release though.