App for Sensor Data and Video Streaming

Techniques
, , ,
21

Hey mate, you can definitely receive the LiDAR stream on macOS. At the moment, only NDI is supported, and so to receive it you need to add an NDI In TOP and find your app/phone name in the drop down box. Just make sure your phone and computer are on the same network and you’re not using a VPN.

Let me know if this helps or if you need further help feel free to send me a direct message

1 Like
22

Thanks for the reply!
The issue I am having is that there is nothing under the NDI in drop down box.
Is there anything else I could check?
The app says Looking for Desktop Companion

23

Ahh yes this could be a bug I’ve been meaning to patch cause of a little typo I’ve made - if the streaming method hasn’t been changed since downloading it, it reverts to using the ‘Desktop Companion’ even though it shows ‘NDI’ is selected. Just try changing the steaming method to something else then switching back to NDI - let me know if that works

1 Like
24

I am having the same issue, did you manage to solve it?
thanks

25

Hey Jaydos, Can i get your email id for the android test apk
thank you

26

Hi - I’m new to TD. Do you have more thorough instructions on:

  1. How to stream LiDAR data from the phone to a Windows machine (I can’t seem to find a “LiDAR” option in the app.
  2. How to turn the LiDAR data into a depth map?

Thanks!

27

So the option will only appear if your Apple device has a LiDAR sensor (not the TrueDepth sensor on the front) - so only the iPhone 12 Pro and later Pro models, and only the more recent Pro models of the iPad. Additionally, sending the LiDAR data is only supported over NDI at the moment due to library limitations

The LiDAR data has already been converted into a depth map, so it will stream the depth map over NDI

I hope this helps, and feel free to reach out if you have any other questions!

(PS. I do plan on creating some instructional videos soon, life is just a bit crazy at the moment)

29

Hi - thank you for building SeeOSC! I’m using the paid version, and running into a few issues:

  1. When I try to send both video and body tracking over WebRTC, the video seems to freeze. This seems to only happen with body tracking.
  2. I have video streaming through WebRTC (from SeeOSC iOS app to SeeOSC TD tox), but when I switch to NDI, no NDI sources are found in the app.
  3. I also tried in the NDI tools monitor, it depth map comes up for a split second, but is hung after.

For context, I’m experimenting with StreamDiffusion, body pose and depth map are both important elements.

Any recommendations?

30

Hello again! Thanks for adding NFC!

It would be supercool to have functionality for apple watch gyroscope also! I’ve seen some apps that allow for this. PhyOSC has the functionality, but the usability of SeeOSC is so much better.

Hope to see it added someday!

1 Like
31

Hello,

This is exactly what I’ve been looking for !

But I’m on Android and I just open my derivate account so I can’t send you a direct message, can you do that and I send me after my email address ?

Thanks you a lot,