App for Sensor Data and Video Streaming

Hi all,

I’ve been working on a new app for iOS and Android called SeeOSC that can send sensor data over OSC (similar to ZigSim) and stream video and audio, but can also receive a video and audio stream which makes it pretty great for prototyping (or even deploying) interactive pieces on your phone/iPad. And just recently I have added direct TouchDesigner integration.

Demo 1

Demo 2

Additionally, I’ve added some extra things that I find handy, such as:

  • generating ‘dummy’ data for when a device doesn’t have a sensor or so you don’t have to keep playing with the phone for data to generate
  • receiving OSC to control screen brightness and vibration (planning to add more like camera control etc.)
  • sending device info like device resolution, device type, system version etc., which makes it great to allow your content to dynamically adjust according to the device that is connected
  • ability to choose a background image/video when only sending sensor data, allowing the use of a ‘fake UI’ like buttons without needing to stream video

I plan to keep updating this as I go as I use this in my own projects and will add things I think are handy, plus if anyone has any ideas feel free to let me know. And soon enough I will release a free version.

If anyone would like to test it out, I have a testing link for iOS: Join the SeeOSC beta - TestFlight - Apple

And for Android unfortunately I need an email address, so feel free to message me with your email address and I’ll add you to the testing group.

I also have a demo TOE and TOX file to download at https://seeosc.com/downloads/SeeOSC_TouchIntegration.zip

14 Likes

Hi, wanted to give this a try! With TestFlight when opening the link it then asks me for an invite code.

1 Like

Hmm not entirely sure why that is, as there isn’t an invite code I can provide you. If you shoot me a message with your email address I can add you that way

1 Like

Works nicely so far ! Thx for sharing

I would love to try it on Android

Great to hear! Let me know if you have any comments or suggestions

Sure mate, just send me an direct message with your email address and I’ll add you to the test group

Hey! Just came across OSC and the app, love it!

I don’t understand how to use vibration control, would love to learn how.

Also, what do I get when I upgrade to Pro?

Thanks for the great app!

Glad to hear you like it!

With the vibration control, you set the three parameters (“/vibrate_duration”, “/vibrate_amplitude” and “/vibration_sharpness” with OSC commands (can be sent at any time). Then to fire a vibration event, you need to send an OSC command to “/vibrate” (sending a 1 is fine).

There’s a couple more details in the sensors page if you press the info button next to the vibration control button with what values are expected, but you can try sending amplitude at 255, sharpness at 1 and duration at 100 and see if you have luck. If that still doesn’t work shoot me over a file and I’ll have a look for you.

The Pro unlock just allows unlimited video streaming sessions (at the moment it is capped at 3 minutes before you have to reconnect) and limits the number of elements on the Custom Control Surface mode. I’ve tried to keep it very usable without paying so that anyone learning still finds it very useful

Thanks for getting back to me.

I don’t know if I’m an idiot or not, but I tried setting it up, and nothing is happening…

oscOutTest.2.toe (7.5 KB)

Hmm weird, it seems to work fine on my phone. I did, however, remove the first ‘/’ from your commands, as the OSC Out CHOP automatically appends one, and it doesn’t seem to work if that first ‘/’ is there.

Also that IP looked a little odd - it might be correct, but just double check you don’t have a VPN on or anything like that.

I’ve attached a new file - it’s best to only fire the “vibrate” command once when you want a vibration, otherwise every cook/frame it will be trying to vibrate again for another 100ms.

I do need to improve the vibrate feature and it’s documentation, hopefully I can get around to it soon

See how you go (don’t forget to update the IP)!
oscOutTest.4.toe (7.7 KB)

Thanks again, I tried the file on different wifi’s and IP´s (the first one I was using was a public university network which is why it might look weird). Still doesn’t work, unfortunately. My phone might be a bit old. I might try to do some more trouble-shooting at a later time. Thanks for trying!

But I also wondered if you considered adding NFC reader data to the app. Could be really useful!

Sorry I couldn’t be of more help. Out of curiosity, what phone do you have? I’ll see if I can look into it a bit more

I’ll definitely look at NFC! Thanks for the suggestion! I think an issue I was facing with NFC is that Apple requires their UI/integration that appears over the top of the app, but I’m going to try and integrate it in a way that makes sense

1 Like

Awesome, looking forward to seeing what you come up with! I saw in a video that the ZigSim app had an NFC reader output, maybe there is some documentation or info somewhere surrounding how they did it, could be a lead🕵️

I have an iPhone 11

1 Like

How about lidar/depth data?

I would love to! And I do plan to, however I currently don’t own a device with a depth camera. When I get the money to buy one I’ll be sure to add the feature!

Hi all,

I haven’t been able to work on the app a huge amount as I’m in the process of moving countries, however I have added a few of things since the last test release (it’s now available on the App Store - ‎SeeOSC on the App Store) such as NDI support and sensor recording.

The release version is free, however it can be upgraded to remove all restrictions. But I have kept it very usable even for the free version (unlimited sensor-streaming, 3-minute sessions when streaming video and 10 elements/3 interfaces for the custom control surface). The upgrade will also ensure all features are unlocked moving forward.

I have recently ordered an iPhone with a depth camera so hopefully I can implement depth streaming soon. I also intend to add other requested features (like NFC).

Thank you all for testing and I continue to look forward to any feedback/requests

2 Likes

This is amazing! Can you send me the APK version or include me in the testing program?
Keep up the great work!

1 Like

Hey Jaydos,

Great app and exactly what I was looking for, particularly the NDI lidar streaming - however, I purchased the pro version still locked to the free version (unable to stream longer than 3 minutes etc) just the “Upgrade” tab has been removed.

Reinstalled the app and tried everything I can think of to reset this but can’t get the pro version features to unlock correctly.

Support email on your website gets a bounce back.

Hi, I am really interested in buying the pro version but I can´t find the way or the explanation on how to recieve video LIDR on touchdesigner on macOS.

Is there any way to do it, or is it just for windows?

Thanks!