App for Sensor Data and Video Streaming

Hi all,

I’ve been working on a new app for iOS and Android called SeeOSC that can send sensor data over OSC (similar to ZigSim) and stream video and audio, but can also receive a video and audio stream which makes it pretty great for prototyping (or even deploying) interactive pieces on your phone/iPad. And just recently I have added direct TouchDesigner integration.

Demo 1

Demo 2

Additionally, I’ve added some extra things that I find handy, such as:

  • generating ‘dummy’ data for when a device doesn’t have a sensor or so you don’t have to keep playing with the phone for data to generate
  • receiving OSC to control screen brightness and vibration (planning to add more like camera control etc.)
  • sending device info like device resolution, device type, system version etc., which makes it great to allow your content to dynamically adjust according to the device that is connected
  • ability to choose a background image/video when only sending sensor data, allowing the use of a ‘fake UI’ like buttons without needing to stream video

I plan to keep updating this as I go as I use this in my own projects and will add things I think are handy, plus if anyone has any ideas feel free to let me know. And soon enough I will release a free version.

If anyone would like to test it out, I have a testing link for iOS: Join the SeeOSC beta - TestFlight - Apple

And for Android unfortunately I need an email address, so feel free to message me with your email address and I’ll add you to the testing group.

I also have a demo TOE and TOX file to download at https://seeosc.com/downloads/SeeOSC_TouchIntegration.zip

7 Likes

Hi, wanted to give this a try! With TestFlight when opening the link it then asks me for an invite code.

Hmm not entirely sure why that is, as there isn’t an invite code I can provide you. If you shoot me a message with your email address I can add you that way

Works nicely so far ! Thx for sharing

I would love to try it on Android

Great to hear! Let me know if you have any comments or suggestions

Sure mate, just send me an direct message with your email address and I’ll add you to the test group

Hey! Just came across OSC and the app, love it!

I don’t understand how to use vibration control, would love to learn how.

Also, what do I get when I upgrade to Pro?

Thanks for the great app!

Glad to hear you like it!

With the vibration control, you set the three parameters (“/vibrate_duration”, “/vibrate_amplitude” and “/vibration_sharpness” with OSC commands (can be sent at any time). Then to fire a vibration event, you need to send an OSC command to “/vibrate” (sending a 1 is fine).

There’s a couple more details in the sensors page if you press the info button next to the vibration control button with what values are expected, but you can try sending amplitude at 255, sharpness at 1 and duration at 100 and see if you have luck. If that still doesn’t work shoot me over a file and I’ll have a look for you.

The Pro unlock just allows unlimited video streaming sessions (at the moment it is capped at 3 minutes before you have to reconnect) and limits the number of elements on the Custom Control Surface mode. I’ve tried to keep it very usable without paying so that anyone learning still finds it very useful

Thanks for getting back to me.

I don’t know if I’m an idiot or not, but I tried setting it up, and nothing is happening…

oscOutTest.2.toe (7.5 KB)

Hmm weird, it seems to work fine on my phone. I did, however, remove the first ‘/’ from your commands, as the OSC Out CHOP automatically appends one, and it doesn’t seem to work if that first ‘/’ is there.

Also that IP looked a little odd - it might be correct, but just double check you don’t have a VPN on or anything like that.

I’ve attached a new file - it’s best to only fire the “vibrate” command once when you want a vibration, otherwise every cook/frame it will be trying to vibrate again for another 100ms.

I do need to improve the vibrate feature and it’s documentation, hopefully I can get around to it soon

See how you go (don’t forget to update the IP)!
oscOutTest.4.toe (7.7 KB)

Thanks again, I tried the file on different wifi’s and IP´s (the first one I was using was a public university network which is why it might look weird). Still doesn’t work, unfortunately. My phone might be a bit old. I might try to do some more trouble-shooting at a later time. Thanks for trying!

But I also wondered if you considered adding NFC reader data to the app. Could be really useful!

Sorry I couldn’t be of more help. Out of curiosity, what phone do you have? I’ll see if I can look into it a bit more

I’ll definitely look at NFC! Thanks for the suggestion! I think an issue I was facing with NFC is that Apple requires their UI/integration that appears over the top of the app, but I’m going to try and integrate it in a way that makes sense

1 Like

Awesome, looking forward to seeing what you come up with! I saw in a video that the ZigSim app had an NFC reader output, maybe there is some documentation or info somewhere surrounding how they did it, could be a lead🕵️

I have an iPhone 11

1 Like