Video / Audio sync issue

Bugs
1

Hi,

I used videoPlayer and videoEngine from the palette this week-end and experienced a video / audio sync issue. I tried many tweaking in the parameters but i always experienced drifting audio.

I then simply tried loading the movie file and used audiomovie CHOP and it was working fine.

Using latest TD Commercial on Windows 11

2

Hey,

Can you post the project (or just a subsection of it) that has the videoPlayer/videoEngine components so I can take a look at how they are set up?

3

Can you also describe if the sync issues you are facing are a constant offset, or a drift that grows over time?

4

hey,

attached the project. i tried the moviePlayer / movieEngine default options and had issues. Just changed the Audio Sync Offset to 0 and enabled Hardware decode but still had the issue.

i can’t tell about offset or drift as the files were 1h long and i had to quickly find a fallback solution for the event.

files were HEVC 25fps encoding with AAC 48K audio embedded

sync.toe (97.2 KB)

5

Would it be possible to privately share a link with one of the videos as well? It’s ok if not, but it would help in diagnosing the issue.

6

it is copyright content but i can check if it is possible. Should i send to support email ?

7

Yep you can send it to support email. Thanks. Let me know if you can’t share it

8

ok sent you a sample file

10

I’m not sure why the Audio Sync Offset for these COMPs is set to the default they are. Since the Audio Device Out CHOP has a buffer length of 0.15s, the audio sync offset should be set to -0.15 to counteract that lag. That’s what the default Movie File In TOP+Audio Movie CHOP setup will have if you put down new nodes.

I’ll continue to monitor the test, but I do wonder if it’s just that things were offset due to the incorrect audio sync offset value here.

11

I’ve watched this, comparing the sync between the file you posted and a simple Movie File In TOP and Audio Movie CHOP, and they seem consistent to me, as long as I have the Audio Sync Offset set to -0.15. Some of the parts of the clip don’t seem well synced to begin with, but overall it seems consistent to me.

13

In the project i shared, the buffer has a custom setting as i tried to fix the issue but the problem was showing with defaults settings as well.

The movie i shared there are parts not synced but this is an original editing issue. I have 5 other videos that shows the same issue with audio. When used with MovieFileIN TOP and AudioMovie CHOP there are no sync issues anymore.

With moviePlayer COMP sync is not consistent and there are random micro audio cuts or video stuttering like video or audio are waiting for each other and re-syncing regularly.

I send audio through a yamaha 01V audio console via USB or jack. I suspected a clock issue but everything seems ok on the audio console parameters. Both TD and 01V are set to 48K. And there are no issues when using Resolume for instance.

I’ll keep digging but i can’t figure out what the problem was.

14

The default settings were incorrect though, they should be -0.15 to counteract the Audio Device Out CHOPs default 0.15. If you use -0.15, how do things look there?

Audio cuts are a different issue, and video stuttering would be due to the software dropping a frame. Note that the underlaying nodes in the movieEngine/moviePlayer are also just Movie File In TOPs and a Audio Movie CHOP as well. The one difference is that it is driving the movie using Specify Index instead of the default Sequential. In your workaround, how did you drive the Movie File In TOP you created?

So it would be good to narrow this down a bit more. Is there a different video that has better sync in the original edit that shows the issue more clearly?

15

Hi,

Ok thanks for the info, i didn’t get the buffer issue you were describing. The moviePlayer COMP Audio sync value effectively defaults to 0.3. I had a try with -0.15 and it seems to have some effects. Not quite sure that it is fixing the issue but it is definitely better.

As for the video / audio stuttering i had the videoFileIn TOP synced to timeline with FPS set to 25 and length according to the movie images number. Though i think it is a separate issue we cumulated with the sync issue and not sure it has anything to do with TD. As a workaround i ended up using a separate computer (macmini) using Millumin as the player and sent the video + audio feed as NDI to the TD computer which was used as a dispatcher to the 6 video projectors.

I have sent another movie if you need to have a further look.