Adding Audio CHOPS together with different local time


I have a couple of video layers (with sound) that I trigger via a network command to play.
To comfortably control looping, playing delays and general time of play, each video layer is within a base that has its own component time.
The audio is read in (within that same component) via a audio File In CHOP.
If I pipe the audio streams out of that component and try to add them together in the project root with a Math CHOP it does not work. The sound is then indistinguishable from horribly crackling noise.

what would be the best way to add audio together from different component time sources?

is it a valid workaround to just use one audio device Out for each component that has its own timing?