Image Warp based on structure points

General TouchDesigner Discussion
1

TD Gurus!

I would like to ‘warp’ or ‘morph’ an image of a face with facial tracking markers to match the corresponding facial tracking markers of another face. I’m wondering if there is a clever way to do this using the Displace TOP?

In other words, for each facial landmark point on the left face, compute the displacement it to the corresponding landmark on the right face, then apply that as an image displacement to the corresponding image point for the underlying face image, with a continuous interpolation between the facial landmarks. Basically I the effect would be my face (left) in the ‘shape’ of my wife’s (right).

LeoMaryFaces
LeoMaryFaces1280×720 58.4 KB

Any ideas of how to do this in TD to save me writing something in Python?

Any help would be appreciated. Thank you!
Leo

2

I figured out a solution for this - I was trying too hard to do this in TOPs on the GPU - turns out an elegant solve here is to use good old texture mapping on the flattened face geometry (extended to include the surrounding raster).

Can’t wait for POPs so type of SOP work can be done on the GPU - it’s slows down my frame rate quite a bit, but gets the job done.