It would be great to use optical flow for frame interpolation. Ie. when using frame interpolation in Movie File In TOP or even more awesome in the TimeMachine TOP (would mean storing 2 more channels in the Texture3D TOP for the latter). So passing a float value for a point in time would use optical flow to calculate the correct inter-frame pixels (as opposed to simply blending from previous to next frame). Further to this, NVidia also have an Optical Flow SDK which has dedicated HW acceleration on newer GPUs so that would be a great way to implement (full frame rate at 4K).
3 Likes
i am also curious, have you found a way to get the motion interpolation?