Is there a Touch Designer Stream Diffusion model that will permit higher resolutions than either 512x512 or at a push 1024x1024. We are attempting to develop HD 2K ,mp4 videos using this technique. I understand that the SD-turbo using TensorRT is speed optimized however we can tolerate slower output rates if we can get higher resolution for video. Upscaling is possible but in the end the better the source data the better the upscaled result.
Hey Anthony,
There are no models made specifically for TouchDesigner or for that matter Derivative does not directly support StreamDiffusion or StableDiffusion.
SD-Turbo is optimized for 512x512 so you should stick with it.
SDXL-Turbo - is also optimized for 512x512
SDXL is optimized for 1024x1024 but also gonna be slower.
I’ve been meaning to look at this model - ByteDance/SDXL-Lightning · Hugging Face .
You should refer to https://www.youtube.com/channel/UC23LFH5xg0EEmdhsLtnV7kQ for the latest on diffusion integrations in TouchDesigner.
In general, you can follow the SD-Turbo with nvupscaler TOP to upscale the 512x512 stream.
Cheers,
Jarrett