this can be expected if individual networks consume this kind of GPU memory. Once the memory is allocated for an operator, it is not freed up automatically.
You can try to make use of the .progressiveUnload() method of the COMP Class to attempt to free up memory when the component output is not being used.
Thanks for the suggestion. Im still pretty new to touchdesigner and I’m not sure what you mean, would I call this function from something like a DAT? (I havent got to playing with DATs yet)