Vid2vid seems to be a promising technique for video synthesis using GANs, as of 2019, which is similar in spirit to it’s image counterpart, pix2pix. When setting this up, I found there are some additional requirements needed, than what’s stated at: https://github.com/NVIDIA/vid2vid.
I created my own environment.yml to make this setup easier (pytorch is specifically for CUDA 9.1, CUDNN 7.1.2, but you can edit the yml file and swap out this version based on the available pytorch versions, and it should work).
The gist is available at: https://gist.github.com/tharindu-mathew/7f79433d92d884fa662f6ccf023537e1
Caluadewa Tharindu Mathew's Website 