In this video, I test out Stable Diffusion Video using different tools like Pinocchio, Hugging Face, and Replicate. I showcase the video quality, motion controls, and 3D understanding of this new model.
I also cover Final Frame – a web tool for extending AI generated videos by chaining clips from tools like Stable Diffusion Video. Final Frame allows arranging clips on a timeline and exporting longer videos.
LINKS
Pinoko: https://pinokio.computer/
Hugging Face: https://huggingface.co/spaces/multimodalart/stable-video-diffusion
Replicate: https://replicate.com/stability-ai/stable-video-diffusion
Replicate Interpolate: https://replicate.com/pollinations/rife-video-interpolation?input=form&output=preview
Replicate Upscale: https://replicate.com/lucataco/real-esrgan-video
Final Frame: Finalframe.net
Steve Mills: twitter.com/stevemills
Max: twitter.com/maxescu
Anu Anakash: twitter.com/anukaakash
If you’d like, please join the Patreon Here: patreon.com/TheoreticallyMedia
Join the Discord: https://discord.gg/nj294sEWqD
Follow Me on Twitter: https://twitter.com/TheoMediaAI
00:00 📽️ Stable Diffusion Video is an AI model for generating short high-quality videos from images, with 25 frames at 576×1024 resolution.
01:11 🎥 Users can achieve impressive video results with Stable Diffusion Video, and there are options to upscale and interpolate the output.
03:35 🌐 The model excels in understanding 3D space, resulting in consistent environments even with different image inputs.
04:40 ⚙️ Users can run Stable Diffusion Video locally using Pinkio or try it for free on Hugging Face or replicate it for more options.
06:06 🎨 Parameters like motion, noise, and frame rate can be adjusted to customize the video output.
07:50 🚀 Future improvements for Stable Diffusion Video include text-to-video, 3D mapping, longer video outputs, and more.
08:11 📹 Final Frame is a tool for merging AI-generated videos, offering a timeline for arranging clips
