FluidFrames | video AI frame generation app

FluidFrames.RIFE is a Windows app powered by RIFE AI to create frame-generated and slowmotion videos.

• https://github.com/Djdefrag/QualityScaler / QualityScaler - image/video AI upscaler app
• https://github.com/Djdefrag/RealScaler / RealScaler - image/video AI upscaler app (Real-ESRGAN)

• RIFE - https://github.com/megvii-research/ECCV2022-RIFE
• PraticalRIFE - https://github.com/hzwer/Practical-RIFE

FluidFrames is completely written in Python, from backend to frontend.

• pytorch (https://github.com/pytorch/pytorch)
• onnx (https://github.com/onnx/onnx)
• onnxconverter-common (https://github.com/microsoft/onnxconverter-common)
• onnxruntime-directml (https://github.com/microsoft/onnxruntime)
• customtkinter (https://github.com/TomSchimansky/CustomTkinter)
• openCV (https://github.com/opencv/opencv)
• moviepy (https://github.com/Zulko/moviepy)
• pyInstaller (https://github.com/pyinstaller/pyinstaller)

Prerequisites.

• Python installed on your pc (https://www.python.org/downloads/release/python-3119/)
• VSCode installed on your pc (https://code.visualstudio.com/)
• FFMPEG.exe downloaded (https://www.gyan.dev/ffmpeg/builds/) RELEASE BUILD > ffmpeg-release-essentials.7z

Getting started.

• Download the project on your PC (Green button Code > Download ZIP)
• Extract the project from the .zip
• Extract FFMPEG.exe in /Assets folder
• Open the project with VSCode (Drag&Drop the project directory on VSCode)
• Click on FluidFrames.py from left bar (VSCode will ask to install Python plugins)
• Install dependencies. In VSCode there is the "Terminal" panel, click there and execute the command "pip install -r requirements.txt"
• Close VSCode and re-open it (this will refresh all the dependecies installed)
• Click on the "Play button" in the upper right corner of VSCode

• Windows 11 / Windows 10
• RAM >= 8Gb
• Any Directx12 compatible GPU with >= 2GB VRAM

• Elegant and easy to use GUI
• Resize video before interpolation
• Multiple GPUs support
• Compatible video - mp4, wemb, gif, mkv, flv, avi, mov, qt
• Video frame-generation STOP&RESUME
• PRIVACY FOCUSED - no internet connection required / everything is on your PC
• Video frames generation x2 / x4 / x8
  • 30fps => x2 => 60fps
  • 30fps => x4 => 120fps
  • 30fps => x8 => 240fps
• Video slowmotion x2 /x4
  • 30fps => x2_slowmotion => 30fps - 2 times slower
  • 30fps => x4_slowmotion => 30fps - 4 times slower
  • 30fps => x8_slowmotion => 30fps - 8 times slower

• 1.X versions
  • Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
  • New GUI with Windows 11 style
  • Include audio for processed video
  • Optimizing video frame resize and extraction speed
  • Multi GPU support (for pc with double GPU, integrated + dedicated)
  • Python 3.10 (expecting ~10% more performance)
  • Slowmotion function
• 2.X versions
  • New, completely redesigned graphical interface based on @customtkinter
  • Fluidify multiple videos at once
  • Save AI generated frames as files
  • Support RIFE AI model updates
  • Support for RIFE_Lite AI model (a faster and lighter version of RIFE)
• 3.x versions
  • New AI engine powered by onnxruntime-directml (https://github.com/microsoft/onnxruntime)
  • Python 3.11 (performance improvements)
  • Python 3.12 (performance improvements)
  • Display frame-generated videos info in the GUI
  • FFMPEG 7 (latest release)
  • Saving user settings (AI model, GPU, CPU etc.)
  • Video frame-generation STOP&RESUME
• 4.X version
  • Hardware accelerated video encoding (nvenc / amf / qsv)
  • More video extensions (.mp4 / .mkv / .avi / .mov)
  • Choose output resolution scaling
  • Video AI multi-threading frame generation
  • Updated AI-engine (onnxruntime-directml)
  • Video frames extraction by FFMPEG (x10 times faster)

1. Original / x4 / x2-slomotion

1. Original / x4 / x4-slomotion

1. Original / x2

1. Original / x2

1. Original / x2 / x2-slomotion