Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video
vladbogo.substack.com
Today’s paper presents Video2Game, a new approach for automatically converting videos of real-world scenes into realistic and interactive game environments. The system leverages neural radiance fields (NeRF) to capture scene geometry and appearance, a mesh module for faster rendering, and a physics module to model object interactions and dynamics. This enables the construction of an interactable digital replica of the real world.
Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video
Video2Game: Real-time, Interactive, Realistic…
Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video
Today’s paper presents Video2Game, a new approach for automatically converting videos of real-world scenes into realistic and interactive game environments. The system leverages neural radiance fields (NeRF) to capture scene geometry and appearance, a mesh module for faster rendering, and a physics module to model object interactions and dynamics. This enables the construction of an interactable digital replica of the real world.