On-line Free-viewpoint Video:From Single to Multiple View Rendering

In recent years,many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering(VBR) methods.But actually,only few of them can render new views on-line.We present a new VBR system that creates new views of a dynamic scene in live.This system provides high quality images and does not require any background subtraction.Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware,graphics processing unit(GPU).Only one computer is used for both acquisition and rendering.The video stream acquisition is performed by at least 3 webcams.We propose an additional video stream management that extends the number of webcams to 10 or more.These considerations make our system low-cost and hence accessible for everyone.We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time.Our system is especially designed for stereovision using autostereoscopic displays.The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone.Due to GPU programming,our method provides up to 16 images of the scene in real-time.The use of both GPU and CPU makes this method work on only one consumer grade computer.