Fast Gradient Descent for Surface Capture Via Differentiable Rendering - INRIA - Institut National de Recherche en Informatique et en Automatique Access content directly
Conference Papers Year :

Fast Gradient Descent for Surface Capture Via Differentiable Rendering


Differential rendering has recently emerged as a powerful tool for image-based rendering or geometric reconstruction from multiple views, with very high quality. Up to now, such methods have been benchmarked on generic object databases and promisingly applied to some real data, but have yet to be applied to specific applications that may benefit. In this paper, we investigate how a differential rendering system can be crafted for raw multi-camera performance capture. We address several key issues in the way of practical usability and reproducibility, such as processing speed, explainability of the model, and general output model quality. This leads us to several contributions to the differential rendering framework. In particular we show that a unified view of differential rendering and classic optimization is possible, leading to a formulation and implementation where complete non-stochastic gradient steps can be analytically computed and the full perframe data stored in video memory, yielding a straightforward and efficient implementation. We also use a sparse storage and coarse-to-fine scheme to achieve extremely high resolution with contained memory and computation time. We show experimentally that results rivaling in quality with state of the art multi-view human surface capture methods are achievable in a fraction of the time, typically around a minute per frame.
Fichier principal
Vignette du fichier
Fast_Differential_Rendering_for_Multi_View_Surface_Capture-1.pdf (3.67 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03748662 , version 1 (09-08-2022)
hal-03748662 , version 2 (07-09-2022)


  • HAL Id : hal-03748662 , version 1


Briac Toussaint, Maxime Genisson, Jean-Sébastien Franco. Fast Gradient Descent for Surface Capture Via Differentiable Rendering. 3DV 2022 - International Conference on 3D Vision, Sep 2022, Prague, Czech Republic. ⟨hal-03748662v1⟩
613 View
384 Download


Gmail Facebook Twitter LinkedIn More