Communication Dans Un Congrès Année : 2026

ROI-NeRFs: Hi-Fi Visualization of Objects of Interest within a Scene by NeRFs Composition

Résumé

Efficient and accurate 3D reconstruction is crucial for cultural heritage applications. This study addresses the challenge of visualizing objects in complex scenes at high levels of detail (LOD) using Neural Radiance Fields (NeRFs), improving visual fidelity for selected objects while maintaining computational efficiency. The proposed ROI-NeRFs framework divides the scene into a Scene NeRF, capturing the overall scene at moderate detail, and multiple Region Of Interest (ROI) NeRFs, focusing on user-defined objects. An object-focused camera selection module automatically groups relevant cameras for each NeRF during the decomposition phase. In contrast, a Ray-level Compositional Rendering technique in the composition phase integrates Scene and ROI NeRFs for simultaneous multi-object rendering. Experiments on two real-world datasets, including a complex eighteenth-century cultural heritage room, demonstrate superior performance over baseline methods, enhancing LOD in object regions, minimizing artifacts, and maintaining efficient inference.

INTRODUCTION

3D reconstruction of cultural heritage sites is essential for creating digital twins used in archiving, conservation [Kong and Hucks, 2023], archaeology [Haibt, 2024], and interactive museum exhibitions [Liu and Chang, 2024].

Neural Radiance Field (NeRF) [Mildenhall et al., 2021] has emerged as a powerful alternative for novel view synthesis (NVS) with unprecedented image quality. NeRF learns scenes as continuous fields of volume density and view-dependent color using MLPs, achieving photorealistic rendering through differentiable volume rendering. However, most NeRF-based methods train a single model on all images of a scene, yielding renderings with a uniform level of detail (LOD). In large-scale scenes, this fixed resolution might lead to poor-quality when viewing close-up specific objects or regions of interest (ROI), while increasing detail globally would incur prohibitive computational costs.

Fichier principal
Vignette du fichier
VISAPP_RoiNeRF_camReady (1).pdf (18.98 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
licence

Dates et versions

hal-05489854 , version 1 (04-02-2026)

Licence

Identifiants

Citer

Quoc Anh Bui, Gilles Rougeron, Géraldine Morin, Simone Gasparini. ROI-NeRFs: Hi-Fi Visualization of Objects of Interest within a Scene by NeRFs Composition. Proceedings of the International Conference on Computer Vision Theory and Applications, Mar 2026, Marbella, Spain, Spain. pp.275-282, ⟨10.5220/0014222100004084⟩. ⟨hal-05489854⟩
2073 Consultations
133 Téléchargements

Altmetric

Partager

  • More