NeRF 的成功:参考文献 [34] 中介绍的 NeRF 提出了一种在辐射场上使用体积渲染进行新颖视图合成的方法,随后的各种工作增强了其功能。 NeRF 的扩展:一些工作通过新的光线参数化、效率改进和动态场景的扩展扩展了 NeRF 的功能。 NeRF 的泛化:原始 NeRF 模型需要针对每个场景进行重新训练,这使得它们在实际应用中不太实...
对于每个输入帧,我们用深度编码器特征构造一个NeRF表示,并根据估计的相机姿态渲染它来解码另一个输入帧。 我们利用渲染帧和输入帧之间的重构损失来训练模型。 然而,单独使用重建损失很容易导致一个平凡的解决方案,因为估计的单目深度、相机姿势和NeRF表示不一定在相同的尺度上。 我们提出的一个关键技术贡献是在训练期间...
然而,这些基于NeRF的方法经常面临渲染速度限制,阻止了实时应用。方法[Xu,2024;Li,2024;Hu,2023;Wang,2024a;Ma,2024b;Wang,2024b]利用3D高斯splatting[Kerbl,2023]取得了出色的性能和渲染速度,但需要视频数据进行特定身份的训练,缺乏通用性。在本文中,我们提出一种基于dual-lifting方法的一次性3D高斯头部头像重建...
PubDate: Apr 2023 Teams: Georgia Institute of Technology;Rice University Writers: Yonggan Fu, Zhifan Ye, Jiayi Yuan, Shunyao Zhang, Sixu Li, Haoran You, Yingyan Lin PDF:Gen-NeRF: Efficient and Generalizable Neural Radiance Fields via Algorithm-Hardware Co-Design Abstract Novel view synthesis is...
Though existing NeRF-based methods can synthesize rather realistic details for human body, they tend to produce poor results when the input has self-occlusion, especially for unseen humans under sparse views. Moreover, these methods often require a large number of sampling points for rendering, ...
Sparse ViewZhaorong Wang Yoshihiro Kanamori Yuki EndoUniversity of Tsukubazhaorong.wang1997@gmail.com, {kanamori, endo}@cs.tsukuba.ac.jp#Inputs: 6 PSNR: 24.19s/frame: 0.047#Inputs: 4 PSNR: 31.27s/frame: 0.035#Inputs: 4 PSNR: 26.57s/frame: 15Ours KeypointNeRF GPS-Gaussian GTFigure 1....
Implicit neural representations, represented by Neural Radiance Fields (NeRF), have dominated research in 3D computer vision by virtue of high-quality visual results and data-driven benefits. However, their realistic applications are hindered by the need for dense inputs and per-scene optimization. ...
Cross-scene generalizable NeRF models, which can di- rectly synthesize novel views of unseen scenes, have be- come a new spotlight of the NeRF field. Several existing attempts rely on increasingly end-to-end “neuralized” ar- chitectures, i.e., replacing scene representation and/or ren- de...
Writers: Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia PDF:Generalizable Patch-Based Neural Rendering Abstract Neural rendering has received tremendous attention since the advent of Neural Radiance Fields (NeRF), and has pushed the state-of-the-art on novel-view synthesis considerably...
The success of the Neural Radiance Fields (NeRF) in novel view synthesis has inspired researchers to propose neural implicit scene reconstruction. However, most existing neural implicit reconstruction methods optimize per-scene parameters and therefore lack ...