Content area

Abstract

We present a novel method for 3D scene editing using diffusion models, designed to ensure view consistency and realism across perspectives. Our approach leverages attention features extracted from a single reference image to define the intended edits. These features are warped across multiple views by aligning them with scene geometry derived from Gaussian splatting depth estimates. Injecting these warped features into other viewpoints enables coherent propagation of edits, achieving high fidelity and spatial alignment in 3D space. Extensive evaluations demonstrate the effectiveness of our method in generating versatile edits of 3D scenes, significantly advancing the capabilities of scene manipulation compared to the existing methods. Project page: \url{https://attention-warp.github.io}

Details

1009240
Title
Diffusion-Based Attention Warping for Consistent 3D Scene Editing
Publication title
arXiv.org; Ithaca
Publication year
2024
Publication date
Dec 10, 2024
Section
Computer Science
Publisher
Cornell University Library, arXiv.org
Source
arXiv.org
Place of publication
Ithaca
Country of publication
United States
University/institution
Cornell University Library arXiv.org
e-ISSN
2331-8422
Source type
Working Paper
Language of publication
English
Document type
Working Paper
Publication history
 
 
Online publication date
2024-12-12
Milestone dates
2024-12-10 (Submission v1)
Publication history
 
 
   First posting date
12 Dec 2024
ProQuest document ID
3143451282
Document URL
https://www.proquest.com/working-papers/diffusion-based-attention-warping-consistent-3d/docview/3143451282/se-2?accountid=208611
Full text outside of ProQuest
Copyright
© 2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Last updated
2024-12-13
Database
2 databases
  • ProQuest One Academic
  • ProQuest One Academic