Papers
arxiv:2604.12251

ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models

Published on Apr 14
Authors:
,
,

Abstract

ArtifactWorld improves sparse-view 3D Gaussian Splatting repair via a large paired video dataset, artifact heatmap localization, and guided spatio-temporal diffusion restoration.

3D Gaussian Splatting (3DGS) delivers high-fidelity real-time rendering but suffers from geometric and photometric degradations under sparse-view constraints. Current generative restoration approaches are often limited by insufficient temporal coherence, a lack of explicit spatial constraints, and a lack of large-scale training data, resulting in multi-view inconsistencies, erroneous geometric hallucinations, and limited generalization to diverse real-world artifact distributions. In this paper, we present ArtifactWorld, a framework that resolves 3DGS artifact repair through systematic data expansion and a homogeneous dual-model paradigm. To address the data bottleneck, we establish a fine-grained phenomenological taxonomy of 3DGS artifacts and construct a comprehensive training set of 107.5K diverse paired video clips to enhance model robustness. Architecturally, we unify the restoration process within a video diffusion backbone, utilizing an isomorphic predictor to localize structural defects via an artifact heatmap. This heatmap then guides the restoration through an Artifact-Aware Triplet Fusion mechanism, enabling precise, intensity-guided spatio-temporal repair within native self-attention. Extensive experiments demonstrate that ArtifactWorld achieves state-of-the-art performance in sparse novel view synthesis and robust 3D reconstruction. Code and dataset will be made public.

Community

๐ŸŽ‰ ArtifactWorld is now publicly available!

Our paper:

ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models

has been accepted by ACM Multimedia (ACM MM) 2026.

We release the official implementation, pretrained models, and benchmark for 3D Gaussian Splatting artifact restoration.

Resources:

We hope ArtifactWorld can facilitate research on 3DGS restoration and generative 3D vision.

Feel free to ask questions, share feedback, or discuss related ideas!

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2604.12251
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2604.12251 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2604.12251 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2604.12251 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.