ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models
Abstract
ArtifactWorld improves sparse-view 3D Gaussian Splatting repair via a large paired video dataset, artifact heatmap localization, and guided spatio-temporal diffusion restoration.
3D Gaussian Splatting (3DGS) delivers high-fidelity real-time rendering but suffers from geometric and photometric degradations under sparse-view constraints. Current generative restoration approaches are often limited by insufficient temporal coherence, a lack of explicit spatial constraints, and a lack of large-scale training data, resulting in multi-view inconsistencies, erroneous geometric hallucinations, and limited generalization to diverse real-world artifact distributions. In this paper, we present ArtifactWorld, a framework that resolves 3DGS artifact repair through systematic data expansion and a homogeneous dual-model paradigm. To address the data bottleneck, we establish a fine-grained phenomenological taxonomy of 3DGS artifacts and construct a comprehensive training set of 107.5K diverse paired video clips to enhance model robustness. Architecturally, we unify the restoration process within a video diffusion backbone, utilizing an isomorphic predictor to localize structural defects via an artifact heatmap. This heatmap then guides the restoration through an Artifact-Aware Triplet Fusion mechanism, enabling precise, intensity-guided spatio-temporal repair within native self-attention. Extensive experiments demonstrate that ArtifactWorld achieves state-of-the-art performance in sparse novel view synthesis and robust 3D reconstruction. Code and dataset will be made public.
Community
๐ ArtifactWorld is now publicly available!
Our paper:
ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models
has been accepted by ACM Multimedia (ACM MM) 2026.
We release the official implementation, pretrained models, and benchmark for 3D Gaussian Splatting artifact restoration.
Resources:
- ๐ค Model: https://huggingface.co/buaadwxl/ArtifactWorld
- ๐ค Benchmark: https://huggingface.co/buaadwxl/ArtifactWorld-Benchmark
- ๐ป Code: https://github.com/fyting/ArtifactWorld
- ๐ Paper: https://arxiv.org/abs/2604.12251
We hope ArtifactWorld can facilitate research on 3DGS restoration and generative 3D vision.
Feel free to ask questions, share feedback, or discuss related ideas!
Get this paper in your agent:
hf papers read 2604.12251 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper