TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation
Abstract
TransNormal-2 improves monocular normal estimation by correcting VAE reconstruction errors through geometry-aware training losses and a lightweight RGB-guided refinement module, achieving strong results with minimal annotations.
Diffusion-based models enable monocular geometry estimation, yet their pixel-space precision is limited by a shared, under-studied error source: VAE reconstruction degradation. The 8x spatial compression in the VAE encoder-decoder degrades surface normals at object boundaries; even encoding and decoding ground-truth normals introduces 1.3--8.5° of mean angular error (MAE), with edge MAE reaching 2.8x the global MAE. We present TransNormal-2, a FLUX.2-based rectified-flow framework with single-step deterministic inference that addresses this degradation on both sides of the VAE decoder: in how latent predictions are supervised during training, and in how decoded normals are corrected at inference. First, geometry-aware pixel-space losses, including inverse rendering self-consistency, von~Mises-Fisher angular loss, and wavelet edge-aware regularization, complement latent MSE by enforcing spherical normal geometry and diffuse image-formation cues after VAE decoding. Second, a lightweight Geometric Refinement Module (GRM) applies an RGB-guided residual correction to reduce boundary-localized decoding errors without freely rewriting the coarse prediction. On general-scene benchmarks, TransNormal-2 matches or exceeds MoGe-2 on all eight reported metrics while using only 1.4% as many task-specific normal annotations. The gains are clearest for transparent objects, reducing MAE by 4.2° on ClearGrasp and 3.1° on ClearPose over the strongest prior baselines. Code will be released at https://longxiang-ai.github.io/TransNormal-2.
Community
TL;DR: TransNormal-2 estimates surface normal maps from a single RGB image in one deterministic rectified-flow step on the FLUX.2 [klein] 9B backbone (LoRA-adapted), followed by a lightweight Geometric Refinement Module (GRM) that applies bounded residual correction to boundary-localized decoding errors. It matches strong feed-forward baselines (e.g. MoGe-2) on general scenes and substantially outperforms prior art on transparent objects (glass, liquids).
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- GHOST: Geometry-Guided Hallucination of Opaque Surface Textures (2026)
- When Latents Forget Pixels: Restoring Fidelity in Diffusion Transformer Super-Resolution (2026)
- FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry (2026)
- Video Generative Models as Geometry Learner (2026)
- PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation (2026)
- OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes (2026)
- ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.06665 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper