Intrinsic Decomposition, Inverse Rendering & Portrait Relighting

A curated reading list of intrinsic image decomposition, recovery of scene geometry/materials/lighting, and portrait relighting.

Scope: papers published at major vision, graphics and machine-learning conferences or journals, including CVPR, ICCV, ECCV, SIGGRAPH / SIGGRAPH Asia, NeurIPS, ICLR, AAAI, TPAMI, IJCV, TOG and CGF. 3DV, WACV, Eurographics / EGSR, and relevant workshops of these conferences are also included. Workshop papers are explicitly labeled. An arXiv link may point to the author version of an accepted paper; arXiv-only work is excluded.

DL means that the method uses deep learning: a trained network, a scene-optimized neural field/MLP, or a pretrained neural prior. non-DL covers explicit physical models and parameter optimization without such a component; automatic differentiation or Gaussian Splatting alone does not imply DL. Hybrid methods are placed in DL when their reconstruction or relighting pipeline uses neural components. Auxiliary masking/feature matching alone is not used to assign DL.

Years refer to the listed publication venue, rather than the first preprint. Resources are official code, data or author project pages where identified; an empty cell means no resource is linked here. Related papers are listed once under their main task. Dataset papers may also occur in method tables when the dataset accompanies a method.

Last literature audit: 2026-10-11. See research notes for search coverage, corrections and remaining limitations.

Table of contents

• Surveys
• Intrinsic Decomposition (non-DL)
• Intrinsic Decomposition (DL)
• Inverse Rendering (non-DL)
• Inverse Rendering (DL)
• Portrait Relighting (DL)
• Dataset

Surveys

Year	Pub	Paper	Resources
2017	Eurographics / CGF	Intrinsic Decompositions for Image Editing	Code Dataset
2021	CGF	Deep Neural Models for Illumination Estimation and Relighting: A Survey
2022	IJCV	A Survey on Intrinsic Images: Delving Deep Into Lambert and Beyond
2026	CGF	Recent Trends in Inverse Rendering

Intrinsic Decomposition (non-DL)

Year	Pub	Paper	Resources
2001	ICCV	Deriving Intrinsic Images from Image Sequences
2005	TPAMI	Recovering Intrinsic Images from a Single Image
2008	CVPR	Intrinsic Image Decomposition with Non-Local Texture Cues
2009	SIGGRAPH Asia	User-Assisted Intrinsic Images
2011	NeurIPS	Recovering Intrinsic Images with a Global Sparsity Prior on Reflectance
2012	EGSR / CGF	Intrinsic Images by Clustering
2016	SIGGRAPH	Live Intrinsic Video
2021	Eurographics	Interactive Photo Editing on Smartphones via Intrinsic Decomposition
2021	SIGGRAPH	Real-time Global Illumination Decomposition of Videos
2023	CVPR	Light Source Separation and Intrinsic Image Decomposition Under AC Illumination

Intrinsic Decomposition (DL)

Year	Pub	Paper	Resources
2015	ICCV	Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regression	Code
2015	ICCV	Learning Data-Driven Reflectance Priors for Intrinsic Image Decomposition
2017	CVPR	Learning Non-Lambertian Object Intrinsics across ShapeNet Categories
2017	NeurIPS	Self-Supervised Intrinsic Image Decomposition	Code / Dataset
2018	ECCV	CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering	Code / Dataset
2018	CVPR	CNN Based Learning Using Reflection and Retinex Models for Intrinsic Image Decomposition
2018	CVPR	Intrinsic Image Transformation via Scale Space Decomposition	Code / Dataset
2018	ECCV	Joint Learning of Intrinsic Images and Semantic Segmentation	Project
2018	CVPR	Learning Intrinsic Image Decomposition from Watching the World	Code / Dataset
2018	CVPR	Revisiting Deep Intrinsic Image Decompositions	Code
2018	ECCV	Single Image Intrinsic Decomposition without a Single Intrinsic Image
2018	Pacific Graphics	Unsupervised Deep Single-Image Intrinsic Decomposition using Illumination-Varying Image Sequences	Code
2019	ICCV	GLoSH: Global-Local Spherical Harmonics for Intrinsic Image Decomposition
2019	CVPR	InverseRenderNet: Learning single image inverse rendering	Code / Dataset
2019	CVPR	Learning to Separate Multiple Illuminants in a Single Image	Code & Dataset
2019	ICCV	Neural Inverse Rendering of an Indoor Scene From a Single Image
2019	ICCV Workshops (PBDL)	Single Image Intrinsic Decomposition with Discriminative Feature Encoding
2020	CVPR	Unsupervised Learning for Intrinsic Image Decomposition from a Single Image	Code
2021	IJCV	ShadingNet: Image Intrinsics by Fine-Grained Shading Decomposition	Code
2022	CVPR	PIE-Net: Photometric Invariant Edge Guided Network for Intrinsic Image Decomposition	Code
2023	TOG	Intrinsic Image Decomposition via Ordinal Shading	Code / Data
2023	CVPR	Unsupervised Intrinsic Image Decomposition With LiDAR Intensity
2024	TOG / SIGGRAPH Asia	Colorful Diffuse Intrinsic Image Decomposition in the Wild	Code
2024	CVPR	Intrinsic Image Diffusion for Indoor Single-view Material Estimation
2024	SIGGRAPH	IntrinsicDiffusion: Joint Intrinsic Layers from Latent Diffusion Models	Code
2025	ICLR	IDArb: Intrinsic Decomposition for Arbitrary Number of Input Views and Illuminations	Code & Data
2025	WACV	Unsupervised Single-Image Intrinsic Image Decomposition with LiDAR Intensity Enhanced Training
2026	CVPR	ReasonX: MLLM-Guided Intrinsic Image Decomposition
2026	CVPR	VT-Intrinsic: Physics-Based Decomposition of Reflectance and Shading using a Single Visible-Thermal Image Pair

Inverse Rendering (non-DL)

L: Lighting Estimation, G: Geometry Estimation, M: Material Estimation. In the legacy tables, a check indicates an estimated quantity; an empty cell does not assert that the quantity is absent from the pipeline. New entries describe the capture setting directly.

Material capture

Year	Pub	Paper	Resources	L	G	M
2010	SIGGRAPH	Manifold bootstrapping for SVBRDF capture			✓	✓
2013	SIGGRAPH	Practical SVBRDF Capture in the Frequency Domain			✓	✓
2014	SIGGRAPH ASIA	Appearance-from-Motion: Recovering Spatially Varying Surface Reflectance under Unknown Lighting		✓	✓	✓
2015	CGF	Mobile Surface Reflectometry			✓	✓
2015	SIGGRAPH	Two-Shot SVBRDF Capture for Stationary Materials	Code & Dataset		✓	✓
2016	SIGGRAPH ASIA	Recovering Shape and Spatially-Varying Surface Reflectance under Unknown Illumination		✓	✓	✓
2016	SIGGRAPH ASIA	Simultaneous Acquisition of Microscale Reflectance and Normals			✓	✓
2017	SIGGRAPH ASIA	Polarization imaging reflectometry in the wild			✓	✓
2018	SIGGRAPH ASIA	Simultaneous Acquisition of Polarimetric SVBRDF and Normals			✓	✓
2021	EGSR	Material and Lighting Reconstruction for Complex Indoor Scenes with Texture-space Differentiable Rendering		✓		✓
2021	Eurographics	Progressive Acquisition of SVBRDF and Shape in Motion			✓	✓

Physical models and differentiable optimization

Year	Pub	Paper	Resources	Focus / capture setting
1999	SIGGRAPH	Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs		Scene reflectance and global illumination
2015	TPAMI	Shape, Illumination, and Reflectance from Shading		SIRFS; single-image shape, reflectance and lighting
2020	ECCV	Polarimetric Multi-View Inverse Rendering		Multi-view geometry/material optimization with polarization
2021	EGSR / CGF	Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Rendering		Joint mesh and SVBRDF optimization

Explicit Gaussian inverse rendering

Year	Pub	Paper	Resources	Focus / capture setting
2024	CVPR	GS-IR: 3D Gaussian Splatting for Inverse Rendering	Code	Explicit Gaussians; material, lighting and occlusion baking
2024	ECCV	Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing		Explicit BRDF/light decomposition with point ray tracing
2025	CVPR	Differentiable Inverse Rendering with Interpretable Basis BRDFs		Flash capture; explicit Gaussians and basis BRDFs
2025	ICCV	Gaussian Splatting with Discretized SDF for Relightable Assets	Code	Explicit sampled SDF and Gaussian material parameters
2025	ICLR	GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Rendering		Explicit Gaussian decomposition with global illumination
2025	CVPR	IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray Tracing	Code	2D Gaussian ray tracing; inter-reflections
2025	CVPR	ReCap: Better Gaussian Relighting with Cross-Environment Captures	Code	Gaussian relighting with cross-environment captures
2025	CVPR	SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Rendering	Code	Spatially varying Gaussian parameters; indirect illumination

Inverse Rendering (DL)

Image-based estimation and material capture

Year	Pub	Paper	Resources	L	G	M
2016	SIGGRAPH	Reflectance Modeling by Neural Texture Synthesis			✓	✓
2017	CVPR	Deep Outdoor Illumination Estimation	Dataset	✓
2017	SIGGRAPH ASIA	Learning to Predict Indoor Illumination from a Single Image	Dataset	✓
2017	SIGGRAPH	Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networks	Code		✓	✓
2017	ICCV	Reflectance Capture using Univariate Sampling of BRDFs			✓	✓
2018	3DV	Learning to Estimate Indoor Lighting from 3D Objects	Code & Dataset	✓
2018	SIGGRAPH ASIA	Learning to Reconstruct Shape and Spatially-Varying Reflectance from a Single Image	Code / Dataset		✓	✓
2018	SIGGRAPH ASIA	Relighting Humans: Occlusion-Aware Inverse Rendering for Full-Body Human Images	Code & Dataset	✓	✓	✓
2018	SIGGRAPH	Single-Image SVBRDF Capture with a Rendering-Aware Deep Network	Code & Dataset		✓	✓
2019	CVPR	All-Weather Deep Outdoor Lighting Estimation	Dataset	✓
2019	ICCV	Deep Parametric Indoor Lighting Estimation	Dataset	✓
2019	CVPR	DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality		✓
2019	CVPR	Fast Spatially-Varying Indoor Lighting Estimation	Dataset	✓		✓
2019	CVPR	Neural Illumination: Lighting Prediction for Indoor Environments	Dataset	✓	✓
2020	CVPR	Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Image	Code / Dataset	✓	✓	✓
2020	CVPR	Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illumination	Code / Dataset	✓
2020	SIGGRAPH ASIA	MaterialGAN: Reflectance Capture using a Generative SVBRDF Model	Code		✓	✓
2020	ECCV	Object-Based Illumination Estimation with Rendering-Aware Neural Networks		✓		✓
2020	ECCV	Single-Shot Neural Relighting and SVBRDF Estimation	Code / Dataset		✓	✓
2021	CVPR	Deep Polarization Imaging for 3D Shape and SVBRDF Acquisition	Dataset		✓	✓
2021	AAAI	EMLight: Lighting Estimation via Spherical Distribution Approximation		✓
2021	SIGGRAPH ASIA	Generative Modelling of BRDF Textures from Flash Images	Code		✓	✓
2021	SIGGRAPH	Highlight-Aware Two-Stream Network for Single-Image SVBRDF Acquisition			✓	✓
2021	ICCV	Learning Indoor Inverse Rendering with 3D Spatially-Varying Lighting		✓	✓
2021	CVPR	PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting	Code	✓	✓	✓
2021	CVPR	Shape and Material Capture at Home	Code & Dataset		✓	✓
2021	ICCV	SurfaceNet: Adversarial SVBRDF Estimation from a Single Image	Code		✓	✓
2022	CVPR	IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes	Code	✓	✓	✓

Neural fields, multi-view reconstruction and reflectance

Year	Pub	Paper	Resources	Focus / capture setting
2018	ECCV	Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image		Single mobile flash image; SVBRDF and normals
2020	ECCV	Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Images		Co-located-light capture; learned reflectance volumes
2020	ECCV	Invertible Neural BRDF for Object Inverse Rendering		Known geometry; normalizing-flow BRDF and illumination
2021	ICCV	NeRD: Neural Reflectance Decomposition From Image Collections	Code	Multi-view capture under varying unknown lighting
2021	SIGGRAPH Asia / TOG	NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	Code	Geometry, BRDF and unknown environment lighting
2021	CVPR	NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis		Known-light capture; neural reflectance and visibility
2021	NeurIPS	Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition		Neural pre-integrated lighting; reflectance decomposition
2022	CVPR	Extracting Triangular 3D Models, Materials, and Lighting From Images	Code	nvdiffrec; mesh, material and environment optimization
2022	CVPR	IRON: Inverse Rendering by Optimizing Neural SDFs and Materials From Photometric Images		Photometric capture; neural SDF and material textures
2022	CVPR	Modeling Indirect Illumination for Inverse Rendering	Project	InvRender; indirect lighting and visibility
2022	ECCV	NeILF: Neural Incident Light Field for Physically-Based Material Estimation	Code	Known geometry; neural incident light and material fields
2022	SIGGRAPH / TOG	NeROIC: Neural Rendering of Objects from Online Image Collections	Code	Online image collections; geometry, appearance and lighting
2022	ECCV	Neural Radiance Transfer Fields for Relightable Novel-View Synthesis with Global Illumination		Relightable neural transport with global illumination
2022	ECCV	PS-NeRF: Neural Inverse Rendering for Multi-View Photometric Stereo	Project	Multi-view photometric stereo; shape, materials and lights
2022	NeurIPS	SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections		Unconstrained image collections; shape and material
2022	NeurIPS	Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoising	Code	nvdiffrecmc; differentiable path tracing and denoising
2023	CVPR	DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering		Uncalibrated photometric stereo; shadows and anisotropy
2023	ICCV	Factorized Inverse Path Tracing for Efficient and Accurate Material-Lighting Estimation	Code	Known geometry; material and lighting via factored transport
2023	CVPR	I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFs	Project	Indoor neural SDF, material and radiance reconstruction
2023	ICCV	IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis		Room-scale albedo/shading decomposition in NeRF
2023	CVPR	Inverse Rendering of Translucent Objects Using Physical and Neural Renderers		Flash/no-flash capture; shape and subsurface scattering
2023	CVPR	MAIR: Multi-View Attention Inverse Rendering With 3D Spatially-Varying Lighting Estimation		Multi-view indoor geometry, SVBRDF and spatial lighting
2023	CVPR	Multi-View Inverse Rendering for Large-Scale Real-World Indoor Scenes	Project	TexIR; texture-based lighting and neural material fields
2023	CVPR	NeFII: Inverse Rendering for Reflectance Decomposition With Near-Field Indirect Illumination		Neural radiance cache for near-field indirect lighting
2023	ICCV	NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimation	Code	Joint geometry, material and inter-reflectable light fields
2023	ICCV	NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objects		Transparent objects; environment matting and relighting
2023	SIGGRAPH	NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images		Reflective objects; geometry, BRDF and lighting
2023	CVPR	Neural Fields Meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes		Urban scenes; neural geometry and mesh light transport
2023	ICCV	Neural Microfacet Fields for Inverse Rendering		Neural microfacet reflectance and geometry
2023	SIGGRAPH	Relighting Neural Radiance Fields with Shadow and Highlight Hints	Code	Moving-light capture; shadows and highlights constrain reflectance
2023	ICCV	ReNeRF: Relightable Neural Radiance Fields with Nearfield Lighting		Near-field lighting and relightable neural fields
2023	CVPR	TensoIR: Tensorial Inverse Rendering		Tensor-factorized geometry, reflectance and illumination
2023	CVPR	UMat: Uncertainty-Aware Single Image High Resolution Material Capture		Single diffuse image; normals, specularity and roughness
2023	CVPR	WildLight: In-the-Wild Inverse Rendering With a Flashlight	Code	Smartphone flashlight capture; neural shape and reflectance
2024	ECCV	Flash Cache: Reducing Bias in Radiance Cache Based Inverse Rendering		Low-bias neural radiance caching for inverse rendering
2024	ECCV	IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illumination	Project	Diffusion material priors for unknown-light reconstruction
2024	CVPR	Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields	Project	Neural plenoptic function for local light interactions
2024	CVPR	NeISF: Neural Incident Stokes Field for Geometry and Material Estimation		Polarized inverse rendering; neural incident Stokes field
2024	ECCV	Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering		Diffusion-guided inverse rendering for image compositing
2024	3DV	Physics-based Indirect Illumination for Inverse Rendering	Code	Multi-view geometry, materials and indirect lighting
2024	CVPR	SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild		Unconstrained images; pose, shape, material and lighting
2024	SIGGRAPH / TOG	TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstruction		Tensorial SDF; roughness-aware geometry and material
2024	ECCV	UniVoxel: Fast Inverse Rendering by Unified Voxelization of Scene Representation	Code	Voxel geometry/material and neural illumination
2024	CVPR	VMINer: Versatile Multi-view Inverse Rendering with Near- and Far-field Light Sources		Near- and far-field lighting; neural/surface rendering
2025	ICCV	InvRGB+L: Inverse Rendering of Complex Scenes with Unified Color and LiDAR Reflectance Modeling		RGB and LiDAR reflectance; large relightable scenes
2025	CVPR	IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images		Indoor material, HDR lighting and camera response
2025	CVPR	LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields		Feed-forward hexa-plane shape and material reconstruction
2025	CVPR	NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectrics		Polarized capture; conductors and dielectrics
2025	CVPR	PBR-NeRF: Inverse Rendering with Physics-Based Neural Fields	Code	Joint geometry, materials and lighting; physical priors
2025	CVPR	TensoFlow: Tensorial Flow-based Sampler for Inverse Rendering		Learned normalizing-flow importance sampling

Image and video decomposition, diffusion and material priors

Year	Pub	Paper	Resources	Focus / capture setting
2022	CVPR	PhyIR: Physics-Based Inverse Rendering for Panoramic Indoor Images		Panoramic indoor geometry, SVBRDF and lighting
2024	CVPR	Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectance		Single-image stochastic illumination and reflectance
2024	ECCV	MERLiN: Single-Shot Material Estimation and Relighting for Photometric Stereo		Single-image material estimation and photometric relighting
2024	SIGGRAPH	RGB↔X: Image Decomposition and Synthesis Using Material- and Lighting-aware Diffusion Models	Code	Image-space intrinsic channels and conditional synthesis
2025	CVPR	Channel-wise Noise Scheduled Diffusion for Inverse Rendering in Indoor Scenes		Single-image geometry, material and lighting diffusion
2025	CVPR	DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models	Code	Video diffusion for inverse and forward rendering
2025	ICCV	DNF-Intrinsic: Deterministic Noise-Free Diffusion for Indoor Inverse Rendering	Code	Deterministic diffusion/flow intrinsic prediction
2025	CVPR	Neural LightRig: Unlocking Accurate Object Normal and Material Estimation with Multi-Light Diffusion	Project	Multi-light diffusion priors; normal and material maps
2025	ICCV	Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering		Cycle-consistent single-step forward/inverse diffusion
2025	ICCV	SuperMat: Physically Consistent PBR Material Estimation at Interactive Rates	Project	Single-step diffusion; albedo, metallic and roughness
2025	CVPR	Uni-Renderer: Unifying Rendering and Inverse Rendering Via Dual Stream Diffusion		Dual-stream forward and inverse rendering diffusion
2026	CVPR	Intrinsic Image Fusion for Multi-View 3D Material Reconstruction		Diffusion material priors fused across views
2026	CVPR	MatMart: Material Reconstruction of 3D Objects via Diffusion		Multi-view material reconstruction with diffusion priors
2026	CVPR	MVInverse: Feed-forward Multiview Inverse Rendering in Seconds		Feed-forward multi-view normals, materials and diffuse shading
2026	CVPR	V-RGBX: Video Editing with Accurate Controls over Intrinsic Properties		Video intrinsic decomposition and controlled synthesis

Lighting estimation and HDR environments

Year	Pub	Paper	Resources	Focus / capture setting
2020	ECCV	PointAR: Efficient Lighting Estimation for Mobile Augmented Reality		RGB-D-conditioned mobile lighting estimation
2022	ECCV	Editable Indoor Lighting Estimation		Parametric lights and high-frequency illumination texture
2022	ECCV	StyleLight: HDR Panorama Generation for Lighting Estimation and Editing	Project	Single-image HDR panorama lighting estimation/editing
2023	ICCV	EverLight: Indoor-Outdoor Editable HDR Lighting Estimation		Editable indoor/outdoor HDR illumination
2024	CVPR	LightOctree: Lightweight 3D Spatially-Coherent Indoor Lighting Estimation		Octree-based spatially varying indoor lighting
2026	CVPR	Lighting in Motion: Spatiotemporal HDR Lighting Estimation		Spatiotemporal HDR environment lighting from diffusion

Human and face inverse rendering

Year	Pub	Paper	Resources	Focus / capture setting
2018	CVPR	SfSNet: Learning Shape, Reflectance and Illuminance of Faces 'in the Wild'		Single-face albedo, normals and illumination
2022	ECCV	Geometry-Aware Single-Image Full-Body Human Relighting		Full-body relighting with geometry and neural rendering
2024	CVPR	Artist-Friendly Relightable and Animatable Neural Heads		Relightable and animatable neural head reconstruction
2024	CVPR	IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing		Monocular dynamic humans; physically based ray tracing
2024	CVPR	Monocular Identity-Conditioned Facial Reflectance Reconstruction		Identity-conditioned face reflectance reconstruction
2025	CVPR	Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization		Generalizable monocular human relighting and harmonization
2025	CVPR	GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modeling	Project	Hair BSDF and learned light-aware residual
2025	CVPR	S^3-Face: SSS-Compliant Facial Reflectance Estimation via Diffusion Priors		Self-supervised face shape, shading and reflectance
2026	CVPR	WildCap: Facial Albedo Capture in the Wild via Hybrid Inverse Rendering		Smartphone facial albedo capture; learned and physical priors

Gaussian methods with neural components

Year	Pub	Paper	Resources	Focus / capture setting
2025	ICCV	GaRe: Relightable 3D Gaussian Splatting for Outdoor Scenes from Unconstrained Photo Collections		Outdoor Gaussians with learned intrinsic decomposition
2025	ICCV	GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering	Code	Neural material representation and mesh-guided Gaussians
2025	WACV	LumiGauss: Relightable Gaussian Splatting in the Wild	Code	Explicit Gaussians with MLP-predicted SH lighting
2025	CVPR	RNG: Relightable Neural Gaussians		Light-conditioned neural Gaussians; learned shading
2025	ICCV	SU-RGS: Relightable 3D Gaussian Splatting from Sparse Views under Unconstrained Illuminations		Sparse-view decomposition with pretrained semantic supervision
2026	CVPR	GHPT: Real-Time Relightable Gaussian Splatting using Hybrid Path Tracing		Gaussian/mesh path tracing; pretrained normal supervision
2026	CVPR	IR-HGP: Physically-Aware Gaussian Inverse Rendering for High-Illumination Scenes via Generative Priors		Gaussian inverse rendering with generative lighting priors
2026	CVPR	LumiMotion: Improving Gaussian Relighting with Scene Dynamics	Code	Dynamic Gaussians with learned deformation; material/light separation
2026	CVPR	MatSpray: Fusing 2D Material World Knowledge on 3D Geometry	Code	Diffusion material maps fused on Gaussians by a neural merger
2026	CVPR	SGS-Intrinsic: Semantic-Invariant Gaussian Splatting for Sparse-View Indoor Inverse Rendering	Project	Sparse-view indoor decomposition with semantic priors
2026	WACV	Spec-Gloss Surfels and Normal-Diffuse Priors for Relightable Glossy Objects		Glossy surfels with learned normal/diffuse priors

Scene and video relighting

Year	Pub	Paper	Resources	Focus / capture setting
2020	ECCV	Learning to Factorize and Relight a City		Outdoor time-varying illumination and permanent factors
2020	ECCV	Self-supervised Outdoor Scene Relighting		Self-supervised albedo, geometry, lighting and relighting
2021	CVPR Workshops (NTIRE)	Physically Inspired Dense Fusion Networks for Relighting		Depth-guided image relighting with intrinsic decomposition
2022	ECCV	NeRF for Outdoor Scene Relighting		NeRF-OSR; outdoor illumination and viewpoint editing
2023	CVPR	Complementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting		Outdoor relighting; CNN and NeRF intrinsic estimates
2023	CVPR	Weakly-Supervised Single-View Image Relighting	Project	Single-view image relighting with weak supervision
2024	WACV	Fast Sun-Aligned Outdoor Scene Relighting Based on TensoRF		Outdoor TensoRF relighting with sun alignment
2024	ECCV	The Sky's the Limit: Relightable Outdoor Scenes via a Sky-pixel Constrained Illumination Prior and Outside-In Visibility	Code	Outdoor relighting; sky-constrained illumination and visibility
2025	ICCV	Light-A-Video: Training-free Video Relighting via Progressive Light Fusion		Pretrained diffusion models; temporally consistent relighting
2025	ICCV	LightSwitch: Multi-view Relighting with Material-guided Diffusion		Multi-view material-guided diffusion relighting
2025	CVPR	LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relighting		Latent intrinsics for indoor image relighting
2025	SIGGRAPH	Physically Controllable Relighting of Photographs		Single-image relighting using intrinsic and geometric predictions
2026	CVPR	FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacement		Pretrained flow-model video relighting and background replacement

Portrait Relighting (DL)

Year	Pub	Paper	Resources
2019	ICCV	Deep Single-Image Portrait Relighting	Code / Data preparation
2019	SIGGRAPH	Single Image Portrait Relighting
2020	CVPR	Learning Physics-Guided Face Relighting Under Directional Light
2020	SIGGRAPH Asia / TOG	Light Stage Super-Resolution: Continuous High-Frequency Relighting
2020	TOG	Single Image Portrait Relighting via Explicit Multiple Reflectance Channel Modeling	Dataset
2021	SIGGRAPH	Learning to Relight Portraits for Background Replacement
2021	CVPR	Monocular Reconstruction of Neural Face Reflectance Fields
2021	ICCV	Neural Video Portrait Relighting in Real-time via Consistency Modeling	Code / Dataset
2021	WACV	Relighting Images in the Wild with a Self-Supervised Siamese Auto-Encoder
2022	CVPR	Face Relighting With Geometrically Consistent Shadows
2022	WACV Workshops (WACI)	Temporally Consistent Relighting for Portrait Videos
2023	ICCV	DiFaReli: Diffusion Face Relighting	Project
2023	CVPR	FaceLit: Neural 3D Relightable Faces
2023	CVPR	LightPainter: Interactive Portrait Relighting With Freehand Scribble
2023	ICCV	Relightify: Relightable 3D Faces from a Single Image via Diffusion Models
2023	WACV	SIRA: Relightable Avatars From a Single Image
2024	CVPR Workshops (EDGE)	EdgeRelight360: Text-Conditioned 360-Degree HDR Image Generation for Real-Time On-Device Video Portrait Relighting
2024	CVPR	Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image
2024	SIGGRAPH	Lite2Relight: 3D-aware Single Image Portrait Relighting
2024	WACV	Multi-Level Attention Aggregation for Aesthetic Face Relighting
2024	ECCV	Personalized Video Relighting With an At-Home Light Stage
2024	CVPR	Real-time 3D-aware Portrait Video Relighting
2024	CVPR	Relightable Gaussian Codec Avatars
2024	CVPR	Relightful Harmonization: Lighting-aware Portrait Background Replacement
2024	CVPR	SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting
2025	SIGGRAPH	GSHeadRelight: Fast Relightability for 3D Gaussian Head Synthesis	Code
2025	CVPR	High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Model	Code
2025	CVPR	Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset
2025	ICLR	Scaling In-the-Wild Training for Diffusion-based Illumination Harmonization and Editing by Imposing Consistent Light Transport	Code
2025	CVPR	SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Faces
2025	AAAI	Text2Relight: Creative Portrait Relighting with Text Guidance
2026	CVPR	GeoRelight: Learning Joint Geometrical Relighting and Reconstruction with Flexible Multi-Modal Diffusion Transformers	Project
2026	CVPR	RelightAnyone: A Generalized Relightable 3D Gaussian Head Model
2026	CVPR	Relightful Video Portrait Harmonization

Dataset

Year	Pub	Paper	Resources
2009	ICCV	Ground Truth Dataset and Baseline Evaluations for Intrinsic Image Algorithms	MIT Intrinsics
2012	ECCV	A Naturalistic Open Source Movie for Optical Flow Evaluation	MPI Sintel
2014	SIGGRAPH	Intrinsic Images in the Wild	Dataset
2017	CVPR	Shading Annotations in the Wild	Dataset
2019	ICCV	A Dataset of Multi-Illumination Images in the Wild	Code / Dataset
2021	ICCV	Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding	Dataset
2021	CVPR	OpenRooms: An Open Framework for Photorealistic Indoor Scene Datasets	Dataset
2023	CVPR	ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objects	Project
2023	NeurIPS Datasets & Benchmarks	Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmark	Code & Data
2024	CVPR	Towards a Perceptual Evaluation Framework for Lighting Estimation	Project
2025	ICCV	A Real-world Display Inverse Rendering Dataset	Project
2025	ICCV	HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesis
2025	ICCV	LightCity: An Urban Dataset for Outdoor Inverse Rendering and Reconstruction under Multi-illumination Conditions