Skip to content

About

List of awesome papers on Dual-Pixel Imaging

Resources

Stars

24 stars

Watchers

3 watching

Forks

Latest commit

 

History

37 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

Dual Pixel

A curated list of Dual-Pixel (DP) imaging research: depth/disparity, defocus deblurring, autofocus, simulation, and computational photography.

Last literature review: 2026-10-11. See research notes for verification sources and limitations.

Table of contents

Scope

New entries prioritize peer-reviewed work at established vision, computational photography, graphics, robotics, and signal-processing conferences, and archival journals comparable to those already represented here. Acceptance/publication must be confirmed by proceedings, publisher metadata, or an author-maintained publication/project page. Preprints without confirmed acceptance are excluded.

The main table covers DP measurements and DP image formation, alongside the existing sensor papers. General restoration methods with explicit DP training or DP-pair experiments and Quad-Pixel (QP/QPD) extensions are listed separately. Merely using the single-image portion of DPDD or conventional stereo does not qualify. Year is the conference or journal volume year, rather than the first preprint date. Journal extensions are listed separately. Empty repository cells mean no official release was verified; placeholders and partial releases are labeled.

Dual Pixel

Year Pub Paper App Repo
2018 SIGGRAPH Synthetic Depth-of-Field with a Single-Camera Mobile Phone Depth / Segmentation / Synthetic DoF
2019 CVPR Reflection Removal Using a Dual-Pixel Sensor Reflection Removal Code
2019 ICCV Learning Single Camera Depth Estimation using Dual-Pixels Depth Code & Dataset
2020 ICCP Modeling Defocus-Disparity in Dual-Pixel Sensors Depth Code & Dataset
2020 CVPR Learning to Autofocus Autofocus Dataset
2020 ECCV Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels Disparity (w/Stereo)
2020 ECCV Defocus Deblurring Using Dual-Pixel Data Deblur Code & Dataset
2021 CVPR Dual Pixel Exploration: Simultaneous Depth Estimation and Image Restoration Depth / Deblur Code & Dataset
2021 CVPRW NTIRE 2021 Challenge for Defocus Deblurring Using Dual-pixel Images: Methods and Results Deblur
2021 CVPRW ATTSF Attention! Stay Focus! Deblur Code
2021 ICCV Defocus Map Estimation and Deblurring From a Single Dual-Pixel Image Deblur / Defocus Map Code & Dataset
2021 ICCV Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data Deblur Code & Dataset
2021 Hot Chips World Largest Mobile Image Sensor with All Directional Phase Detection Auto Focus Function Sensor / Autofocus
2021 ICTC Disparity probability volume guided defocus deblurring using dual pixel data Deblur
2021 Journal of Electronic Imaging Defocus deblurring: a designed deep model based on CNN Deblur
2021 VLSI Symposium All-Directional Dual Pixel Auto Focus Technology in CMOS Image Sensors Circuits / Autofocus
2021 TIFS Single-Shot Face Anti-Spoofing for Dual Pixel Camera Depth / Anti-spoofing
2022 WACV Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning Deblur Code & Dataset
2022 ISSCC A 1/1.57-inch 50Mpixel CMOS Image Sensor With 1.0μm All-Directional Dual Pixel by 0.5μm-Pitch Full-Depth Deep-Trench Isolation Technology Circuits
2022 ECCV Facial Depth and Normal Estimation using Single Dual-Pixel Camera Depth / Surface Normal / Anti-spoofing / Relighting Code & Dataset
2022 IEEE/CAA JAS BaMBNet: A Blur-Aware Multi-Branch Network for Dual-Pixel Defocus Deblurring Deblur / Defocus Map Code
2022 ICME Dynamic Multi-Scale Network for Dual-Pixel Images Defocus Deblurring with Transformer Deblur
2022 BMVC Dual-Pixel Raindrop Removal Raindrop Removal Code & Dataset
2023 CVPR K3DN: Disparity-Aware Kernel Estimation for Dual-Pixel Defocus Deblurring Deblur
2023 CVPR Spatio-Focal Bidirectional Disparity Estimation From a Dual-Pixel Image Depth / Disparity Code
2023 ICCP Learning to Synthesize Photorealistic Dual-pixel Images from RGBD frames Simulator Code & Dataset
2023 ICCV Exploring Positional Characteristics of Dual-Pixel Data for Camera Autofocus Autofocus
2023 ICASSP MRNET: Multi-Refinement Network for Dual-Pixel Images Defocus Deblurring Deblur
2024 CVPR CADS: Passive Snapshot Coded Aperture Dual-Pixel RGB-D Imaging Depth / Deblur Code
2024 CVPR LDP: Language-driven Dual-Pixel Image Defocus Deblurring Network Deblur Code
2024 3DV Continuous Cost Aggregation for Dual-Pixel Disparity Extraction Depth / Disparity Code
2024 ECCV Resolving Scale Ambiguity in Multi-view 3D Reconstruction using Dual-Pixel Sensors Depth Code
2024 ICCP Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction Disparity / Light Field Video Code
2024 SIGGRAPH / TOG Split-Aperture 2-in-1 Computational Cameras Depth / HDR / Hyperspectral Imaging Project & Code links
2024 TPAMI Weakly-Supervised Depth Estimation and Image Deblurring via Dual-Pixel Sensors Depth / Deblur Warping component
2024 TPAMI Dual-Pixel Raindrop Removal Raindrop Removal Code & Dataset
2025 WACV Revisiting Disparity from Dual-Pixel Images: Physics-Informed Lightweight Depth Estimation Depth / Disparity Code & Dataset
2025 Neurocomputing Learning dual-pixel alignment for defocus deblurring Deblur / Alignment Code
2025 Engineering Applications of Artificial Intelligence Parallax-aware dual-view feature enhancement and adaptive detail compensation for dual-pixel defocus deblurring Deblur / Alignment
2025 MVA FMDP: Leveraging a Foundation Model for Dual-Pixel Disparity Estimation Depth / Disparity
2025 ICCV Simulating Dual-Pixel Images From Ray Tracing For Depth Estimation Simulator / Depth Code & Dataset
2025 ICCV Spatially-Varying Autofocus Autofocus / Depth / Optical All-in-Focus Imaging Project & Code links
2025 IROS DiFuse-Net: RGB and Dual-Pixel Depth Estimation using Window Bi-directional Parallax Attention and Cross-modal Transfer Learning RGB + DP Depth / DCDP Dataset
2025 ACM MM Enhanced Dual-Pixel Image Reflection Removal via Gaussian Splatting Reflection Removal / 3D Gaussian Splatting
2025 NeurIPS User-Instructed Disparity-aware Defocus Control Deblur / Refocus / DoF Control
2026 ICASSP Freq-DP Net: A Dual-Branch Network for Fence Removal using Dual-Pixel and Fourier Priors Fence Removal
2026 IJCV DCRR++: Unsupervised Reflection Removal and Novel View Synthesis via Dual-Pixel Guided 3D Gaussian Splatting Reflection Removal / Novel View Synthesis
2026 TPAMI DP-SfM: Dual-Pixel Structure-from-Motion without Scale Ambiguity Metric 3D Reconstruction Repository (code/data upcoming)
2026 ECCV (accepted) FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation Depth / Foundation Model Project (full code/data pending)

Restoration methods using DP data

These papers use DP pairs for training or evaluate a DP-pair input variant; their broader restoration architectures are not specific to DP sensors.

Year Pub Paper DP relevance Repo
2021 CVPR Iterative Filter Adaptive Network for Single Image Defocus Deblurring IFAN: DP disparity supervision during training; single-image inference and a DP-pair variant Code
2022 CVPR Restormer: Efficient Transformer for High-Resolution Image Restoration Single-image and DP-pair defocus deblurring Code
2023 TPAMI Learning Enriched Features for Fast Image Restoration and Enhancement MIRNet-v2: DP-pair defocus deblurring Code
2023 CVPR Efficient and Explicit Modelling of Image Hierarchies for Image Restoration GRL: single-image and DP-pair defocus deblurring Code
2024 CVPR Boosting Image Restoration via Priors from Pre-trained Models PTG-RM: refinement of GRL for DP-pair defocus deblurring
2025 WACV F2former: When Fractional Fourier Meets Deep Wiener Deconvolution and Selective Frequency Transformer for Image Deblurring Single-image and DP-pair defocus deblurring

Related Quad-Pixel research

QP/QPD sensors provide four sub-aperture measurements rather than the two of a DP sensor. Related datasets are kept separate below.

Year Pub Paper App Repo
2024 BMVC Disparity Estimation Using a Quad-Pixel Sensor QP Disparity / Synthetic Data Code & Dataset
2025 CVPR All-directional Disparity Estimation for Real-world QPD Images DP / QPD Disparity / QPD2K Dataset
2025 CVPR Quad-Pixel Image Defocus Deblurring: A New Benchmark and Model QP Defocus Deblurring / QPDD Dataset

Dataset

Links lead to author download instructions or papers describing the data; access restrictions and unverified download availability are indicated. Counts denote scenes, image sets, or pairs as specified.

Year Pub Paper Detail
2019 ICCV Learning Single Camera Depth Estimation using Dual-Pixels Train:2506, Test:684, Res:1512x2016(DP), 16bit png, DP Raw / Depth
2020 ICCP Modeling Defocus-Disparity in Dual-Pixel Sensors Num:100, Res:5180x2940, RGB 8bit jpg / 16bit tif Depth, DP LR / Depth
2020 ECCV Defocus Deblurring Using Dual-Pixel Data DPDD: 500 scenes (350 train / 74 validation / 76 test), Res:1680x1120, 16bit; DP L/R, combined blurry and sharp reference images; used for NTIRE 2021 (CVPRW)
2020 CVPR Learning to Autofocus 510 focal stacks with conventional/DP measurements and per-pixel depth from multi-view stereo; download instructions on the project page
2021 CVPR Dual Pixel Exploration: Simultaneous Depth Estimation and Image Restoration DP Simulator from NYUD Dataset
2021 ICCV Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data DP Simulator from SYNTHIA-SF dataset
2021 ICCV Defocus Map Estimation and Deblurring From a Single Dual-Pixel Image 17 indoor/outdoor scenes captured with Google Pixel 4; green-channel 14-bit DP data, calibrated blur kernels and vignetting patterns included in the repository
2022 ECCV Facial Depth and Normal Estimation using Single Dual-Pixel Camera More than 135K images of 101 people; metric depth, normals and calibration; signed license agreement and author request required
2023 ICCP Learning to Synthesize Photorealistic Dual-pixel Images from RGBD frames Num:5130, Res:1680x1120, RGB(DP LRC) 8bit png / Depth 16bit png
2024 TPAMI (BMVC 2022 precursor) Dual-Pixel Raindrop Removal Synthetic-Raindrop: 1960 train / 492 test pairs for each tilted/vertical setting; Real-Waterdrop: 130 tilted / 125 vertical test pairs; Real-Car: 94 tilted pairs; BMVC and expanded TPAMI versions available
2024 ICCP Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction dpMV: three-view DP video data for stereo distillation and light-field video reconstruction; public download not verified
2024 ECCV Resolving Scale Ambiguity in Multi-view 3D Reconstruction using Dual-Pixel Sensors DSLR/phone multi-view DP sequences for metric 3D reconstruction; download links in the repository
2025 WACV Revisiting Disparity from Dual-Pixel Images: Physics-Informed Lightweight Depth Estimation SEDC (Synthetic Edge Depth Completion): synthetic training data for DP disparity estimation, not real DP captures; Microsoft account and author-granted access required
2025 ICCV Simulating Dual-Pixel Images From Ray Tracing For Depth Estimation DP119: real DP/depth test set, Canon R6 Mark II + RF50mm, fixed focus at 1m and F/4; simulator and sample data also provided
2025 IROS DiFuse-Net DCDP (Dual-Camera Dual-Pixel): real RGB/DP/depth training benchmark introduced in the paper; public download not verified

Related QP datasets

Year Pub Paper / Dataset Detail
2024 BMVC QPDNet synthetic dataset Synthetic QP views and disparity generated from RGB-D data; see repository download instructions
2025 CVPR QPD2K 2100 real-world QPD image sets with disparity maps; public download not verified
2025 CVPR QPDD Quad-Pixel defocus deblurring benchmark; public download not verified

About

List of awesome papers on Dual-Pixel Imaging

Resources

Stars

24 stars

Watchers

3 watching

Forks

Releases

Packages

Contributors