Skip to content

YuriyN/awesome-light-field

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 

Repository files navigation

Awesome Light Field: Awesome

A curated list of awesome light field resources

Light field is a scene representation, described as a set of light rays in captured space, created by shifted full-size or micro-lenses

Basics

  • Gershun, The Light Field — first theorhetical description of a light field
  • Bolles et al., Epipolar-plane image analysis: An approach to determining structure from motion — first appearance and theory of epipolar-plane images, the important structure for light field analysis
  • Adelson and Bergen, The Plenoptic Function and the Elements of Early Vision — light field reformulation in a more convenient way
  • Levoy and Hanrahan, Light Field Rendering — two-plane parameterization of light field
  • Ng et al., Light Field Photography with a Hand-held Plenoptic Camera — description of a first plenoptic camera

Surveys

Datasets and benchmarks

Algorithms with available code

Depth Estimation

Title Year Framework Link
3D Convolutional Neural Network for Light Field Depth Estimation https://github.com/catdance124/3Dconv_LF_depth_estimation
Deep Coarse-to-fine Dense Light Field Reconstruction with Flexible Sampling and Geometry-aware Fusion https://github.com/jingjin25/LFASR-FS-GAF
Depth Estimation from 4D Light Field Videos https://github.com/mediaeng-lfv/LFV_Disparity_Estimation
Depth from Combining Defocus and Correspondence Using Light-Field Cameras https://github.com/Vincentqyw/depth-from-defocus-and-correspondence
Depthy https://github.com/hahnec/depthy
DistgDisp: Disentangling Mechanism for Light Field Disparity Estimation https://github.com/YingqianWang/DistgDisp
EPINET: A Fully-Convolutional Neural Network using Epipolar Geometry for Depth from Light Field Images https://github.com/chshin10/epinet
Efficient Light Field Reconstruction via Spatio-Angular Dense Network https://github.com/huzexi/SADenseNet
Empirical Bayesian Light-Field Stereo Matching by Robust Pseudo Random Field Modeling https://www.ee.nthu.edu.tw/chaotsung/rprf/index.html
Fast Light-field Disparity Estimation with Multi-disparity-scale Cost Aggregation https://github.com/zcong17huang/FastLFnet
High-Dimensional Dense Residual Convolutional Neural Network for Light Field Reconstruction https://github.com/monaen/LightFieldReconstruction
Intrinsic Light Field Decomposition and Disparity Estimation with a Deep Encoder-Decoder Network https://github.com/cvia-kn/lf_autoencoder_cvpr2018_code
Learning Sheared EPI Structure for Light Field Reconstruction https://github.com/GaochangWu/Sheared-EPI
Learning to Think Outside the Box: Wide-Baseline Light Field Depth Estimation with EPI-Shift https://github.com/titus-leistner/epi-shift
LFattNet: Attention-based View Selection Networks for Light-field Disparity Estimation https://github.com/LIAGM/LFattNet
MANet: Multi-scale Aggregated Network For Light Field Depth Estimation https://github.com/YanWQ/MANet
OccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation 2023 TensorFlow https://github.com/chaowentao/OccCasNet
Occlusion-Aware Cost Constructor for Light Field Depth Estimation https://github.com/YingqianWang/OACC-Net
On Linear Structure from Motion for Light Field Cameras https://publications.lightfield-analysis.net/
OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation 2023 PyTorch https://github.com/pengHTYX/OPAL
Robust Depth Estimation for Light Field via Spinning Parallelogram Operator https://github.com/shuozh/Spinning-Parallelogram-Operator
SubFocal: Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation 2023 TensorFlow https://github.com/chaowentao/SubFocal
Unsupervised disparity estimation from light field using plug-and-play weighted warping loss https://www.fujii.nuee.nagoya-u.ac.jp/Research/LFDepth/
Variational light field analysis for disparity estimation and super-resolution https://github.com/GilbertRC/Light-Field-Structure-Tensor-Depth-Estimation

Denoising

Title Year Framework Link
Light Field Denoising by Sparse 5D Transform Domain Collaborative Filtering https://github.com/V-Sense/LFBM5D
Pipeline for Noise Generation and Denoising of Light Fields (wavelet, BM3D, LFBM5D, DnCNN, LFDnPatch) 2023 C++ https://github.com/mmspg/Light-Field-Denoising
Robust Dense Light Field Reconstruction from Sparse Noisy Sampling 2021 https://github.com/sunshineHDU/NoisyLFRecon

Novel view synthesis

Title Year Framework Link
DistgASR: Disentangling Mechanism for Light Field Angular Super-Resolution 2022 PyTorch https://github.com/YingqianWang/DistgASR
Learning to Synthesize a 4D RGBD Light Field from a Single Image https://github.com/pratulsrinivasan/Local_Light_Field_Synthesis
Local Light Field Fusion https://github.com/Fyusion/LLFF
Multi-Angular Epipolar Geometry Based Light Field Angular Reconstruction Network https://github.com/ldyorchid/Multi_Angular_Epipolar_Geometry_Based_Light_Field_Angular_Reconstruction_Network
Real-Time Light Field Video Focusing and GPU Accelerated Streaming https://github.com/dormon/3DApps/blob/master/src/lightfieldPlayer.cpp
Lightweight All-Focused Light Field Rendering https://www.fit.vutbr.cz/~ichlubna/lf
Efficient Random-Access GPU Video Decoding for Light-Field Rendering https://github.com/ichlubna/lfEncoding

Super-resolution

Title Year Framework Link
DistgSSR: Disentangling Mechanism for Light Field Statial Super-Resolution https://github.com/YingqianWang/DistgSSR
DistgEPIT: Enhanced Disparity Learning for Light Field Image Super-Resolution (NTIRE 2023 solution) 2023 PyTorch https://github.com/OpenMeow/NTIRE23_LFSR_DistgEPIT
DPT: Detail-Preserving Transformer for Light Field Image Super-Resolution 2022 PyTorch https://github.com/BITszwang/DPT
EPIT: Learning Non-Local Spatial-Angular Correlation for Light Field Image Super-Resolution 2023 PyTorch https://github.com/ZhengyuLiang24/EPIT
Graph-Based Light Field Super-Resolution https://github.com/rossimattia/light-field-super-resolution
LF-DET: Exploiting Spatial and Angular Correlations With Deep Efficient Transformers for Light Field Image Super-Resolution 2023 PyTorch https://github.com/Congrx/LF-DET
LF-DGT: Multi-level Disparity-Guided Transformers for Light Field Spatial Super-Resolution 2025 PyTorch https://github.com/YigengLiao/LF-DGT
LF-DMnet: Real-World Light Field Image Super-Resolution via Degradation Modulation 2024 PyTorch https://github.com/YingqianWang/LF-DMnet
LFMamba: Light Field Image Super-Resolution with State Space Model 2024 PyTorch https://github.com/stanley-313/LFMamba
LFMT: Exploring Non-Local Spatial-Angular Correlations with a Hybrid Mamba-Transformer Framework for Light Field Super-Resolution 2025 PyTorch https://github.com/hsliu01/LFMT
LFSRDiff: Light Field Image Super-Resolution via Diffusion Models 2023 PyTorch https://github.com/chaowentao/LFSRDiff
LFT: Light Field Image Super-Resolution with Transformers 2022 PyTorch https://github.com/ZhengyuLiang24/LFT
LFTransMamba: NTIRE 2025 Light Field Super-Resolution Challenge Solution 2025 PyTorch https://github.com/OpenMeow/LFTransMamba
Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization https://github.com/jingjin25/LFSSR-ATO
Light Field Super-Resolution By Jointly Exploiting Internal and External Similarities https://github.com/Joechann0831/LFSR-FusNet
Residual Networks for Light Field Image Super-Resolution https://github.com/wxywhu/demo-resLF
Spatial-Angular Interaction for Light Field Image Super-Resolution https://github.com/YingqianWang/LF-InterNet
Light Field Spatial Super-resolution Using Deep Efficient Spatial-Angular Separable Convolution https://github.com/jingjin25/LFSSR-SAS-PyTorch

Other tasks

Title Year Framework Link
DRBNet: Learning to Deblur using Light Field Generated and Real Defocus Images 2022 PyTorch https://github.com/lingyanruan/DRBNet
Light Field Blind Motion Deblurring 2017 TensorFlow https://github.com/pratulsrinivasan/Light_Field_Blind_Motion_Deblurring
Light Field Salient Object Detection: A Review and Benchmark 2021 https://github.com/kerenfu/LFSOD-Survey
OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentation 2023 PyTorch https://github.com/FeiBryantkit/OAFuser
Style Transfer for Light Field Photography 2020 https://github.com/davidmhart/LightFieldStyleTransfer
VCD-Net: Real-time volumetric reconstruction of biological dynamics with light-field microscopy 2021 TensorFlow https://github.com/feilab-hust/VCD-Net

Light field and neural rendering

Title Year Framework Link
Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering 2021 PyTorch https://github.com/vsitzmann/light-field-networks
Light Field Neural Rendering 2022 JAX https://github.com/google-research/google-research/tree/master/light_field_neural_rendering
MobileR2L: Real-Time Neural Light Fields on Mobile Devices 2023 PyTorch https://github.com/snap-research/MobileR2L
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field 2022 PyTorch https://github.com/oppo-us-research/NeuLF
R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis 2022 PyTorch https://github.com/snap-research/R2L

Other

Compression and coding

Hardware, cameras and displays

Demos

Workshops and challenges

Research groups

Other resources

Releases

No releases published

Packages

 
 
 

Contributors