SlideShare a Scribd company logo
1 of 14
Masayuki Tanaka
Takashi Shibata
Masatoshi Okutomi
Gradient-Based
Low-Light Image
Enhancement
Background
1
Most common mistake is
blurring of moving objects or
by camera-shake.
Blurred image
Dark image
Increase shutter speed
Sensitivity of the sensor has been
improved.
But, we still have dark images
with fast shutter speed.
Low-Light Image Enhancement
2
Take photo
under
low-lightscene
Proposed Image EnhancementLow-Light Image Enhancement is
highly demanded.
We propose a gradient-
based low-light image
enhancement.
Gradient-Based Image Processing
3
Gradient
information
Intensity
information>
Shibata, Gradient-Domain Image Reconstruction Framework with Intensity-Range and Base-Structure
Constraints, CVPR2016
Important
for human visual system
Many gradient-
based image
processing
applications have
been proposed.
Gradient-based image processing
4
Gradient
extraction
Gradient
manipulation
Gradient
integration
Post
processing
Processing pipeline
Input
image
Output
image
Drawback of Gradient-based image processing
The intensity range of output image is unknown unless the integration is
performed. The intensity range of the output image often exceeds the
typical intensity range of [0,255].
We’ve gotten
saturation in the
output images.
Image
enhancement
Example of post-processing
5
Input image Processed image
×1.5
Intensity range of
processed image
exceeds [0,255]
Rescaling Intensity clipping Proposed
Proposed Integration
6
Shibata, Gradient-Domain Image Reconstruction Framework with Intensity-Range and Base-Structure
Constraints, CVPR2016
Gradient
extraction
Gradient
manipulation
Proposed
integration
Input
image
Output
image
Intensity range
information
𝐹𝐹 𝑢𝑢 𝑥𝑥 = � �
𝑑𝑑=ℎ,𝑣𝑣
𝜕𝜕𝑑𝑑 𝑢𝑢 𝑥𝑥 − 𝑞𝑞𝑑𝑑 𝑥𝑥 2
𝑑𝑑𝑑𝑑 + G𝑅𝑅[𝑢𝑢(𝑥𝑥)]
𝑢𝑢 𝐱𝐱
𝑔𝑔𝑅𝑅(𝑢𝑢 𝐱𝐱 )
𝑅𝑅 𝑚𝑚𝑚𝑚 𝑚𝑚 𝑅𝑅 𝑚𝑚𝑚𝑚𝑚𝑚
Intensity range
We penalize if the
intensity exceeds the
intensity range.This cost function means to
preserving the gradient
information while keeping
the intensity range within the
given intensity range.
Gradient Enhancement Strategy
7
Gradient
extraction
Gradient
manipulation
Proposed
integration
Input
image
Output
image
Intensity range
information
Intensity
Gradient manipulation: Higher gain for darker region
Input
gradient
Gain
generation
Enhanced
gradient
Intensity
Gain
β:15
1
τ:50
Experimental Comparisons
8
Input image Histogram equalization
Automatic tone correction
by photoshop
HDR tone mapping
by matlab
LIME (Guo2016)
Proposed
Experimental Comparisons
9
Input image Histogram equalization
Automatic tone correction
by photoshop
HDR tone mapping
by matlab
LIME (Guo2016)
Proposed
Experimental Results
10 Input images
Experimental Results
11 Proposed results
Real Time Demonstration
12
Conclusions
13
We propose have a gradient-based low-light
image enhancement.
• Higher gain for darker region
• Image integration with
intensity range constraint
Input image
Proposed result
matlab code is available on our project page:
http://www.ok.sc.e.titech.ac.jp/res/IC/LowLight/

More Related Content

What's hot

Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Simplilearn
 
morphological image processing
morphological image processingmorphological image processing
morphological image processing
John Williams
 
Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...
Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...
Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...
Simplilearn
 

What's hot (20)

Intensity Transformation and Spatial filtering
Intensity Transformation and Spatial filteringIntensity Transformation and Spatial filtering
Intensity Transformation and Spatial filtering
 
Image processing, Noise, Noise Removal filters
Image processing, Noise, Noise Removal filtersImage processing, Noise, Noise Removal filters
Image processing, Noise, Noise Removal filters
 
ResNet basics (Deep Residual Network for Image Recognition)
ResNet basics (Deep Residual Network for Image Recognition)ResNet basics (Deep Residual Network for Image Recognition)
ResNet basics (Deep Residual Network for Image Recognition)
 
Image Filtering in the Frequency Domain
Image Filtering in the Frequency DomainImage Filtering in the Frequency Domain
Image Filtering in the Frequency Domain
 
Image segmentation with deep learning
Image segmentation with deep learningImage segmentation with deep learning
Image segmentation with deep learning
 
Convolutional Neural Network Models - Deep Learning
Convolutional Neural Network Models - Deep LearningConvolutional Neural Network Models - Deep Learning
Convolutional Neural Network Models - Deep Learning
 
Active contour segmentation
Active contour segmentationActive contour segmentation
Active contour segmentation
 
1.arithmetic & logical operations
1.arithmetic & logical operations1.arithmetic & logical operations
1.arithmetic & logical operations
 
Image processing second unit Notes
Image processing second unit NotesImage processing second unit Notes
Image processing second unit Notes
 
Image Classification using deep learning
Image Classification using deep learning Image Classification using deep learning
Image Classification using deep learning
 
Object Detection using Deep Neural Networks
Object Detection using Deep Neural NetworksObject Detection using Deep Neural Networks
Object Detection using Deep Neural Networks
 
Deep Learning in Computer Vision
Deep Learning in Computer VisionDeep Learning in Computer Vision
Deep Learning in Computer Vision
 
Introduction to object detection
Introduction to object detectionIntroduction to object detection
Introduction to object detection
 
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
 
IMAGE SEGMENTATION.
IMAGE SEGMENTATION.IMAGE SEGMENTATION.
IMAGE SEGMENTATION.
 
Depth estimation using deep learning
Depth estimation using deep learningDepth estimation using deep learning
Depth estimation using deep learning
 
morphological image processing
morphological image processingmorphological image processing
morphological image processing
 
Digital Image Processing: Digital Image Fundamentals
Digital Image Processing: Digital Image FundamentalsDigital Image Processing: Digital Image Fundamentals
Digital Image Processing: Digital Image Fundamentals
 
Cnn
CnnCnn
Cnn
 
Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...
Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...
Deep Learning With Python | Deep Learning And Neural Networks | Deep Learning...
 

Similar to Gradient-Based Low-Light Image Enhancement

Deep gradient compression
Deep gradient compressionDeep gradient compression
Deep gradient compression
David Tung
 

Similar to Gradient-Based Low-Light Image Enhancement (20)

IMAGE PROCESSING
IMAGE PROCESSINGIMAGE PROCESSING
IMAGE PROCESSING
 
Super resolution-review
Super resolution-reviewSuper resolution-review
Super resolution-review
 
Image enhancement
Image enhancement Image enhancement
Image enhancement
 
Photometric calibration
Photometric calibrationPhotometric calibration
Photometric calibration
 
Image processing
Image processing Image processing
Image processing
 
X-Ray Image Enhancement using CLAHE Method
X-Ray Image Enhancement using CLAHE MethodX-Ray Image Enhancement using CLAHE Method
X-Ray Image Enhancement using CLAHE Method
 
Dip lect2-Machine Vision Fundamentals
Dip  lect2-Machine Vision Fundamentals Dip  lect2-Machine Vision Fundamentals
Dip lect2-Machine Vision Fundamentals
 
IMAGE PROCESSING.pptx
IMAGE PROCESSING.pptxIMAGE PROCESSING.pptx
IMAGE PROCESSING.pptx
 
satellite image enhancement
satellite image enhancementsatellite image enhancement
satellite image enhancement
 
Deep gradient compression
Deep gradient compressionDeep gradient compression
Deep gradient compression
 
An Introduction to Image Processing and Artificial Intelligence
An Introduction to Image Processing and Artificial IntelligenceAn Introduction to Image Processing and Artificial Intelligence
An Introduction to Image Processing and Artificial Intelligence
 
M017427985
M017427985M017427985
M017427985
 
DIP PPT (1).pptx
DIP PPT (1).pptxDIP PPT (1).pptx
DIP PPT (1).pptx
 
Image processing
Image processingImage processing
Image processing
 
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
 
Ijmsr 2016-10
Ijmsr 2016-10Ijmsr 2016-10
Ijmsr 2016-10
 
Low Light Image Enhancement Using Zero-DCE algorithm
Low Light Image Enhancement Using Zero-DCE algorithmLow Light Image Enhancement Using Zero-DCE algorithm
Low Light Image Enhancement Using Zero-DCE algorithm
 
IRJET- Heuristic Approach for Low Light Image Enhancement using Deep Learning
IRJET- Heuristic Approach for Low Light Image Enhancement using Deep LearningIRJET- Heuristic Approach for Low Light Image Enhancement using Deep Learning
IRJET- Heuristic Approach for Low Light Image Enhancement using Deep Learning
 
Seeing is Not Believing: Camouflage Attacks on Image Scaling Algorithms Review
Seeing is Not Believing: Camouflage Attacks on Image Scaling Algorithms ReviewSeeing is Not Believing: Camouflage Attacks on Image Scaling Algorithms Review
Seeing is Not Believing: Camouflage Attacks on Image Scaling Algorithms Review
 
IMAGE RESOLUTION ENHANCEMENT BY USING SWT AND DWT
IMAGE RESOLUTION ENHANCEMENT BY USING SWT AND DWTIMAGE RESOLUTION ENHANCEMENT BY USING SWT AND DWT
IMAGE RESOLUTION ENHANCEMENT BY USING SWT AND DWT
 

More from Masayuki Tanaka

遠赤外線カメラと可視カメラを利用した悪条件下における画像取得
遠赤外線カメラと可視カメラを利用した悪条件下における画像取得遠赤外線カメラと可視カメラを利用した悪条件下における画像取得
遠赤外線カメラと可視カメラを利用した悪条件下における画像取得
Masayuki Tanaka
 

More from Masayuki Tanaka (20)

Slideshare breaking inter layer co-adaptation
Slideshare breaking inter layer co-adaptationSlideshare breaking inter layer co-adaptation
Slideshare breaking inter layer co-adaptation
 
PRMU201902 Presentation document
PRMU201902 Presentation documentPRMU201902 Presentation document
PRMU201902 Presentation document
 
Year-End Seminar 2018
Year-End Seminar 2018Year-End Seminar 2018
Year-End Seminar 2018
 
遠赤外線カメラと可視カメラを利用した悪条件下における画像取得
遠赤外線カメラと可視カメラを利用した悪条件下における画像取得遠赤外線カメラと可視カメラを利用した悪条件下における画像取得
遠赤外線カメラと可視カメラを利用した悪条件下における画像取得
 
Learnable Image Encryption
Learnable Image EncryptionLearnable Image Encryption
Learnable Image Encryption
 
クリエイティブ・コモンズ
クリエイティブ・コモンズクリエイティブ・コモンズ
クリエイティブ・コモンズ
 
デザイン4原則
デザイン4原則デザイン4原則
デザイン4原則
 
メラビアンの法則
メラビアンの法則メラビアンの法則
メラビアンの法則
 
類似性の法則
類似性の法則類似性の法則
類似性の法則
 
権威に訴える論証
権威に訴える論証権威に訴える論証
権威に訴える論証
 
Chain rule of deep neural network layer for back propagation
Chain rule of deep neural network layer for back propagationChain rule of deep neural network layer for back propagation
Chain rule of deep neural network layer for back propagation
 
Give Me Four
Give Me FourGive Me Four
Give Me Four
 
Tech art 20170315
Tech art 20170315Tech art 20170315
Tech art 20170315
 
My Slide Theme
My Slide ThemeMy Slide Theme
My Slide Theme
 
Font Memo
Font MemoFont Memo
Font Memo
 
One-point for presentation
One-point for presentationOne-point for presentation
One-point for presentation
 
ADMM algorithm in ProxImaL
ADMM algorithm in ProxImaL ADMM algorithm in ProxImaL
ADMM algorithm in ProxImaL
 
Intensity Constraint Gradient-Based Image Reconstruction
Intensity Constraint Gradient-Based Image ReconstructionIntensity Constraint Gradient-Based Image Reconstruction
Intensity Constraint Gradient-Based Image Reconstruction
 
Least Square with L0, L1, and L2 Constraint
Least Square with L0, L1, and L2 ConstraintLeast Square with L0, L1, and L2 Constraint
Least Square with L0, L1, and L2 Constraint
 
Lasso regression
Lasso regressionLasso regression
Lasso regression
 

Recently uploaded

Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
Silpa
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 
POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
Silpa
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
1301aanya
 
Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformation
Areesha Ahmad
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 

Recently uploaded (20)

Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdf
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
Selaginella: features, morphology ,anatomy and reproduction.
Selaginella: features, morphology ,anatomy and reproduction.Selaginella: features, morphology ,anatomy and reproduction.
Selaginella: features, morphology ,anatomy and reproduction.
 
POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)
 
Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformation
 
Exploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdfExploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdf
 
Stages in the normal growth curve
Stages in the normal growth curveStages in the normal growth curve
Stages in the normal growth curve
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspects
 
Velocity and Acceleration PowerPoint.ppt
Velocity and Acceleration PowerPoint.pptVelocity and Acceleration PowerPoint.ppt
Velocity and Acceleration PowerPoint.ppt
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
 

Gradient-Based Low-Light Image Enhancement