File: tutorial-imgproc-contrast-sharpening.dox

package info (click to toggle)
visp 3.7.0-10
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 166,384 kB
  • sloc: cpp: 392,705; ansic: 224,448; xml: 23,444; python: 13,701; java: 4,792; sh: 207; objc: 145; makefile: 118
file content (124 lines) | stat: -rw-r--r-- 7,318 bytes parent folder | download
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
/**

\page tutorial-imgproc-contrast-sharpening Tutorial: Contrast and image sharpening techniques
\tableofcontents

\section imgproc_contrast_sharpening_intro Introduction

While the ViSP library is not intended to be an image processing library or replace a raster graphics editor, some easy image processing techniques can be used to improve the contrast and the sharpness of an image.

The different methods presented are:
- histogram stretching, see the corresponding <a href="https://docs.gimp.org/2.10/en/gimp-filter-stretch-contrast.html">Gimp documentation</a>.
- histogram stretching in the HSV color space, see the corresponding <a href="https://docs.gimp.org/2.10/en/gimp-filter-stretch-contrast-hsv.html">Gimp documentation</a>.
- histogram equalization, see the corresponding <a href="https://en.wikipedia.org/wiki/Histogram_equalization">Wikipedia entry</a>.
- contrast limited adaptive histogram equalization (CLAHE), see the corresponding <a href="https://en.wikipedia.org/wiki/Adaptive_histogram_equalization#Contrast_Limited_AHE">Wikipedia entry</a>.
- unsharp masking, an image sharpening technique, see the corresponding <a href="https://en.wikipedia.org/wiki/Unsharp_masking">Wikipedia entry</a>.

The first two methods consist of stretching the histogram of an image to make it use the entire range of values. It is more or less similar to the histogram equalization technique (presented in \ref imgproc_brightness_histogram_equalization).
The stretching will act like a direct mapping between the old and new intensity values whereas the histogram equalization will linearize the cumulative histogram distribution to try to make each intensity values the same weighting in the image.
The CLAHE algorithm will limit the contrast enhancement using a maximum slope value to avoid to amplify too much the image noise. It will also compute the cumulative histogram locally by sliding a window around the current pixel location.

\section imgproc_contrast_sharpening_example Example code

The following example also available in tutorial-contrast-sharpening.cpp will show the result of each of these methods on a low contrast image.

\include tutorial-contrast-sharpening.cpp

These functions are provided in a \a vp:: namespace and accessible using this include:

\snippet tutorial-contrast-sharpening.cpp Include

The first step is to read the input image:

\snippet tutorial-contrast-sharpening.cpp Read

The low contrast color image used in this tutorial can be downloaded <a href="https://upload.wikimedia.org/wikipedia/commons/f/fd/Crayfish_low_contrast.JPG">here</a> (By Biem (Own work) [Public domain], via Wikimedia Commons):

\image html img-tutorial-contrast-sharpening-Crayfish-low-contrast.png "Input low contrast color image"

The figure below represents the histogram and the cumulative histogram of the low contrast image. Most of the histogram bins are approximately in the [80 - 140] range, resulting in an image with low dynamic.

\image html img-tutorial-contrast-sharpening-Crayfish-low-contrast-hist.png "Histogram and cumulative histogram of the input image"

The histogram stretching can be done with:

\snippet tutorial-contrast-sharpening.cpp Stretch contrast

The result is:

\image html img-tutorial-contrast-sharpening-histogram-stretching.png "Histogram stretching"

The corresponding histogram and cumulative histogram are the following:

\image html img-tutorial-contrast-sharpening-histogram-stretching-hist.png "Histogram and cumulative histogram of the stretched histogram image"

This method stretches the histogram with a direct mapping between the old and the new intensity values. The histogram bins are more spread out and the image gains some dynamic. It will not change the intensity distribution as the histogram equalization method could do.

The histogram stretching on HSV colorspace can be done with:

\snippet tutorial-contrast-sharpening.cpp Stretch contrast HSV

\image html img-tutorial-contrast-sharpening-histogram-stretching-HSV.png "Histogram stretching on HSV colorspace"

The main difference is that this method will stretch the Saturation and Value components and preserve the Hue channel.

From the Gimp documentation:
<blockquote>
it works in HSV color space, rather than RGB color space, and it preserves the Hue. Thus, it independently stretches the ranges of the Hue, Saturation and Value components of the colors. Occasionally the results are good, often they are a bit odd.
</blockquote>

\image html img-tutorial-contrast-sharpening-histogram-stretching-HSV-hist.png "Histogram and cumulative histogram of the stretched histogram image in HSV colorspace"

The histogram and cumulative histogram are similar to the previous method as expected.

To improve the image contrast using the histogram equalization method:

\snippet tutorial-contrast-sharpening.cpp Histogram equalization

The result is:

\image html img-tutorial-contrast-sharpening-histogram-equalization.png "Histogram equalization"

If we look at the histogram and the cumulative histogram:

\image html img-tutorial-contrast-sharpening-histogram-equalization-hist.png "Histogram and cumulative histogram of the histogram equalized image"

The cumulative histogram is more linear which can be related to a more equal distribution of the pixel intensities in the image.

To use the CLAHE algorithm:

\snippet tutorial-contrast-sharpening.cpp CLAHE

The CLAHE method avoid the over amplification of the noise compared to the histogram equalization method:

\image html img-tutorial-contrast-sharpening-CLAHE.png "Contrast limited adaptive histogram equalization (blockRadius=150, bins=256, slope=3)"

The parameters are:
- the block radius: the size (2*blockRadius+1) of the neighborhood to consider around the current pixel location
- the number of bins for the histogram computation
- the maximum slope to limit the contrast enhancement

The histogram of the corrected image is stretched and the local processing plus the limitation of the contrast enhancement avoid the over boosting of the contrast as in the histogram equalization case.

\image html img-tutorial-contrast-sharpening-CLAHE-hist.png "Histogram and cumulative histogram after using the CLAHE method"

The unsharp masking will sharpen the edges in an image:

\snippet tutorial-contrast-sharpening.cpp Unsharp mask

It is applied here on the image after using the CLAHE algorithm:

\image html img-tutorial-contrast-sharpening-unsharp-masking.png "Unsharp masking (weight=0.5, Gaussian blur size=11) on the processed image after CLAHE"

Two parameters can be modified:
- the size of the Gaussian kernel, see vpImageFilter::gaussianBlur(const vpImage<double> &, vpImage<double> &, unsigned int, double, bool)
- the unsharp masking weighting: \f$ I_{sharpen} = \frac{\left( I_{original} - weight \times I_{blurred} \right)}{\left( 1 - weight \right)} \f$

To summarize, the techniques presented to improve the contrast of an image can do a good job in some situations and not in another.
The CLAHE algorithm and the unsharp masking can be tuned (but the default values should be good enough in most of the situation).

\section imgproc_contrast_sharpening_next Next tutorial

You can now read the \ref tutorial-imgproc-autothreshold, to learn how to automatically threshold / binarise a grayscale image.

*/