Survey and Comparative Analysis of Entropy and Relative Entropy Thresholding Techniques

Entropy-based image thresholding has received considerable interest in recent years. Two types of entropy are generally used as thresholding criteria Shannons entropy and relative entropy, also known as Kullback-Leibler information distance, where the former measures uncertainty in an information source with an optimal threshold obtained by maximizing Shannons entropy, whereas the latter measures the information discrepancy between two different sources with an optimal threshold obtained by minimizing relative entropy. Many thresholding methods have been developed for both criteria and reported in the literature. These two entropy-based thresholding criteria have been investigated and the relationship among entropy and relative entropy thresholding methods has been explored. In particular, a survey and comparative analysis is conducted among several widely used methods that include Pun and Kapurs maximum entropy, Kittler and Illingworths minimum error thresholding, Pal and Pals entropy thresholding and Chang et al.s relative entropy thresholding methods. In order to objectively assess these methods, two measures, uniformity and shape, are used for performance evaluation.