Image Segmentation

Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging

Introduction

We propose an unsupervised texture image segmentation framework with unknown number of regions, which involves feature extraction and classification in feature space, followed by flooding and merging in spatial domain. The distribution of the features for the different classes are obtained by a block-wise unsupervised voting framework using the blocks grid graph or its minimum spanning tree and the Mallows distance.Experimental results are presented on on the Prague benchmark data set demonstrating the high-performance of the proposed scheme [1].

Methodology

Figure 2: The main steps of the proposed method.

The block size as well as the minimum (MINR) and the maximum (MAXR) number of possible regions are

the three parameters of the proposed method method. The proposed scheme [1] consists of several steps.

    • The image is divided into overlapping blocks, whose content is described by the distribution of three color Lab components and two components from wavelet transform to represent the texture [8].
    • The Voting framework [4-5] selects the MAXR representative blocks using as input the blocks grid graph or its minimum spanning tree and the Mallows distance (see Fig. 1).
    • Then, for each possible number of regions K ∈ {MINR, ...,MAXR}, we have performed the following steps (see lines 4-9 of Fig. 2). Based on the Mallows distance and the K first representative blocks as extracted by a Voting Framework, the rest blocks are grouped in clusters with homogeneous content. Then a k-centroids clustering procedure is applied using the Bhattacharyya distance between the distributions of features extracted from each block cluster. Based on the resulting clustering, the feature classes are extracted and described, one per cluster, and then, probabilistic distances are used to select and label a set of pixels that belong to each class with high confidence, thus providing an initial map of almost correctly labelled pixels. Different existing components of the same class are captured by the initial seed-regions. Having the data modelling available and the initial map of almost correctly labelled pixels, we have used an algorithm in order to fill the initial map of decisions, using statistical dissimilarity criteria. The new algorithm, Priority Multi-Class Flooding Algorithm (PMCFA) [2,3] imposes strong topology constraints in such a way that also allows topological flexibility. The segmentation map is constructed respecting the proximity principle. The final step of our framework is a statistical region merging algorithm [2].
    • Finally, we select the segmentation that minimizes a criterion taking into account the average likelihood per pixel of the classification map and penalizes the complexity of the regions boundaries.

Downloads

Related Publications

[1] C. Panagiotakis, I. Grinias, and G. Tziritas, Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging, First Prize on Unsupervised Image Segmentation - ICPR 2014 Contest, 2014.

[2] C. Panagiotakis, I. Grinias and G. Tziritas, Natural Image Segmentation based on Tree Equipartition, Bayesian Flooding and Region Merging, IEEE Trans. on Image Processing, IEEE Transactions on Image Processing, Vol. 20, No. 8, pp. 2276 - 2287, Aug. 2011.

[3]. I. Grinias, Bayesian Flooding for Image and Video Segmentation, University of Crete, PhD Thesis, 2009.

[4] C. Panagiotakis and P. Fragopoulou, Voting Clustering and Key Points Selection, International Conference on Computer Analysis of Images and Patterns, 2013.

[5] C. Panagiotakis, Clustering via Voting Maximization, submitted to Journal of Classification, 2013.

[6]. C. Panagiotakis, H. Papadakis, E. Grinias, N. Komodakis, P. Fragopoulou and G. Tziritas, Interactive Image Segmentation Based on Synthetic Graph Coordinates, Pattern Recognition, vol. 46, no. 11, pp. 2940-2952, Nov. 2013.

[7]. C. Panagiotakis, H. Papadakis, E. Grinias, N. Komodakis, P. Fragopoulou and G. Tziritas, Interactive Image Segmentation via Graph Clustering and Synthetic Coordinates Modeling, International Conference on Computer Analysis of Images and Patterns, 2013.

[8] S. Liapis, E. Sifakis, and G. Tziritas, Colour and texture segmentation using wavelet frame analysis, deterministic relaxation and fast marching algorithms, Journal of Visual Communication and Image Representation, vol. 15, no. 1, pp. 1–26, Mar. 2004.