Multi-Layer Joint Segmentation Using MRF and Graph Cuts

Nicolas Lermé (1) , Sylvie Le Hégarat-Mascle (1) , François Malgouyres (2) , Marie Lachaize (3)

1 SATIE - Systèmes et Applications des Technologies de l'Information et de l'Energie
2 IMT - Institut de Mathématiques de Toulouse UMR5219
3 VERI - Veolia Environnement Recherche et Innovation = Veolia Environnement Research and Innovation

The problem of jointly segmenting objects, according to a set of labels (of cardinality L), from a set of images (of cardinality K) to produce K individual segmentations plus one joint segmentation, can be cast as a Markov Random Field model. Coupling terms in the considered energy function enforce the consistency between the individual segmentations and the joint segmentation. However, neither optimality on the minimizer (at least for particular cases), nor the sensitivity of the parameters, nor the robustness of this approach against standard ones have been clearly discussed before. This paper focuses on the case where L>1, K>1 and the segmentation problem is handled using graph cuts. Noticeably, some properties of the considered energy function are demonstrated, such as global optimality when L=2 and K>1, the link with majority voting and the link with naive Bayes segmentation. Experiments on synthetic and real images depict superior segmentation performance and better robustness against noisy observations.

Domains: Image Processing [eess.IV]

Nicolas Lermé, Sylvie Le Hégarat-Mascle, François Malgouyres, Marie Lachaize. Multi-Layer Joint Segmentation Using MRF and Graph Cuts. Journal of Mathematical Imaging and Vision, inPress. ⟨hal-02125044v2⟩