Spatial-aware global contrast representation for saliency detection

Abstract

Deep learning networks have been demonstrated to be helpful when used in salient object detection andachieved superior performance than the methods that are based on low-level hand-crafted features. In this paper, wepropose a novel spatial-aware contrast cube-based convolution neural network (CNN) which can further improve thedetection performance. From this cube data structure, the contrast of the superpixel is extracted. Meanwhile, thespatial information is preserved during the transformation. The proposed method has two advantages compared to theexisting deep learning-based saliency methods. First, instead of feeding the deep learning networks with raw imagepatches or pixels, we explore the spatial-aware contrast cubes of superpixels as training samples of CNN. Our method issuperior because the saliency of a region is more dependent on its contrast with the other regions than its appearance.Second, to adapt to the diversity of a real scene, both the color and textural cues are considered. Two CNNs, colorCNN and textural CNN, are constructed to extract corresponding features. The saliency maps generated by two cuesare concatenated in a dynamic way to achieve optimum results. The proposed method achieves the maximum precisionof 0.9856, 0.9250, and 0.8949 on three benchmark datasets, MSRA1000, ECSSD, and PASCAL-S, respectively, whichshows an improvement of performance in comparison to the state-of-the-art saliency detection methods.