Personalized Saliency and Its Prediction

doi:10.1109/TPAMI.2018.2866563

	Personalized Saliency and Its Prediction
	Yanyu Xu1,2 ; Shenghua Gao1 ; Junru Wu 3; Nianyi Li 4; Jingyi Yu1
	2019-12-01
发表期刊	IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (IF:20.8[JCR-2023],22.2[5-Year])
ISSN	1939-3539
卷号	41 期号:12
发表状态	已发表
DOI	10.1109/TPAMI.2018.2866563
摘要	Nearly all existing visual saliency models by far have focused on predicting a universal saliency map across all observers. Yet psychology studies suggest that visual attention of different observers can vary significantly under specific circumstances, especially a scene is composed of multiple salient objects. To study such heterogenous visual attention pattern across observers, we first construct a personalized saliency dataset and explore correlations between visual attention, personal preferences, and image contents. Specifically, we propose to decompose a personalized saliency map (referred to as PSM) into a universal saliency map (referred to as USM) predictable by existing saliency detection models and a new discrepancy map across users that characterizes personalized saliency. We then present two solutions towards predicting such discrepancy maps, i.e., a multi-task convolutional neural network (CNN) framework and an extended CNN with Person-specific Information Encoded Filters (CNN-PIEF). Extensive experimental results demonstrate the effectiveness of our models for PSM prediction as well their generalization capabilityfor unseen observers.
URL	查看原文
收录类别	SCI ; SCIE ; EI
来源库	IEEE
引用统计	正在获取...
文献类型	期刊论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/28257
专题	信息科学与技术学院_博士生信息科学与技术学院_PI研究组_虞晶怡组信息科学与技术学院_PI研究组_高盛华组
作者单位	1.ShanghaiTech University, Pudong, China 2.University of Chinese Academy of Sciences, Beijing, China 3.Texas A&M University, College Station 4.University of Delaware, Newark, USA
第一作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Yanyu Xu,Shenghua Gao,Junru Wu,et al. Personalized Saliency and Its Prediction[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2019,41(12).
APA	Yanyu Xu,Shenghua Gao,Junru Wu,Nianyi Li,&Jingyi Yu.(2019).Personalized Saliency and Its Prediction.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,41(12).
MLA	Yanyu Xu,et al."Personalized Saliency and Its Prediction".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 41.12(2019).