HyperSOR : Context-Aware Graph Hypernetwork for Salient Object Ranking

Salient object ranking (SOR) aims to segment salient objects in an image and simultaneously predict their saliency rankings, according to the shifted human attention over different objects. The existing SOR approaches mainly focus on object-based attention, e.g., the semantic and appearance of objec...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 9 vom: 01. Aug., Seite 5873-5889
1. Verfasser: Qiao, Minglang (VerfasserIn)
Weitere Verfasser: Xu, Mai, Jiang, Lai, Lei, Peng, Wen, Shijie, Chen, Yunjin, Sigal, Leonid
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000caa a22002652 4500
001 NLM368716570
003 DE-627
005 20240807232413.0
007 cr uuu---uuuuu
008 240222s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2024.3368158  |2 doi 
028 5 2 |a pubmed24n1494.xml 
035 |a (DE-627)NLM368716570 
035 |a (NLM)38381637 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Qiao, Minglang  |e verfasserin  |4 aut 
245 1 0 |a HyperSOR  |b Context-Aware Graph Hypernetwork for Salient Object Ranking 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 07.08.2024 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a Salient object ranking (SOR) aims to segment salient objects in an image and simultaneously predict their saliency rankings, according to the shifted human attention over different objects. The existing SOR approaches mainly focus on object-based attention, e.g., the semantic and appearance of object. However, we find that the scene context plays a vital role in SOR, in which the saliency ranking of the same object varies a lot at different scenes. In this paper, we thus make the first attempt towards explicitly learning scene context for SOR. Specifically, we establish a large-scale SOR dataset of 24,373 images with rich context annotations, i.e., scene graphs, segmentation, and saliency rankings. Inspired by the data analysis on our dataset, we propose a novel graph hypernetwork, named HyperSOR, for context-aware SOR. In HyperSOR, an initial graph module is developed to segment objects and construct an initial graph by considering both geometry and semantic information. Then, a scene graph generation module with multi-path graph attention mechanism is designed to learn semantic relationships among objects based on the initial graph. Finally, a saliency ranking prediction module dynamically adopts the learned scene context through a novel graph hypernetwork, for inferring the saliency rankings. Experimental results show that our HyperSOR can significantly improve the performance of SOR 
650 4 |a Journal Article 
700 1 |a Xu, Mai  |e verfasserin  |4 aut 
700 1 |a Jiang, Lai  |e verfasserin  |4 aut 
700 1 |a Lei, Peng  |e verfasserin  |4 aut 
700 1 |a Wen, Shijie  |e verfasserin  |4 aut 
700 1 |a Chen, Yunjin  |e verfasserin  |4 aut 
700 1 |a Sigal, Leonid  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 46(2024), 9 vom: 01. Aug., Seite 5873-5889  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:46  |g year:2024  |g number:9  |g day:01  |g month:08  |g pages:5873-5889 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2024.3368158  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 46  |j 2024  |e 9  |b 01  |c 08  |h 5873-5889