Babytalk : understanding and generating simple image descriptions

We present a system to automatically generate natural language descriptions from images. This system consists of two parts. The first part, content planning, smooths the output of computer vision-based detection and recognition algorithms with statistics mined from large pools of visually descriptiv...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 35(2013), 12 vom: 01. Dez., Seite 2891-903
1. Verfasser: Kulkarni, Girish (VerfasserIn)
Weitere Verfasser: Premraj, Visruth, Ordonez, Vicente, Dhar, Sagnik, Li, Siming, Choi, Yejin, Berg, Alexander C, Berg, Tamara L
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2013
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, Non-P.H.S.
LEADER 01000naa a22002652 4500
001 NLM219854777
003 DE-627
005 20231224043943.0
007 cr uuu---uuuuu
008 231224s2013 xx |||||o 00| ||eng c
028 5 2 |a pubmed24n0733.xml 
035 |a (DE-627)NLM219854777 
035 |a (NLM)22848128 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Kulkarni, Girish  |e verfasserin  |4 aut 
245 1 0 |a Babytalk  |b understanding and generating simple image descriptions 
264 1 |c 2013 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 22.04.2016 
500 |a Date Revised 02.12.2018 
500 |a published: Print 
500 |a Citation Status MEDLINE 
520 |a We present a system to automatically generate natural language descriptions from images. This system consists of two parts. The first part, content planning, smooths the output of computer vision-based detection and recognition algorithms with statistics mined from large pools of visually descriptive text to determine the best content words to use to describe an image. The second step, surface realization, chooses words to construct natural language sentences based on the predicted content and general statistics from natural language. We present multiple approaches for the surface realization step and evaluate each using automatic measures of similarity to human generated reference descriptions. We also collect forced choice human evaluations between descriptions from the proposed generation system and descriptions from competing approaches. The proposed system is very effective at producing relevant sentences for images. It also generates descriptions that are notably more true to the specific image content than previous work 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
650 4 |a Research Support, U.S. Gov't, Non-P.H.S. 
700 1 |a Premraj, Visruth  |e verfasserin  |4 aut 
700 1 |a Ordonez, Vicente  |e verfasserin  |4 aut 
700 1 |a Dhar, Sagnik  |e verfasserin  |4 aut 
700 1 |a Li, Siming  |e verfasserin  |4 aut 
700 1 |a Choi, Yejin  |e verfasserin  |4 aut 
700 1 |a Berg, Alexander C  |e verfasserin  |4 aut 
700 1 |a Berg, Tamara L  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 35(2013), 12 vom: 01. Dez., Seite 2891-903  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:35  |g year:2013  |g number:12  |g day:01  |g month:12  |g pages:2891-903 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 35  |j 2013  |e 12  |b 01  |c 12  |h 2891-903