Personalized Exposure Control Using Adaptive Metering and Reinforcement Learning

We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable. Our approach is based on Markov Decision Process (MDP). In the camera viewfinder or live preview mode, given the current frame, our system predicts the change in exposure so as to o...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 25(2019), 10 vom: 26. Okt., Seite 2953-2968
1. Verfasser: Yang, Huan (VerfasserIn)
Weitere Verfasser: Wang, Baoyuan, Vesdapunt, Noranart, Guo, Minyi, Kang, Sing Bing
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2019
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM287526844
003 DE-627
005 20231225054218.0
007 cr uuu---uuuuu
008 231225s2019 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2018.2865555  |2 doi 
028 5 2 |a pubmed24n0958.xml 
035 |a (DE-627)NLM287526844 
035 |a (NLM)30113896 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Yang, Huan  |e verfasserin  |4 aut 
245 1 0 |a Personalized Exposure Control Using Adaptive Metering and Reinforcement Learning 
264 1 |c 2019 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 10.07.2020 
500 |a Date Revised 10.07.2020 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable. Our approach is based on Markov Decision Process (MDP). In the camera viewfinder or live preview mode, given the current frame, our system predicts the change in exposure so as to optimize the trade-off among image quality, fast convergence, and minimal temporal oscillation. We model the exposure prediction function as a fully convolutional neural network that can be trained through Gaussian policy gradient in an end-to-end fashion. As a result, our system can associate scene semantics with exposure values; it can also be extended to personalize the exposure adjustments for a user and device. We improve the learning performance by incorporating an adaptive metering module that links semantics with exposure. This adaptive metering module generalizes the conventional spot or matrix metering techniques. We validate our system using the MIT FiveK [1] and our own datasets captured using iPhone 7 and Google Pixel. Experimental results show that our system exhibits stable real-time behavior while improving visual quality compared to what is achieved through native camera control 
650 4 |a Journal Article 
700 1 |a Wang, Baoyuan  |e verfasserin  |4 aut 
700 1 |a Vesdapunt, Noranart  |e verfasserin  |4 aut 
700 1 |a Guo, Minyi  |e verfasserin  |4 aut 
700 1 |a Kang, Sing Bing  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 25(2019), 10 vom: 26. Okt., Seite 2953-2968  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:25  |g year:2019  |g number:10  |g day:26  |g month:10  |g pages:2953-2968 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2018.2865555  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 25  |j 2019  |e 10  |b 26  |c 10  |h 2953-2968