EventHDR : From Event to High-Speed HDR Videos and Beyond

Event cameras are innovative neuromorphic sensors that asynchronously capture the scene dynamics. Due to the event-triggering mechanism, such cameras record event streams with much shorter response latency and higher intensity sensitivity compared to conventional cameras. On the basis of these featu...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - PP(2024) vom: 09. Okt.
1. Verfasser: Zou, Yunhao (VerfasserIn)
Weitere Verfasser: Fu, Ying, Takatani, Tsuyoshi, Zheng, Yinqiang
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM378696475
003 DE-627
005 20241010232954.0
007 cr uuu---uuuuu
008 241010s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2024.3469571  |2 doi 
028 5 2 |a pubmed24n1563.xml 
035 |a (DE-627)NLM378696475 
035 |a (NLM)39383083 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Zou, Yunhao  |e verfasserin  |4 aut 
245 1 0 |a EventHDR  |b From Event to High-Speed HDR Videos and Beyond 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 10.10.2024 
500 |a published: Print-Electronic 
500 |a Citation Status Publisher 
520 |a Event cameras are innovative neuromorphic sensors that asynchronously capture the scene dynamics. Due to the event-triggering mechanism, such cameras record event streams with much shorter response latency and higher intensity sensitivity compared to conventional cameras. On the basis of these features, previous works have attempted to reconstruct high dynamic range (HDR) videos from events, but have either suffered from unrealistic artifacts or failed to provide sufficiently high frame rates. In this paper, we present a recurrent convolutional neural network that reconstruct high-speed HDR videos from event sequences, with a key frame guidance to prevent potential error accumulation caused by the sparse event data. Additionally, to address the problem of severely limited real dataset, we develop a new optical system to collect a real-world dataset with paired high-speed HDR videos and event streams, facilitating future research in this field. Our dataset provides the first real paired dataset for event-to-HDR reconstruction, avoiding potential inaccuracies from simulation strategies. Experimental results demonstrate that our method can generate high-quality, high-speed HDR videos. We further explore the potential of our work in cross-camera reconstruction and downstream computer vision tasks, including object detection, panoramic segmentation, optical flow estimation, and monocular depth estimation under HDR scenarios 
650 4 |a Journal Article 
700 1 |a Fu, Ying  |e verfasserin  |4 aut 
700 1 |a Takatani, Tsuyoshi  |e verfasserin  |4 aut 
700 1 |a Zheng, Yinqiang  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g PP(2024) vom: 09. Okt.  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:PP  |g year:2024  |g day:09  |g month:10 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2024.3469571  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d PP  |j 2024  |b 09  |c 10