Learning Adaptive Sampling and Reconstruction for Volume Visualization

A central challenge in data visualization is to understand which data samples are required to generate an image of a data set in which the relevant information is encoded. In this article, we make a first step towards answering the question of whether an artificial neural network can predict where t...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 28(2022), 7 vom: 19. Juli, Seite 2654-2667
1. Verfasser: Weiss, Sebastian (VerfasserIn)
Weitere Verfasser: Isk, Mustafa, Thies, Justus, Westermann, Rudiger
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM317787721
003 DE-627
005 20231225164010.0
007 cr uuu---uuuuu
008 231225s2022 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2020.3039340  |2 doi 
028 5 2 |a pubmed24n1059.xml 
035 |a (DE-627)NLM317787721 
035 |a (NLM)33211659 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Weiss, Sebastian  |e verfasserin  |4 aut 
245 1 0 |a Learning Adaptive Sampling and Reconstruction for Volume Visualization 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 27.05.2022 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a A central challenge in data visualization is to understand which data samples are required to generate an image of a data set in which the relevant information is encoded. In this article, we make a first step towards answering the question of whether an artificial neural network can predict where to sample the data with higher or lower density, by learning of correspondences between the data, the sampling patterns and the generated images. We introduce a novel neural rendering pipeline, which is trained end-to-end to generate a sparse adaptive sampling structure from a given low-resolution input image, and reconstructs a high-resolution image from the sparse set of samples. For the first time, to the best of our knowledge, we demonstrate that the selection of structures that are relevant for the final visual representation can be jointly learned together with the reconstruction of this representation from these structures. Therefore, we introduce differentiable sampling and reconstruction stages, which can leverage back-propagation based on supervised losses solely on the final image. We shed light on the adaptive sampling patterns generated by the network pipeline and analyze its use for volume visualization including isosurface and direct volume rendering 
650 4 |a Journal Article 
700 1 |a Isk, Mustafa  |e verfasserin  |4 aut 
700 1 |a Thies, Justus  |e verfasserin  |4 aut 
700 1 |a Westermann, Rudiger  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 28(2022), 7 vom: 19. Juli, Seite 2654-2667  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:28  |g year:2022  |g number:7  |g day:19  |g month:07  |g pages:2654-2667 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2020.3039340  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 28  |j 2022  |e 7  |b 19  |c 07  |h 2654-2667