Illumination Space: A Feature Space for Radiance Maps

illumination_space_teaser
Figure: Radiance maps within the same cluster share similar illumination properties (a, b, c, and d). The features are visualized in the two scatterplots, which we call the ‘illumination space’, on the right.

Abstract

Radiance maps (RM) are used for capturing the lighting properties of real-world environments. Databases of RMs are useful for various rendering applications such as Look Development, live action composition, mixed reality, and machine learning. Such databases are not useful if they cannot be organized in a meaningful way. To address this, we introduce the illumination space, a feature space that arranges RM databases based on illumination properties.We avoid manual labeling by automatically extracting features from an RM that provides a concise and semantically meaningful representation of its typical lighting effects. This is made possible with the following novel contributions: a method to automatically extract a small set of dominant and ambient lighting properties from RMs, and a low-dimensional (5D) light feature vector summarising these properties to form the illumination space. Our method is motivated by how the RM illuminates the scene as opposed to describing the textural details of the RM image.

Publication and authors

Pacific Graphics 2020,  "Illumination Space: A Feature Space for Radiance Maps"
A. Chalmers (Victoria University of Wellington, NZ), T. Zickler (Harvard University, USA), T. Rhee (Victoria University of Wellington, NZ).