< Back to list

Encoding VR sessions: image-based techniques to record and inspect immersive experiences

conferencePaper

DOI:10.1109/DigitalHeritage.2018.8810070
Authors: Fanini Bruno / Cinque Luigi

Extracted Abstract:

—Recording immersive VR sessions performed in virtual environments through HMDs - during public exhibits or permanent installations in a museum - may offer valuable insights on visitors propensities, physical workload, spatial affordances, focus and locomotion data. A first challenge raises from storage, where large amount of casual visitors need to be recorded on a daily basis, analyzed and possibly streamed to remote profes-sionals. For each VR session in fact, size of collected dataset may grow very quickly. Another issue is related to the visual inspection of such data, providing a team of experts tools that allow to revisit the whole history of a single or multiple sessions. We propose, formalize and discuss image-based encoding techniques and quantized signals for compact and light ”musical scores” that allow both common offline 2D image processing and interactive manipulation on modern desktop and mobile GPUs. We describe compact quantization methods and flexible volumetric observers, including location ignition and signatures. The paper discusses obtained results for different case studies where we employed such encodings, including desktop VR, WebVR and streaming of recorded sessions from cheap hardware. Keywords —Virtual reality, Data collection, Image analysis, Visualization, Web services I.

Level 1: Include/Exclude

  • Papers must discuss situated information visualization* (by Willet et al.) in the application domain of CH.
    *A situated data representation is a data representation whose physical presentation is located close to the data’s physical referent(s).
    *A situated visualization is a situated data representation for which the presentation is purely visual – and is typically displayed on a screen.
  • Representation must include abstract data (e.g., metadata).
  • Papers focused solely on digital reconstruction without information visualization aspects are excluded.
  • Posters and workshop papers are excluded to focus on mature research contributions.
Show all meta-data