Virtual Worlds and Augmented Reality in Cultural Heritage Applications

Magnenat-Thalmann, N. and Papagiannakis, G.

Abstract: We describe a complete methodology for real-time integrated mixed reality systems that feature realistic complete simulations of animated virtual human actors (clothes, body, skin, face) who augment real environments and re-enact staged storytelling dramas. Although initially targeted at Cultural Heritage Sites, the paradigm is by no means limited to such subjects. The abandonment of traditional concepts of static cultural artifacts or rigid geometrical and textual augmentations with interactive, augmented historical character-based event representations in a mobile and wearable setup, is the main contribution of the described work as well as the proposed extensions to AR Enabling technologies: a VR/AR character simulation kernel framework with character to object interaction, a markerless camera tracker specialized for non-invasive geometrical registration on heritage sites and an NPR mixed reality illumination model for an alternative modal reality. We demonstrate a real-time case study on the actual site of an-cient Pompeii.

  booktitle = {Proc. Recording, Modeling and Visualization of Cultural Heritage, Baltsavias et al. (eds)},
  author = {Magnenat-Thalmann, N. and Papagiannakis, G.},
  title = {Virtual Worlds and Augmented Reality in Cultural Heritage Applications},
  publisher = {Taylor and Francis Group},
  pages = {419-430},
  month = jan,
  year = {2006},
  topic = {Virtual Heritage}