These notes are a summary of concepts presented in “Dual Reality: Merging the Real and Virtual.”
Lifton, J., Paradiso, J.A. (2010). Dual Reality: Merging the Real and Virtual. In: Lehmann-Grube, F., Sablatnig, J. (eds) Facets of Virtual Environments. FaVE 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 33. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11743-5_2
- Definition of Dual Reality
- Interaction between the real world and virtual world mediated by networks of sensors and actuators
- Both worlds are independent but enriched by their ability to reflect, influence, and merge with each other
- Elements
- Digital Omniscience
- Users explore phenomena across locations and scales using distributed displays and actuators
- Bidirectional enrichment
- Data from the real world enhances virtual environments, and vice versa
- Expanded senses
- Sensor networks expand human perception in space, time, and modality
- Digital Omniscience
- Design Implementation
- Focus on facilitating interaction rather than replicating all aspects of reality
- Integrating sensing capabilities in virtual environments for greater potential
- Self-Expression in Virtual Worlds
- Limitations
- Lacks scent, body language, and signs of wear and tear
- Enhancements
- Real-world sensor networks can import expressive elements into virtual environments
- Limitations
- The Vacancy Problem
- Definition
- Absence of a person in one world (real or virtual) while they engage in the other
- Manifestations
- In real life – people absorbed in themselves
- In virtual life – sparse population in virtual spaces
- Proposed Solution
- Scalable virtuality” – maintaining continuous connection between worlds via sensor networks and connect devices
- Definition
- Real-Virtual Interaction
- Mapping strategies
- Direct mapping may not be ideal; subjective perceptions could shape virtual worlds
- Hyper reality
- Analyzing real-world data and creating “data ponds” for efficient virtual browsing of sensor data
- Mapping strategies
- Sensor Networks in Dual Reality
- Real vs. virtual sensor networks
- Real – captures low-level nuances of the physical world
- Virtual – captures high-level context of virtual interactions
- Embedded and wearable sensors
- Embedded – sensing objects in virtual environments via interaction scripts
- Wearable – devices like sensing bracelets report avatar location, motion, and identity
- Real vs. virtual sensor networks
- Interaction and Correlation
- Correlation of real and virtual data to enhance experiences in both realms
- Applications
- Weaving sensor data into meaningful real or virtual narratives
- Creating and Consuming Dual Reality
- Creation and Consumption
- The process of transforming data into manifestations should be as rewarding as experiencing the outcome
- Real-world entropy can dynamically alter virtual environments
- Creation and Consumption