An overview study on the use of Semantics in Immersive Environments
Étude générale sur l'utilisation de la sémantique dans les environnements immersifs
Résumé
The use of semantics in immersive environments such as Virtual Reality (VR) and Augmented Reality (AR) offers new opportunities to enhance user interaction through multimodal interfaces, including gestures and voice commands. However, significant challenges persist due to the lack of formal and explicit semantic representations of both interaction contexts and virtual scene content. This paper offers a comprehensive review of current methods for integrating semantic data into virtual environments, with a focus on knowledge representation and rule-based reasoning. Using the PRISMA guidelines for systematic reviews, our analysis spans various applications, including science, education, and architecture in virtual and augmented environments. We explore the role of ontologies and knowledge representation in managing virtual environments, emphasizing how knowledge graphs and rule-based reasoning can improve the efficiency and comprehension of user interactions, particularly in generating multimodal commands. This paper identifies research gaps and proposes future directions for developing adaptable and interoperable semantic frameworks that can be reused across diverse virtual environment applications.
