The proposed innovation is to demonstrate the feasibility of creating a shared VR and AR world with photorealistic rendering of large-scale environment. The need for advanced extended immersive reality is critical in order to support future Lunar and Martian space missions training.
NASA JSC has been using Virtual Reality for many years to train the astronauts in limited world space, for instance the interior of an ISS module, the robotics arm of both Shuttle and Station. The Artemis missions will challenge the current set of VR training capabilities and will require the move to a greater virtual world realism, to a more collaborative work environment, to a mix of multiple modalities and to the use of the continuously improving VR and AR headsets. Tietronix is proposing to develop a framework and associated artifacts development tools and workflow that provide a photorealistic multi-user multi-modality shared environment. We foresee the capability of our framework to enable AR and VR users’ collaboration, and to provide a wider set of interactions and use cases as compared to immersive VR alone.
Complex assembly and maintenance tasks in space operational environments
NASA Gateway missions
NASA Artemis program
Lunar Rover Training
Active Response Gravity Offload System (ARGOS) project
Scientific Hybrid Reality Environment (SHyRE) project
Joint Augmented Reality Visual Informatics System (JARVIS)
Automotive assembly training
Airline pilot training
Power plant systems
Solar electrical generating plants operator and field technicians training
Department of Defense (DoD) large complex systems training