The proposed R&D will develop a holographic augmented/mixed-reality (AR/MR) medical and surgical assist system for astronauts of exploration-class space missions. The system will enable users possessing minimal medical training to perform high-value, life-saving procedures that otherwise would exceed their capabilities. Astronauts can communicate with the system via natural modalities (speech, gaze, and hand gestures). In Phase I complete holographic apps for six medical procedures will be developed. In Phase II and beyond an entire suite of more than 100 procedures will be developed.
The innovation will directly support NASA’s exploration medical capability (ExMC) and can be used for terrestrial training and life-saving procedures on space missions. It will emphasize surgical and complex medical procedures that are likely to be needed on an exploration class space mission and that could be performed by a total of two or three people.
A possible non-NASA extension of the proposed project could be an AR/MR life-saving visualization aid for civilian, law enforcement, and military use. With such a system paramedics, military medics and other caregivers in the field can visualize a patient’s internal anatomy, diagnose the extent of the internal injury based on externally visible wounds, and treat the patient accordingly.