Project Details

[Return to Previous Page]

Development of Immersive Dementia Care Simulation Modules Using Mixed Reality

Company: Center for Immersive Learning and Digital Innovation, Penn State University

Major(s):
Primary: CMPSC

Optional: BME, IE

Non-Disclosure Agreement: NO

Intellectual Property: NO

This interdisciplinary project will develop an immersive dementia care simulation module using Mixed Reality (MR). The goal is to train nursing, medical, and speech language pathology students to care for older adults with dementia and delirium. The outcomes will be compared with those of another team using Virtual Reality (VR). Both modules will include an AI enabled patient to support natural conversational interaction. In the VR module, the patient will be represented by a human like virtual avatar with AI generated responses. In the MR module, AI driven patient communication may be integrated with the existing physical patient model or implemented through an alternative MR design if it better supports the learning objectives. AI behavior must be constrained to the approved vignette and scenario logic, with scripted or decision tree fallback responses for critical safety moments. Deliverables include a working MR model, a basic interaction and data collection interface, curriculum integration documentation, and a brief technical guide describing the scenario flow and AI constraints. Student Qualifications Experience with Unity and C sharp, XR interaction design, and 3D asset development. AI-related skills could include API integration, voice input and output, and scenario based response control. Strong communication skills and interest in healthcare simulation are beneficial.