AI and VR research at Ontario Tech University in Oshawa improving lives of dementia patients

Artificial Intelligence and Virtual Reality isn’t just for today’s generation, declares an Associate Professor at Ontario Tech University working on improving the lives of people with dementia.

Dr. Winnie Sun of the university’s Faculty of Health Sciences is the lead author of a new research paper summarizing a strategy to integrate virtual reality reminiscence therapy into dementia care. Sun and her Ontario Tech research team are partnering in the project with the Alzheimer Society of Durham Region and Neurofit, a Toronto-based company that develops web platforms and adjustable digital activity environments to assist in neuro-rehabilitation.

While emerging technologies such as virtual reality (VR) and artificial intelligence (AI) tend to be embraced first by society’s younger generations, new research at Ontario Tech shows new tech can play a major role in ‘reminiscence therapy’ – a type of psychotherapy involving the recollection of past events to help people feel pleasure and an improved sense of well-being.

“Our preliminary work with immersive technologies like VR demonstrates that most people with dementia not only find the experience positive; they actually love what the technology can do for them, sometimes unlocking memories they’ve not recalled in a long time,” explained Sun, who has presented several papers and lectures on the importance of therapeutic self-care in promoting the safety of older adults in home care. “We reintroduce people with dementia to things like images of familiar destinations, family pictures, and tracks of favourite music. The overwhelming emotional responses to these sudden moments of cognitive recollection are incredible for people with dementia and their caregivers, as well as for health-care providers.”

The project is also connected to the work of the Advancement for Dementia Care Centre, a community-based partnership led by Ontario Tech and Ontario Shores Centre for Mental Health Sciences in Whitby that seeks solutions to improve the quality of life of people with dementia and caregivers through innovation in research and deployment of new technologies.

Dr. Winnie Sun, Ontario Tech

“This is technology-in-action, in a most compellingly ethical and humane way.”

Utilizing VR reminiscence therapy helps to stimulate memories and emotional responses by engaging multiple senses and can be particularly effective in comforting and reducing behavioural responses, she added. When a person living with dementia uses reminiscence therapy, it can build deeper connections to the past and reduce stress. Using VR technology complements traditional methods by addressing the emotional and cognitive needs of a person living with dementia in a more immersive way. It can also help relieve caregiver stress by allowing them to witness the person living with dementia being happy and engaged.

“Seeing the VR in action was remarkable and awe-inspiring,” says Dana Warner, the Behavioural Supports Ontario RPN at the dementia care centre. “I was not familiar with the use of advanced technology in dementia care and was uncertain to how participants would respond to the therapy. Each week they were eager to come back and use the VR device again. We were able to curate the therapies to their needs and interests, making it unique for each participant. I am eager to see how these advancements can support persons living with dementia and their care partners.”

The study uses the Oculus Meta Quest 3 headset, designed to bring people into an immersive 3D virtual world that feels close to real life. The headset can be programmed to display a complete virtual reality environment, or to ‘mixed reality’ by blending digital elements with the immediate surroundings (floor, walls, furniture), using optical sensors on the headset.

The Meta Quest 3’s high-resolution screens provide clear and detailed images as well as a large field of view (90 to 120 degrees). The headset tricks your brain into seeing depth and uses spatial audio, so sounds seem like they’re coming from specific places around you, making the experience more life-like.

The headset can also track hand movement, enabling interaction with virtual objects without the need for controllers. Hand controls can be used, however, as are ‘adaptive triggers’ which can make certain movements feel more realistic, such as adding resistance when you pull a virtual bowstring.

The results of Sun’s research were recently published in an electronics engineering journal and also presented this summer at the Serious Gaming and Health Application Conference in Funchal, Portugal.

“All kinds of exciting questions are being prompted following the success of our pilot project with Alzheimer Society Durham Region,” Sun said. “Where might artificial intelligence fit into the equation? Can we create the kinds of serious video games and easy-to-use devices that will gain widespread acceptance? Can we partner with health-care providers and expand to long-term care facilities to make these kinds of activities available to benefit those in need?”

More than 730,000 Canadians live with dementia, with the number growing by 350 people each day and that total is expected to surpass one million by 2030.

There are more than 25 different diseases and conditions can cause dementia, with Alzheimer’s the most common.

There is no cure.

With files from Bryan Oliver, Ontario Tech