An Athlone-based PhD candidate is exploring the use of Augmented Reality (AR) to cure people of walk abnormalities which, if left untreated, can lead to “wear and tear” arthritis and serious injuries.
Thiago Braga Rodrigues, a Brazilian biomedical engineer studying at Athlone Institute of Technology, is flipping traditional rehabilitation therapies on their head with an innovative technology-led approach that empowers patients.
“Traditionally, patients are given guided feedback in a clinical setting which requires the presence of an expert to inform the rehabilitation or re-training. It can also necessitate a patient travel many times to and from a clinic,” he explains.
As a complimentary therapy, Mr Braga Rodrigues is using AR smart glasses to help patients correct their walk abnormalities. His goal is to help patients better understand and react to feedback so that they can improve their gait in the comfort of their own home.
AR is an immersive mixed-reality technology, synonymous with apps like Instagram and Snapchat, which superimposes static and moving images on a real-world environment.
Mr Braga Rodrigues has adapted the technology so that patients wearing smart glasses see a series of projected circles in their field of vision; if their legs are correctly aligned as they walk, the centre-aligned circle flashes blue. The objective is to try to keep the circle blue for the duration of each session.
“I’m using AR in combination with a wearable sensor system to detect specific gait variables and process them to gain an understanding of a patient’s gait within typical threshold values,” he explains. “If a patient is outside of those thresholds, I can use AR to teach the patient how to adapt their gait technique in real-time.”
This real-time visual feedback, powered by AR, is proving an effective method of gait rehabilitation as it significantly reduces the number of knee misalignments which in turn reduces injury incidence.
Feedback is critical to all types of rehabilitation and is a powerful tool for motor skill learning. It helps patients process, organise, and interpret sensory perceptual information required to perform or learn a skill.
With AR feedback, visual cues are what prompt a patient to adjust their gait, whereas with haptic feedback, vibrations are delivered directly to the leg that the patient needs to change.
Mr Braga Rodrigues’ research, which is also concerned with users’ Quality of Experience (QoE), found that patients also favoured AR more highly than haptic feedback as they found it easier to adjust their gait when seeing cues than they did from feeling them.
The Athlone Institute of Technology researcher says that the technology’s potential is only starting to be explored. “The potential of AR as a portable, wearable and visual piece of technology is under-researched and certainly worth investigating further,” he explains. “It has a wide range of applications and is capable of augmenting human performance in a variety of ways.”
Now in the final write-up phase of his research, Mr Braga Rodrigues has just had his paper on the use of immersive mixed reality technology in correcting walk abnormalities accepted to one of the world’s leading scientific journals. The PhD candidate calls the PLOS One publication his “greatest achievement” to date.
According to PhD supervisor Dr Niall Murray, who is a leading researcher in the field of immersive technologies and a Science Foundation Ireland Funded Investigator in ADAPT and CONFIRM, this is a “significant milestone” for Thiago as he enters the final stages of his postgraduate studies.
“Having a paper accepted to a multidisciplinary journal like PLOS One with its impact factor and H5 index is a great achievement,” he says, adding: “The fact that PLOS One is an open access journal also means that his research will be easily accessible to the research community and general public.”
Pioneering in its approach, the academic journal makes papers avail to the public for free immediately upon publication. This open access model has been lauded for breaking down barriers to knowledge dissemination and ensuring equal access to information.
“The open access model is important as it makes research available to the scientific community in a timely, open manner,” Mr Braga Rodrigues explains. “I am delighted to have my first Quality of Experience (QoE) paper published in PLOS One.”
The PhD candidate, whose research is funded by the Irish Research Council of Ireland, came to Athlone Institute of Technology from Harvard Medical School, USA, where he studied biomechanics and bioinformatics.
“The PhD structure and the modules I undertook throughout the duration of my studies have really helped me further my academic career and enhance my skillset,” Mr Braga Rodrigues says.
“I’m extremely grateful to my supervisors, Dr Niall Murray (AIT), Dr Ciarán Ó Catháin (AIT) and Prof. Noel O’Connor (DCU), for their unending support, guidance and expertise.”
Soon to be graduating with his doctorate, Mr Braga Rodrigues has taken up a post as a lecturer within the Faculty of Engineering and Informatics at Athlone Institute of Technology.
Thiago Braga Rodrigues’ paper, entitled A Quality of Experience assessment of haptic and augmented reality feedback modalities in a gait analysis system, is now available.
Athlone Institute of Technology is a contemporary third level institute distinguished by academic excellence in teaching, learning and research. The institute was awarded The Sunday Times ‘Institute of Technology of the Year 2020, 2018 and Runner-Up in 2017. The institute also tops Ireland’s official league table for research and was listed in U-Multirank’s ‘Top 25 Performing Universities in the World for Interdisciplinary Research’ in 2018 and 2019. For information relating to the institute’s undergraduate and postgraduate programmes, visit http://www.ait.ie. #ChooseAIT