Voice Banking to Support People Who Use Speech-Generating Devices: New Zealand Voice Donors’ Perspectives

Authors: Westley, M., Sutherland, D., & Bunnell, H. T.

Purpose

Voice banking is the process of recording an individual’s speech to create a personalized synthetic voice to use on speech-generating augmentative and alternative communication devices. This study set out to examine the experience of healthy voice donors during the ModelTalker voice banking process and to identify specific issues related to voice banking in the New Zealand context.

Method

Eight healthy adults and 2 children completed the ModelTalker voice banking protocol. All participants completed a questionnaire about their voice banking experience, including the length of time required as well as the ease and the technical aspects of the process.

Results

The median time taken to complete the voice banking process was 5 hr 30 min (range: 3 hr 10 min to 11 hr). Questionnaire responses included themes related to the voice banking process, such as increased awareness of voice banking and its benefits, positive features and challenges of the ModelTalker process, and potential adaptations for the New Zealand context.

Conclusions

The findings support the use of ModelTalker with New Zealand speakers and inform development of voice banking protocols. The voices created as part of this study are available for people using speech-generating devices who want to use New Zealand–accented voices. Future research is needed to investigate the voice banking experiences of clinical populations, such as people with amyotrophic lateral sclerosis.

 

School of Psychology, Speech and Hearing University of Canterbury

Researcher

Dean Sutherland, PhD
Senior Lecturer
School of Psychology, Speech and Hearing
University of Canterbury

Current Research

I am passionate about supporting adults with complex movement and communication difficulties –  and the people who they communicate with. My research has focused on alternative communication techniques, use of assistive communication technology, and communication partner knowledge and skills.

My latest study focused on supporting adults with complex motor and speech difficulties to be able to have access to effective communication options. The study included testing a voice-banking protocol and voice donors and creating ‘Kiwi-accented’ voices that can be used on a variety of speech-generating communication systems for people who rely on these devices to communicate.

A publication from this study entitled “Voice Banking to Support People Who Use Speech-Generating Devices: New Zealand Voice Donors’ Perspectives” can be viewed here

Relationship to MND

Many people with motor neuron disease experience difficulty speaking – with many becoming unable to speak. They are candidates for using alternative and augmentative forms of communication. Accessing augmentative and alternative communication (AAC) systems with limited motor movement requires ‘alternative access’ methods (e.g., eye gaze) and also skilled communication partners (e.g., family and/ or caregivers).

Future Research

I am always interested in speaking with people with MND, students, clinicians, and researchers about collaborating on future research to better understand the communication needs and developing effective communication supports for people with MND.

Collaborations

Dr Catherine Theys, Senior Lecturer, School of Psychology, Speech and Hearing, University of Canterbury (no current collaborative projects)

Publications

Westley, M., Sutherland, D., & Bunnell, H. T. (2019). Voice Banking to Support People Who Use Speech-Generating Devices: New Zealand Voice Donors’ Perspectives. Perspectives of the ASHA Special Interest Groups4(4), 593-600. 

Contact

E: dean.sutherland@canterbury.ac.nz

P: 03-369-5090

 

Thoughtwired

ResearThought Wired Teamchers

Thought-Wired, are a multidisciplinary team consisting of:

Dr James Pau – Biomedical Engineer, Co-founder Dr Sarvnaz Taherian – Research Psychologist, Co-founder Dmitry Selitskiy – CEO, Co-founder They are based in Auckland, New Zealand and Melbourne, Australia.

Current Research

The team are conducting ongoing research and development of a brain-computer interface for people with severe physical disabilities, such as Motor Neuron Disease and Cerebral Palsy. The main aim is to create a completely physical free communication and interaction system, that utilises the electrical signals of the brain to control applications on a computer. So far, as part of this research and development they have released a wearable eye blink switch called Nous Blink (www.getnous.app)

They have already done several studies to help understand the design requirements to build this system – including software, hardware and training/support components.

They previously conducted an observational study with Motor Neuron Disease New Zealand that focused on the experience of using the prototype of their technology by people with Motor Neuron Disease. The methodology was user-centered and incorporated both quantitative and qualitative methods. They looked at how their training may help people master the technology (quantitative) and how they perceived using and interacting with the system (qualitative). They do not have a set schedule of studies at the moment, due to the impact of COVID-19 and having to put research studies on hold.

Relationship to MND

Due to the progressive nature of motor neuron disease, people may get to a stage where no existing assistive technology can improve their functional abilities or enable them to communicate. Because brain-computer interfaces only rely on brain activity, it has the potential to assist people who have lost physical function and enable them to continue to participate and communicate later in the stages of the disease.

Future Research

They may continue to test re-iterations of the technology design, as they have noticed that they learn the most when working with the actual customers.

They are also considering conducting an efficacy study of the first product – Nous Blink – a wearable eye blink switch, which is also applicable to users with progressed MND.

Identified Gaps

It would be good to get an understanding of how many people currently live with MND, and what stages of the disease.

The Team

Thoughtwired are a multidisciplinary team who have been developing this technology for the past 8 years. There idea was inspired by the CEO, Dmitry, who has a cousin with severe cerebral palsy. No existing form of assistive technology works for him, but from his interactions, they know that he has a sound mind – he just lacks the physical ability to communicate his thoughts. Dmitry came across a TED talk that discussed this technology, which inspired him to try a create something useful for people who may be in a similar situation to his cousin.

From here, Sarvnaz and James came on board to help develop and test the proof of concept. Both have backgrounds in academia at the University of Auckland, and approached the development through psychological and technical approach. This meant that from the inception, they have been working with the disability community to understand the needs of all the people who would be using and interacting with the technology.

Currently, Dmitry and James are ongoingly involved with Thought-Wired work, while Sarvnaz acts as a consultant alongside her role with ADHB.

Publications

Caregiver and special education staff perspectives of a commercial brain-computer interface as access technology: a qualitative study Sarvnaz Taherian & T. Claire Davies (2018) Caregiver and special education staff perspectives of a commercial brain-computer interface as access technology: a qualitative study, Brain-Computer Interfaces, 5:2-3, 73-87

Contact Details 

e: hello@thought-wired.com w: http://www.thought-wired.com/