Challenges of brain-computer interface facilitated cognitive assessment for children with cerebral palsy

Abstract

Brain-computer interfaces (BCIs) have been successfully used by adults, but little information is available on BCI use by children, especially children with severe multiple impairments who may need technology to facilitate communication. Here we discuss the challenges of using BCI with children, especially children who do not have another established method of communication with unfamiliar partners. Strategies to manage these challenges require consideration of multiple factors related to accessibility, cognition, and participation. Appropriate consideration of these factors revolves around the answer to three questions: 1) Where (home, clinic or lab) will participation take place? 2) How many sessions will be involved? 3) What degree of participation is expected from the child? Careful consideration of how to answer these questions while addressing the challenges inherent in BCI use by children with disabilities will establish a basis on which successful BCI calibration and adoption of BCI as an access method can occur.

Introduction

Brain-computer interfaces (BCIs) have long been considered communication tools for people with impairments that prevent verbal communication and manual computer access. The event-related potential BCI design introduced by Farwell and Donchin (1988) as the P300 BCI design has been used for daily communication in home environments by people with amyotrophic lateral sclerosis (ALS) (Sellers et al., 2010; Wolpaw et al., 2018). This non-invasive BCI design (Figure 1, left) presents stimuli on a computer screen, senses brain activity using electroencephalogram (EEG) electrodes, and interprets the EEG to determine to which single stimulus the user is paying attention. Although BCI has been successful for able-bodied adults and adults with acquired impairments, little is known about BCI use by children with severe multiple impairments who need technology for communication (Orlandi et al., 2021).

FIGURE 1

Figure 1. Left: Participant with cerebral palsy (CP) viewing first calibration screen. Adjustable monitor support enables optimal positioning. Right: Closeup of a later calibration screen, with the stimulus flashing for picture 3.

Cerebral palsy (CP) is one of the most common childhood disabilities (Odding et al., 2006). Approximately 25% of people with CP cannot talk (Novak et al., 2012; Acpr Group, 2013), while 15–19% have no method of communication (Parkes et al., 2010). With verbal comprehension often exceeding expressive capacities in children with complex communication needs (Sevcik, 2006), we created and studied (with publisher’s permission) BCI-facilitated access (Alcaide-Aguirre et al., 2017) to a standard receptive vocabulary test, the Peabody Picture Vocabulary Test, 4th edition, PPVT-4; (Dunn and Dunn, 2007). EEG was recorded with 32-location gel-based EEG caps (Electro-cap International, Inc., Eaton, OH, United States) and g.USBamps (g.tec medical engineering GmbH, Schiedlberg, Austria). Directing attention among four images in response to a recorded verbal prompt (Figure 1) enables BCI-facilitated access (Huggins et al., 2015). We used this access method with children and young adults (Alcaide-Aguirre et al., 2017), both typically developing and with CP, who could also complete the standard test format as a necessary first step in validating the new access method (American Educational Research Association et al., 1999). The 29 recruited participants, 18 with CP, were age 8–27 years (mean 15.0, SD 5.5). Primary or secondary CP type included spasticity in 88.9%, with primary or secondary ataxia in 11.2% and 5.6% dystonic. Primary or secondary tone was hemiplegic or bilateral spasticity, with 66.7% exhibiting hemiplegia and 33.4% exhibiting diplegia or quadriplegia. Functional mobility levels using Gross Motor Functional Classification System (GMFCS) (Palisano et al., 1997) scores were: level I-II 76.2%, level III 14.3%, and level IV-V 9.6%. Functional dexterity ratings using the Manual Ability Classification System (MACS) (Eliasson et al., 2006) included level I 71.4, level II 19.0, and level III 9.6%. The study focused on the psychometrics of BCI access to the PPVT-4, showing excellent measurement agreement with standardized administration (Warschausky et al., 2022). Our next step was evaluating BCI-facilitated tests with those for whom standardized test administration was inaccessible (Huggins et al., 2020). The 28 recruited participants were 10–43 years (mean 19.5, SD 9.4) with GMFCS scores of Level IV 17.9% and Level V 82.1% and MACS scores Level IV 28.6% and Level V 71.4%. Primary tone was spasticity (81.5%) and dystonia (29.6%) with 76.2% exhibiting quadriplegia, 19.0% diplegia, and 4.8% hemiplegia. A separate effort, involving 18 participants to date (age 13–79 years; mean 40.7 ± 18.6), is examining BCI access to a commercial speech generating device (Huggins et al., 2019) with 7-or 16-location gel electrodes or seven-location dry electrodes (VR300 amplifier from Wearable Sensing, San Diego, CA, United States). Here we discuss the challenges experienced with the 75 participants in these studies.

Challenges and compensatory strategies

Caregiver participation

The participation of trusted adults is important for any BCI use by children, especially children with multiple impairments. In our BCI lab, parents/guardians receive advance information about the BCI during the consent process, which may help set expectations. Parents have identified topics such as football, pictures of food, or specific cartoon characters as content that is motivating or of interest to a child to establish rapport and reduce potential participation anxiety. It is recommended that future studies systematically gather this type of information and incorporate the content into initial introductory materials and training stimuli. In the session, caregivers familiar with the child help to manage expectations regarding BCI procedures, assist with interpreting non-verbal communication, provide comfort, entertain the child during BCI setup, or focus their attention on a task. However, caregivers also can be a distraction or provide inaccurate instructions by well-meaning verbal or physical prompts.

Situational anxiety and motivation

Despite caregiver presence, some children still exhibited signs of anxiety when entering the study site. Children often need advance preparation for unfamiliar settings and task demands, which could be accomplished with video orientation materials (see Section “Comprehension of task”) and guided parent task-specific behavioral modeling. We have found that taking the BCI to the child’s home or other familiar environment can help alleviate anxiety. Children’s assent for participation should always be sought, although children without well-established communication methods will likely be unable to pose questions and only express lack of assent or a desire to end participation with non-verbal behaviors. These may include closed eyes, turning away from the screen or experimenter, or pretending to sleep.

Children’s willingness to use assistive technology also depends on their perception and experience of immediate benefits (Hemmingsson et al., 2009). In addition, there can be self-image related resistance to using unusual technologies in social situations (Hemmingsson et al., 2009; Murchland and Parkyn, 2010). Furthermore, there are individual differences in mastery motivation, or the willingness to persist in the face of the challenge of learning new technology.

Task demands

All elements of a BCI task should be evaluated for familiarity and fit with capabilities and experience. Before working with children who could not access the standardized vocabulary test, we carefully selected calibration words the children were likely to have experienced in either personal, educational, or entertainment contexts. Starting from word frequency lists, we excluded items that involved motor demands inaccessible to the child or with associated images that were ambiguous or scary. For this cross-cultural study, we also removed words with inconsistent meanings between the United States and Australia (e.g., cookie vs. biscuit). Illustrations were selected instead of photographs to facilitate the planned transition to the PPVT-4 vocabulary test (Dunn and Dunn, 2007), which uses illustrations.

A child who has never successfully used technology should not be expected to be immediately ready to follow multi-step instructions for BCI operation. However, gradual introduction of concepts involved in BCI use may be possible. During calibration, we supported the concept of picture identification by using color to highlight the target among grayscale non-targets. Further, we started with a single picture and three empty quadrants (Figure 1, left), then a picture with non-target generic shapes, and finally a target picture with three non-target pictures (Figure 1, right). Similarly, we first used a + character on the flashing labels before introducing the numeric labels that matched the PPVT-4 testing screens. However, the efficacy of this graded training is not yet clear.

Experience with choice-making

The most fundamental skill for participation in cognitive assessment or BCI use is the ability to make a choice (Van Tubbergen et al., 2008). In typically developing children, choice-making skill follows a developmental progression, from basic orienting, to preference, to directed choice in response to questions requiring indirect application of knowledge (e.g., can dogs fly?). Directed choice-making is needed for typical cognitive assessments. Yet, it can be difficult to determine if children with limited reliable overt communication have achieved directed choice-making. This is particularly true for children with CP who function at GMFCS (Palisano et al., 1997), MACS (Eliasson et al., 2006), and Communication Function Classification System (Hidecker et al., 2011) levels IV-V, which indicate inability to reliably move or talk without assistance (if at all). A child skilled with a communication device exhibits directed choice-making. However, children with lower levels of motor and communication function in effect can be “locked in” with limited recognition of their underlying capabilities. Further, without choice-making opportunities, they can be completely naïve to the most fundamental testing demands. Thus, even the initial preparatory and learning/practice trials may provide novel information regarding choice-making capabilities.

Screen layout and brain-computer interface stimuli

In our cognitive testing BCI design, the spatial separation between the vocabulary pictures and flashing labels (stimuli) added to the complexity of instructions. We subsequently considered (but have not yet tested) alternate stimulus types and locations. Face stimuli have been shown to improve BCI accuracy, especially for people with disabilities (Kaufmann et al., 2013). However, face stimuli may increase the complexity of instructions. We prefer the idea of integrating stimuli into the pictures or their backgrounds or using actual or simulated motion as the stimulus (Martens et al., 2009; Liu et al., 2010). If the stimulus is a small picture rotation, the user could be simply instructed to pay attention to the picture that matched the word and the response to the “movement” of the picture should be largely automatic.

Comprehension of task

To generate P300’s, the user must select a specific stimulus among the possible stimuli, monitor for occurrences of that stimulus, and preferentially attend to that stimulus. This process is often explained by instructions to count the flashes of the specific stimulus. The typical practice of referring to stimuli as flashes seems readily understood by children. However, parents report that children may not be able to count or may find counting stressful because of association with the demands of school. Further, children who are able may prefer to count out loud, which could generate EEG artifact. Yet, instructions other than counting the flashes are not as easily understood. Several variants have produced inadvertent, non-useful results. Participants instructed to think “yes” when a flash happened in the right place reported that they were thinking yes over and over again, but their EEG showed a lack of stimulus-related responses. Another participant responded to the stimulus, but the response was evident because the participant performed the physical movement used to indicate yes, a source of both fatigue and artifact. Another participant who was non-verbal made sounds in response to the stimulus. Several of these participants generated clear responses when asked to try counting instead. We have also tried the instruction to think “now” when a flash happens in the right place, this has the advantage of describing the connection between stimulus and mental response. Sometimes, thinking the name of the target item when the target stimulus occurs is sufficient, although this instruction may easily be misunderstood as thinking the name of the item repeatedly (without the vital connection to the time of the stimulus).

A key difficulty is the impossibility of demonstrating P300 BCI use. Most instructions for operating devices, even assistive technology, involve some task-specific behavioral modeling so the learner can mimic the actions required for use. But anything added to BCI use to indicate the thought process involved artificially inserts a physical response that is unnecessary and potentially problematic, both for a user with a disability and for EEG quality. To address this, we are creating instructional videos for each BCI study that include slow motion sections emphasizing the relationship between stimulus timing and mental response. Videos also enable the use of thought bubbles or other representations of thought to model mental responses to target stimuli e.g., (Branco et al., 2021).

Age and attention

Even children who try to follow instructions may struggle with doing so long enough to provide 10–20 min of calibration data. Our study found that children in the 8–10-year age range exhibited significant inattentiveness during calibration. Children could sometimes be redirected toward the calibration task by prompting. Also, breaking the calibration data into shorter segments was sometimes of benefit. However, inattentiveness and/or reported lack of interest were an ongoing barrier.

Immediate feedback from the system on whether they are doing something wrong and how to change it would be desirable (Taherian and Davies, 2018). An example of the effect on mental tasks was demonstrated (Schudlo and Chau, 2014) where eight out of 10 participants adjusted their mental strategies when receiving feedback. However, prior to BCI calibration, relatively little information is available to inform specific feedback.

Processing speed

Individual differences in cognitive processing speed can affect BCI accessibility. Children with CP are at significant risk for slowed processing speed, even with normal range IQs (Kaufman et al., 2014). Processing speed can affect both the time to register a stimulus and the time to plan the next target after the BCI registers a selection. The duration of BCI stimuli can be adjusted to accommodate slower visual processing speed. However, appropriate planning time is an often overlooked and potentially more complex challenge. P300 BCIs usually operate in a synchronous mode in which a specific number of stimuli are presented, a decision is made, and stimuli for the next selection start after a fixed duration pause. Two approaches might accommodate an individual’s slower processing speed. The time between selections can be manually adjusted. Alternatively, automatic algorithms might identify whether an EEG response was generated to one of the stimuli. Our cognitive testing BCI used statistical analysis of the stimulus responses to identify when one stimulus produced a significantly larger EEG response (Alcaide-Aguirre et al., 2017; Aref, 2018). This enabled the user to spend as much time as needed to consider the illustrations before picking the one they wanted to select and attending to the associated stimulus.

Calibration time

An advantage of the P300 BCI design for children is that it can be calibrated within a single session as compared to the multiple sessions generally required for motor imagery BCIs [e.g., (Cincotti et al., 2008)]. However, calibration time may still exceed a child’s attention span, especially if the stimuli are not inherently interesting. Traditionally, P300 BCIs use a fixed duration of calibration data. Our various studies used 9, 13, or 19 min of calibration data (Alcaide-Aguirre et al., 2017; Huggins et al., 2019, 2020). While calibration data of this duration is not necessarily essential, calibrations performed on small amounts of data may report success, but not correctly interpret new data. Methods to create BCIs that work without individualized calibration or that perform more rapid calibration using transfer learning from past participants are not yet readily available [e.g., (Lu et al., 2009; Xu et al., 2015; Sahay and Brinton, 2021)]. Methods are needed to automatically remove data with artifact or low participant attention. In addition, methods are needed to rapidly validate, preferably during collection of the calibration data, whether a calibration will generalize to new data.

Electrode location

An additional consideration for calibration is electrode location. Most P300 BCI studies use similar electrode locations (Thompson et al., 2009; Wolpaw et al., 2018) based on experiments with typically developing participants and people with ALS. For these groups, customizing electrode locations appears to actually reduce performance (Colwell et al., 2014). However, for people with congenital disabilities, custom electrode locations can be useful and perhaps vital for successful calibration (Tou et al., in revision). This is not surprising considering that neuroanatomy imaging of children with CP found abnormal results in 80–90% (Korzeniewski et al., 2008). Thus, when working with children with congenital neurodevelopmental conditions, custom electrode locations should be considered if calibration with standard locations fails. Further, ongoing efforts to reduce the number of electrodes used by BCIs should consider the possible necessity of atypical electrodes locations.

Electroencephalogram headgear challenges

EEG headgear designed for people without impairments may not fit the heads of people with multiple congenital impairments. Prevalence of head asymmetry among people with the most severe impairments from CP are reported as over 40% (Kawakami et al., 2013) and microcephaly at 30–60% (Venkateswaran and Shevell, 2008; Minciu, 2012). We have repeatedly experienced issues with poor fitting gel and dry EEG headgear. Thus, there is a need for either custom fitted headgear or headgear that accommodates asymmetries or atypical head shapes.

Additionally, the time required for EEG electrode setup and establishing good recording quality can be tedious. Providing caregiver-suggested/provided entertainment can help. In addition, the necessary intrusion into a child’s personal space and the strange sensations of gel electrodes or the weight of a dry electrode headset may be poorly tolerated. Comfortable EEG headgear that can be rapidly set up and quickly establish good recording quality is essential. Further, it may be necessary to specifically acclimate children so that they will tolerate the headgear.

Electroencephalogram signals may also be vulnerable to movement artifact. Children, of course, move; and children with CP may have more frequent and less controlled movements, leading to greater issues with movement artifact in EEG. Further, movements may bring the EEG headgear into contact with the back of a chair or a wheelchair headrest, which can create EEG artifact, dislodge the headgear, or be painful (Daly et al., 2013).

Discussion

For any child, familiarity and a paced and supportive introduction of the EEG headgear and the tasks involved in BCI use may be vital for eventual success. However, for children with impairments in speech and volitional movement, including those with CP, factors related to agency, neuroanatomy, and lived experience may differ in important ways. Building on work-to-date, we present a concept map (Figure 2) of issues and strategies to consider when designing BCIs for children with multiple impairments.

FIGURE 2

Figure 2. Concept map, design aspects, and possible strategies to consider in brain-computer interfaces (BCI) design for children with disabilities.

Consideration should first be given to overall accessibility, not only for wheelchair access, but also for compatibility of EEG headgear with seating systems and any known neuroanatomy anomalies. Slowed visual processing speed or a history of cognitive visual impairments should be considered. Children with CP are at significant risk for epilepsy and a history of photosensitive epilepsy is usually an exclusion factor for BCI use, though we have not seen reports of visual BCI stimuli actually causing seizures. Next, the cognitive and experimental aspects of the BCI design should be considered. Successful participation may depend upon implicit and explicit assumptions about what the child knows and can understand, and their previous experience with alternative access methods such as switch or eye-gaze technology. Engagement will likely be affected by comfort and familiarity with the nature and complexity of the stimulus presentation. If participation requires following directions, how will that fundamental capability be assessed, or will it be developed during training? The child’s endurance and sustained attention will affect the time available for setup, training, and assessment. In addition to situational anxiety, travel time can affect attention and fatigue. What can be done to maximize the child’s comfort and motivation? These considerations will inform strategic planning of where (home, clinic, or lab) to conduct the assessment and over how many sessions. More sessions allow introduction of new concepts at a slower pace but also increase travel burden if not conducted in the home. The child’s engagement and participation may depend upon the extent to which the study requires conscious compliance with instructions rather than initial passive participation, which can ease the child into BCI use. Thus, accessibility, cognition, and participation considerations establish the basis on which successful BCI calibration and successful adoption of BCI as an access method will be built.

Data availability statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving human participants were reviewed and approved by University of Michigan Institutional Review Board IRBMED and the Cerebral Palsy Alliance Human Research Ethics Committee. Written informed consent to participate in this study was provided by the participant or the participants’ legal guardian/next of kin. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author contributions

JH and PK contributed to the analysis of data. JH and PK with their staff, performed most of the data collection for the studies, with some participation from SW. JH drafted most of this manuscript with many paragraphs contributed in their entirety by SW and PK. All authors collaborated on the design of the studies.

Funding

This study was supported by the internal funding from University of Michigan Health Sidney Licht fund. Research reported in this publication was supported by the Mildred E. Swanson Foundation, Cerebral Palsy Alliance Research Foundation (project grant PG3516), National Institute On Deafness And Other Communication Disorders of the National Institutes of Health under Award Numbers: R41DC015142 and R42DC015142, the National Institute on Disability, Independent Living, and Rehabilitation Research of the Administration for Community Living under Award Number: 90IFDV0002, and the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number: UL1TR000433.

Acknowledgments

We thank the children and young adults and their caregivers who participated in our studies as well as all our participants who gave up their time and provided us with valuable feedback.

Conflict of interest

Authors JH and SW hold a patent on Brain-Computer Interface for Facilitating Direct Standardized Cognitive Testing and The Identification of State Changes. This patent is licensed by the company Neurable. Authors JH and SW have no direct financial stake in Neurable.

The remaining author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Author disclaimer

The content is solely the responsibility of the authors and does not necessarily represent the official views of any of the funding agencies.

References

Acpr Group. (2013). Report of the Australian cerebral palsy register, birth years 1993-2006, February 2013. East Maitland, NSW: Cerebral Palsy Alliance Research Institute.

Alcaide-Aguirre, R. E., Warschausky, S. A., Brown, D., Aref, A., and Huggins, J. E. (2017). Asynchronous brain-computer interface for cognitive assessment in people with cerebral palsy. J. Neural Eng. 14:066001. doi: 10.1088/1741-2552/aa7fc4

American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association, 194.

Aref, A. W. (2018). Improving brain-computer interface performace by using dynamic methods based on analysis of cognitive State. Ann Arbor: University of Michigan.

Branco, M. P., Pels, E. G. M., Nijboer, F., Ramsey, N. F., and Vansteensel, M. J. (2021). Brain-Computer Interfaces for communication: Preferences of individuals with locked-in syndrome, caregives and researchers. Disabil. Rehabil. Assist. Technol. 2, 1–11. doi: 10.1080/17483107.2021.1958932

Cincotti, F., Mattia, D., Aloise, F., Bufalari, S., Schalk, G., Oriolo, G., et al. (2008). Non-invasive brain-computer interface system: Towards its application as assistive technology. Special Issue Robot. Neurosci. 75, 796–803. doi: 10.1016/j.brainresbull.2008.01.007

Colwell, K. A., Ryan, D. B., Throckmorton, C. S., Throckmorton, C. S., and Collins, L. M. (2014). Channel selection methods for the P300 Speller. J. Neurosci. Methods 232, 6–15. doi: 10.1016/j.jneumeth.2014.04.009

Daly, I., Billinger, M., Laparra-Hernández, J., Aloise, F., Aloise, F., and García, M. L. (2013). On the control of brain-computer interfaces by users with cerebral palsy. Clin. Neurophysiol. 124, 1787–1797. doi: 10.1016/j.clinph.2013.02.118

Dunn, L. M., and Dunn, D. M. (2007). Peabody picture vocabulary test–, 4th Edn. San Antonio, TX: Pearson Assessment. doi: 10.1037/t15144-000

Eliasson, A. C., Krumlinde-Sundholm, L., Rösblad, B., Beckung, E., Arner, M., and Ohrvall, A. M. (2006). The manual ability classification system (MACS) for children with cerebral palsy: Scale development and evidence of validity and reliability. Dev. Med. Child Neurol. 48, 549–554. doi: 10.1017/S0012162206001162

Farwell, L. A., and Donchin, E. (1988). Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 70, 510–523. doi: 10.1016/0013-4694(88)90149-6

Hemmingsson, H., Lidström, H., and Nygård, L. (2009). Use of assistive technology devices in mainstream schools: Students’ perspective. Am. J. Occup. Ther. 63, 463–472. doi: 10.5014/ajot.63.4.463

Hidecker, M. J., Paneth, N., Rosenbaum, P. L., Kent, R. D., Lillie, J., Eulenberg, J. B., et al. (2011). Developing and validating the communication function classification system for individuals with cerebral palsy. Dev. Med. Child Neurol. 53, 704–710. doi: 10.1111/j.1469-8749.2011.03996.x

Huggins, J. E., Alcaide-Aguirre, R. E., Aref, A. W., Brown, D., and Warschausky, S. A. (2015). “Brain-computer interface administration of the peabody picture vocabulary test-IV,” in Prcoceedings of the 7th international IEEE EMBS conference on neural engineering, Montpellier, 29–32.

Huggins, J. E., Garcia-Verdugo, M. A., Cross, R., and Hill, K. (2019). “Brain-computer interface operation of a commercial augmentative and alternative communication device,” in Poster presented at Neuroscience, Chicago, IL.

Huggins, J. E., Garcia, M., Tou, S. L. J., Karlsson, P., and Warschausky, S. (2020). “Comparison of brain-computer interface and eye-gaze interface technology for access to an untimed vocabulary test by people with cerebral palsy,” in Proceedings of the annual meeting of the australasian academy of cerebral palsy and developmental medicine, Perth, WA.

Kaufman, J. N., Donders, J., and Warschausky, S. (2014). A comparison of visual inspection time measures in children with cerebral palsy. Rehab. Psychol. 59, 147–154. doi: 10.1037/a0036019

Kaufmann, T., Schulz, S. M., Köblitz, A., Renner, G., Wessig, C., and Kübler, A. (2013). Face stimuli effectively prevent brain-computer interface inefficiency in patients with neurodegenerative disease. Clin. Neurophysiol. 124, 893–900. doi: 10.1016/j.clinph.2012.11.006

Kawakami, M., Liu, M., Otsuka, T., Wada, A., Uchikawa, K., Aoki, A., et al. (2013). Asymmetric skull deformity in children with cerebral palsy: Fequency and correlation with postural abnormalities and deformities. J. Rehabil. Med. 45, 149–153. doi: 10.2340/16501977-1081

Korzeniewski, S. J., Birbeck, G., DeLano, M. C., Potchen, M. J., and Paneth, N. A. (2008). systematic review of neuroimaging for cerebral palsy. J. Child Neurol. 23, 216–227. doi: 10.1177/0883073807307983

Liu, Y., Zhou, Z., and Hu, D. (2010). “comparison of stimulus types in visual P300 speller of brain-computer interfaces,” in Proceedings of the 9th IEEE International Conference on Cognitive Informatics (ICCI’10), doi: 10.1109/COGINF.2010.5599730 (Beijing: IEEE).

Lu, S., Guan, C., and Zhang, H. (2009). Unsupervised brain computer interface based on intersubject information and online adaptation. IEEE Trans. Neural Syst. Rehabil. Eng. 17, 135–145. doi: 10.1109/TNSRE.2009.2015197

Martens, S. M. M., Hill, N. J., Farquhar, J., and Schölkopf, B. (2009). Overlap and refractory effects in a brain-computer interface speller based on the visual p300 event-related potential. J. Neural. Eng. 6:026003. doi: 10.1088/1741-2560/6/2/026003

Minciu, I. (2012). Clinical correlations in cerebral palsy. Maedica 7, 319–324.

Murchland, S., and Parkyn, H. (2010). Using assistive technology for schoolwork: The experience of children with physical disabilities. Disabil. Rehabil. Assist. Technol. 5, 438–447. doi: 10.3109/17483107.2010.481773

Novak, I., Hines, M., Goldsmith, S., and Barclay, R. (2012). Clinical prognostic messages from a systematic review on cerebral palsy. Pediatrics 130, e1285–e1312. doi: 10.1542/peds.2012-0924

Odding, E., Roebroeck, M. E., and Stam, H. J. (2006). The epidemiology of cerebral palsy: Incidence, impairments and risk factors. Disabil. Rehabil. 28, 183–191. doi: 10.1080/09638280500158422

Orlandi, S., House, S. C., Karlsson, P., Saab, R., and Chau, T. (2021). Brain-computer interfaces for children with complex communication needs and limited mobility: A systematic review. Front. Hum. Neurosci. 15:643294. doi: 10.3389/fnhum.2021.643294

Palisano, R., Rosenbaum, P., Walter, S., Walter, S., Wood, E., and Galuppi, B. (1997). Development and reliability of a system to classify gross motor function in children with cerebral palsy. Dev. Med. Child Neurol. 39, 214–223. doi: 10.1111/j.1469-8749.1997.tb07414.x

Parkes, J., Hill, N., Platt, M. J., and Donnelly, C. (2010). Oromotor dysfunction and communication impairments in children with cerebral palsy: A register study. Dev. Med. Child Neurol. 52, 1113–1119. doi: 10.1111/j.1469-8749.2010.03765.x

Sahay, R., and Brinton, C. G. (2021). Robust subject-independent P300 waveform classification via signal pre-processing and deep learning. IEEE Access. 9, 87579–87591. doi: 10.1109/ACCESS.2021.3089998

Schudlo, L. C., and Chau, T. (2014). Dynamic topographical pattern classification of multichannel prefrontal NIRS signals: II. Online differentiation of mental arithmetic and rest. J. Neural. Eng. 11:016003. doi: 10.1088/1741-2560/11/1/016003

Sellers, E. W., Vaughan, T. M., and Wolpaw, J. R. (2010). A brain-computer interface for long-term independent home use. Amyotroph. Lateral Scler. 11, 449–455. doi: 10.3109/17482961003777470

Sevcik, R. A. (2006). Comprehension: An overlooked component in augmented language development. Disabil. Rehabil. 28, 159–167. doi: 10.1080/09638280500077804

Taherian, S., and Davies, T. (2018). Caregiver and special education staff perspectives of a commercial brain-computer interface as access technology: A qualitative study. Brain Comput. Interfaces 5, 73–87. doi: 10.1080/2326263X.2018.1505191

Thompson, D. E., Baker, J. J., Sarnacki, W. A., and Huggins, J. E. (2009). “Plug-and-play brain-computer interface keyboard performance. 2009,” in Proceedings of the 4th International Ieee/embs Conference on Neural Engineering, doi: 10.1109/NER.2009.5109325 (Antalya: IEEE), 426–428.

Tou, S. L. J., Warschausky, S. A., Karlsson, P., et al. (in revision). Individualized electrode subset improves the calibration accuracy of an EEG P300-based brain-computer interface for people with severe cerebral palsy JNE.

Van Tubbergen, M., Warschausky, S., Birnholz, J., and Baker, S. (2008). Choice beyond preference: Conceptualization and assessment of choice-making skills in children with significant impairments. Rehabil. Psychol. 53, 93–100. doi: 10.1037/0090-5550.53.1.93

Venkateswaran, S., and Shevell, M. I. (2008). Comorbidities and clinical determinants of outcome in children with spastic quadriplegic cerebral palsy. Dev. Med. Child Neurol. 50, 216–222. doi: 10.1111/j.1469-8749.2008.02033.x

Warschausky, S. A., Huggins, J. E., Alcaide-Aguirre, R. E., and Aref, A. W. (2022). Preliminary psychometric properties of a standard vocabulary test administered using a noninvasive brain-computer interface. Front. Hum. Neurosci. 16:930433. doi: 10.3389/fnhum.2022.930433

Wolpaw, J. R., Bedlack, R. S., Reda, D. J., Ringer, R. J., Banks, P. G., Vaughan, T. M., et al. (2018). Independent home use of a brain-computer interface by people with amyotrophic lateral sclerosis. Neurology 91, e258–e267. doi: 10.1212/WNL.0000000000005812

Xu, M., Liu, J., Chen, L., Qi, H., He, F., Zhou, P., et al. (2015). “Inter-subject information contributes to the ERP classification in the P300 speller,” in Proceedings of the 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER), doi: 10.1109/NER.2015.7146596 (Montpellier: IEEE).