Understanding How to Design Complex Brain-Controlled Applications

Krzysztof Z. Gajos



Most of the effort in brain-computer interface (BCI) research so far has been directed at developing better sensors and better ways of extracting useful information from the brain signal, while little effort has been directed at systematically understanding the unique strengths and limitations of this input modality and their implications for interaction design. Past proof of concept brain-controlled applications either involved very simple interaction or they augmented existing complex applications with external widgets to enable limited control.

This relative lack of research directed at developing applications and interaction methods specifically for brain-computer interfaces is a concern for several reasons. First, some BCI technologies are mature enough to be used soon by large numbers of paralyzed users. Lack of compelling brain-controlled applications or the tools and techniques for building such applications will significantly limit the impact of these technologies. Second, recent work on ability-based user interfaces has demonstrated that large gains in efficiency of interaction and user satisfaction can be achieved if user interfaces are designed with a user's specific abilities and devices in mind. The results of our studies showed that adapting user interfaces to the unique abilities of people with a range of motor impairments helped close the performance gap between those users and able-bodied people by over 60%. For BCI users, who need up to several tens of seconds to perform a single UI operation, efficiency of interaction will have an even larger impact and will likely determine whether an application is usable in practice. Lastly, a lot of the current research effort in BCI is directed at improving various aspects of the sensing and signal extraction technology. Good understanding of the user interaction requirements of brain-controlled applications will help inform and direct those efforts to maximize their impact on the user experience.

Motivated by these observations, we are starting a project to explore the properties and limitations of one particularly promising BCI paradigm as an input modality and to develop methods and tools for designing user interfaces for complex brain-controlled applications.

Available Versions

Citation Information

Krzysztof Z. Gajos. Understanding how to design complex brain-controlled applications. In Proceedings of the Workshop on Brain, Body and Bytes: Psychophysiological User Interaction at CHI'10, 2010.