Lstm Based Brain-Machine Interface Tool For Text Generation Through Eyes Blinking Detection
2021 IEEE 18TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC)(2021)
摘要
This paper presents the development of a tool that allows people to communicate, by using only their voluntary eyes blinks. This tool provides a communication link mainly for people with motor disabilities, who cannot communicate through voice. The electroencephalographic (EEG) signal provided by the Mindwave Mobile 2 headset is the source of information to detect the voluntary blinks. In order to perform the digital processing of the EEG signal, a Long-Short Term Memory (LSTM) neural network was implemented, for the classification of the EEG signal in one of 5 possible classes: No blink, One blink, Two blinks, Three blinks and Other. The results of the trained model achieved an average accuracy of 92%. The neural network was embedded in a native Android mobile application, that shows a virtual keyboard consisting of the 27 letters of the Spanish alphabet, plus three characters, that are the commands "delete", "space", and "enter". Each character can be selected by the user only through a determined number of voluntary blinks executed at certain times. When the user types a word and selects the "enter" command, the word is converted to audio using a text-to-speech engine. Finally, to verify the performance of the application, an experiment with eight people was executed, and as result the system achieved an average spelling precision of 91,26%.
更多查看译文
关键词
Long Short Term Memory, Electroencephalography, Brain-Computer Interfaces, Recurrent Neural Networks, Biomedical Signal Processing
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要