臺灣國際科展

Computer Vision for Alternative Input Systems

科展類別
臺灣國際科展作品
屆次
2012年
科別
電腦科學
得獎情形
一等獎
學校名稱
Upper Saint Clair
作者
Matthew Thomas Vernacchia
關鍵字
Computer Vision for Alternative Input Systems,image processing algorithm

摘要或動機

In the fast-paced environment of a hospital intensive care unit (ICU), good doctor-patient communication is essential. However, medical conditions and devices often inhibit a patient’s ability to speak, write or type. Current assistive communication devices are either prohibitively expensive or cumbersome and time-consuming, creating a gap in communication during a patient’s first days in the ICU. This project applies computer vision to develop a low-cost software solution that bridges this gap by enabling patients to generate words with eye movements. In the system, a webcam acquires an image of the patient, and an image processing algorithm classifies patient’s gaze as pointing in one of eight directions. Each direction corresponds to an option on a graphical menu presented to the patient on the computer’s display. The patient can use the menu to select a preformed phrase from a list of common phrases. Patients desiring to express more complex ideas can type custom words using the menu as an ambiguous keyboard (similar to a phone keypad). In either case, the patient-generated text will be displayed on screen and read aloud through the computer’s audio system. The only hardware requirements are an existing computer and a $6 webcam. The program can process and respond to an image in 148ms. A new user can be trained in approximately 10 minutes, and after training can type a simple phrase such as “hello world” in 40 seconds. While further testing and improvement is required before the system will be ready for implementation, the project shows promise as a low-cost solution to ICU communication.


「為配合國家發展委員會「推動ODF-CNS15251為政府為文件標準格式實施計畫」,以及 提供使用者有文書軟體選擇的權利,本館檔案下載部分文件將公布ODF開放文件格式, 免費開源軟體可至LibreOffice 下載安裝使用,或依貴慣用的軟體開啟文件。」

檔案名稱 檔案大小 格式
Computer Vision for Alternative Input Systems 309 KB Adobe Reader(Pdf)檔案