全國中小學科展

電腦科學與資訊工程

運用影像辨識及機器學習改良網路打字系統與密碼

本研究延續先前自己所做的研究進行延伸。首先研究者嘗試利用Python、MediaPipe、OpenCV進行手部辨識,判斷使用者是否用正確的手指按壓鍵盤,逐次開發打字系統提升精進指法的練習平台;在過程中研究者觀察到多數人打字習慣都不一樣,所以嘗試將打字習慣運用機器學習形成密碼,讓其他人就算知道密碼也無法輕易解密,因為他們並沒有使用者的打字習慣。並提出三項研究目的,分別為增加機器學習模型Random Forest並觀察準確率,提出最短密碼之研究方法及忘記密碼系統之研究方法,並提出關於電腦前後端問題的解決方法。目前研究已能夠判斷使用者是否用正確的手指按壓按鍵。未來預計解決打字到拍攝的時間差回推影像等問題,並將蒐集更多數據觀察觀察模型結果,找尋一種最佳的密碼模型。未來也會將此打字系統架設到網站上,並且蒐集使用者的人機體驗感想回饋,進而更為精進完善本系統。

利用增強學習之Q-Learning,解決數字華容道的比較性發展研究

因為我們一開始對電腦程式語言有濃厚的興趣,所以去學習了python程式語言,後來發現到世界三大益智的華容道遊戲,似乎可以加以運用,又從文獻中發現了人工智慧之重要性和增強學習的各類法則。剛好於國中時期寫出了讓電腦產生並解決3*3數字華容道之程式。但發現4*4的遊戲竟有20兆種組合,該無法用3*3之程式思維。後來用了增強學習的Q-Learning技術,不僅完成任務,而且還可以發展出人與電腦的比賽,造成轟動、受到小朋友的喜愛~最後我們還希望自己能設計出不同的華容道加以測試,並研究深度增強學習(DRL)的原理與應用,來解決更高階的遊戲,達到增進人工智慧學習的發展。

HandExo

Stroke is a very common disease, almost a national disease. In terms of stroke frequency, 匈牙利 ranks second in the world. Every year, 40-50 thousand people become paralyzed or permanently injured as a result of cerebrovascular disorders. This number is three to four times higher than in developed countries. Almost every Hungarian family is affected! Of course, saving the life of someone who has a stroke is the most important thing, but rehabilitation is also very important, since only with the help of a physiotherapist will the patient be able to live a full life.

以最佳化演算法進行鐵路時刻表排點

鐵路時刻表排點直到目前為止仍十分仰賴人工作業,且排班優劣對於乘客服務品質有顯著的影響。本研究採用啟發式最佳化演算法以及模擬器進行旅客列車鐵路時刻表排點,希望能夠找出一份針對旅客需求,能夠提升旅客運輸成功率且降低旅途時間的時刻表。我們提出一種班表編碼機制,可依此機制產生班表草稿。我們研發的模擬器可將班表草稿轉換為合法無衝突之班表。最後,透過登山演算法來搜尋班表草稿,並以模擬器評估班表優劣,我們實現了一個自動化排班系統。實驗結果指出我們的模擬器能夠有效率地產生無衝突之班表,且所提出之演算法操作有助於提升運輸成功率和降低旅途時間。

Wibrazz

"Blindness keeps you from things, deafness keeps you from people" (Helen Keller) Wibrazz is a communication tool that can be placed inside sportswear. Two versions have been developed. The simpler one allows hearing-impaired footballers to compete in the league with other athletes. The referee is given an additional device to give a signal when he blows his whistle. The hearing-impaired footballer then senses the signal from the device he is wearing and knows that he must pay attention to the referee. The complex version speeds up communication between the coach and the players during training sessions. It allows the coach to send simple messages to his players using his smart device. The athlete senses the signal from the device and acts on what has been previously discussed (e.g. a long signal means, "Everyone come to me!") With over 70 million deaf people worldwide, and 2-4 out of 1000 people in the United States who are functionally deaf, this can affect an individual's mental and physical well-being, and it is therefore a pressing issue to provide these athletes with the means to develop their talents in a traditional team environment. In addition to the organisations within countries, the ICSD is present on the international stage. Their importance is demonstrated by the fact that the 2023 Deaf Football World Cup featured teams from countries such as the United States, Germany, England and Japan.

Project M.I.R.A.S

1.1 Short project summary My project involves the conceptualization and development of an innovative approach to modular self-assembling robotic systems. Through its ability to form any complex configuration, the system is highly adaptable to various scenarios and environments. Before delving deeper into the details of my project, I will provide an overview of my background and motivations. 1.2 Background Ever since I first watched the movie "Big Hero 6", I felt amazed by the applications of the so called “microbots”. From that point on, it made me always wonder what would be possible in the real world. When I did the research, I stumbled upon this field of modular robotics. Initially, I was unsure whether to embark on a project focused on electronics and robotics due to my background in programming. On the other side, this year gave me a chance to see the incredible performances of various projects at different science expos. Besides, I took part in the program of CANSAT LU and learned a lot during it, such as microchips, the control of miniature robotics, and the sensors of it. Finally, at school, I took the option Electronics where we dig into similar topics. With this accumulated knowledge and experience I felt confident enough to start this project.

AI-Based Customer Sentiments Dashboard

In this fast-paced digital economy, customers' judgment is based on their experience with a company’s products and services. Customer reviews become a vital source of information for companies because this information can be used to enhance their products, understand customer wants and needs, improve brand reputation, and provide a competitor’s advantage. A company can understand customer needs and wants by going through reviews. Customers are encouraged to leave not only their opinion but also their ideas for the development of the product or service. By understanding these reviews, a company can actively respond and engage with a reviewer or problem. Failure of companies who don't answer customer queries may negatively impact customer loyalty. Customers will feel neglected by these companies and will choose competing companies to handle their needs. Additionally, customers may speak negatively about a company that does not respond to reviews. The AI-based customer sentiment dashboard can help gain a company's competitive advantage by identifying weaknesses in themselves and others. Companies will be enabled to understand where they succeed and where improvement is needed compared to their competitors, leveraging businesses to address strengths and weaknesses before competitors do. Through AI-based customer sentiment dashboards, a company can analyze its competitor’s reviews and use that information as leverage to make improvements to its products and services. Customers are increasingly leaving reviews on popular apps like Google Play, Stamped.io, Yapto, and Judge.me, Loox, Qualaroo, and Yelp. The reviews are rich in customer sentiments offering valuable insights into user satisfaction and pointing out the areas for improvement that are crucial to every company no matter how big or small. Despite their value, manually processing these reviews is a challenging task due to the large volume of unstructured data. Manual processing is also vulnerable to bias and human error, leading to inaccurate information. Traditional methods such as surveys have been proven to be ineffective if the main focus is targeted feedback and have low responses compared to reviews. The advances in artificial intelligence like Natural Language Processing (NLP) help us interpret and analyze human language and generate outputs like predicting what type of sentiments are in reviews. This project proposes developing an AI-based sentiment analysis model to evaluate customer feedback on two widely used taxi applications. Natural Language Processing libraries, such as the Valence Aware Dictionary and Sentiment Reasoner (. The model aims to categorize customer reviews into positive, negative, and neutral sentiments.

ChordSeqAI: Generating Chord Sequences Using Deep Learning

This report presents a novel AI-driven tool for aiding musical composition through the generation of chord progressions. Data acquisition and analysis are discussed, uncovering intriguing patterns in chord progressions across diverse musical genres and periods. We developed a range of deep learning models, from basic recurrent networks to sophisticated Transformer architectures, including conditional and style-based Transformers for improved controllability. Human evaluation indicates that, within the context of our specific data processing methods, the chord sequences generated by the more advanced models are practically indistinguishable from real sequences. The models are then integrated into a userfriendly open-source web application, making advanced music composition tools accessible to a broader audience.

Artificial Intelligence Sensing Technology for Blinds Path Findings

Over 30 million souls live in a world of darkness, a number greater than the populations of both Norway and Sweden combined. Every individual deserves the chance to embark on a journey across our magnificent blue planet. Yet, regrettably, little has been done to assist them. With this project, we’re lighting the way for the blind to explore our beautiful world independently, breaking free from dependence and embracing boundless horizons. In order to put our theory of the project into practice & explore the use of artificial intelligence & computer science, we started by collecting the required materials for our project such as micro-controllers, sensors, a pair of glasses, a laptop, and a miniature camera. Then we moved onto creating the project itself in which the digital software programmed onto the hardware plays the key-role, as the sensors and the camera will record the details and information from the surroundings and send it to the laptop for further processing. The camera would be the backbone of our project, as it will stream real-time footage to the laptop which will be analyzed by an open-source object detection model ‘YOLOv8’ for identifying objects. After finishing the base model of our project, we tested it in-front of objects such as toy cars, bikes, people, etc, and the results of the object-detection would be shown on the laptop. To observe this data, we created a device which has different modules and integrations for different functions. For example, we will use our camera and then stream it onto a laptop so the reading and the data can be processed on the laptop by AI using YOLOv8. As mentioned in the start, many people do not possess the ability to see, to assist them we have thought of this device which uses all readings and its analytical skills to analyze data and help them navigate, travel or simply, live a better life.

SAFE_MEDICATION - A STUDY OF USING ARTIFICIAL INTELLIGENCE TO RECOGNISE MEDICATION ERRORS

Medication errors in patients are a global problem. They can negatively affect patients and be costly for hospitals and medical clinics. In 2021, a 28-year-old man with heart problems was admitted to a hospital in Porto Alegre. Due to a pharmacy error and insufficient monitoring in the administration, he received a dose 10 times higher than prescribed. This caused serious and probably irreversible damage to the patient. Reading the news and following the case in the media has encouraged research in scientific databases, searching for information and data on medication errors, as well as emerging technologies to reduce the occurrence of adverse medication events. Based on the findings of an English study that proved that errors occur at the drug prescription stage, the first stage of this research focused on drug dosage errors. The aim of this study is to develop an application based on artificial intelligence that can recognise these errors and help prevent them. The application uses a neural network to analyse prescriptions and warn of possible cases of incorrect dosage. The computer program was developed using a neural network and the drug dosage error recognition system using Python and Keras. The system was trained with 10 drugs and correct and incorrect dosage cases. A graphical interface was created to input and display new case data. Neural networks with different configurations were tested to obtain high accuracy with the training and validation data. A confusion matrix was used to assess the accuracy of the network for cases not used for training. The accuracy was approximately 96%, but problems were found in certain intervals. The errors are due to the need for more training, higher processing capacity and a cloud server. The results of the first stage of the research indicate the feasibility of using a neural network to recognise medication dosage errors and thus preventing the associated risks. Such a method could prevent cases like the one in Porto Alegre. Future studies could incorporate more types of drugs, allergies, drug interactions, pre-existing illnesses and other relevant factors into the system.