電腦科學與資訊工程

Nowadays, all blind people are able to read any type of text thanks to The Braille system, which is a system of reading by touch. The Braille system provides a good and important help to blind people but it’s not enough. They try to integrate into society, try to read and write the same as those blessed with sight. However, only 18% of people can actually write in Braille and doing so takes a lot of effort. While Braille techniques have existed for many years now, there isn’t one that takes advantage of the comfort and easiness of modern technology. To be fair and give more chances to the blind people, and with all the available technologies nowadays, we must find solutions and innovative ideas to fulfill this objective. And this is how our project was born. To be honest, it’s not just a project, for us it’s a dream. Our focus in this project is creating an automatic machine based on transforming our language to their language and transforming this new invention to assist the blind in writing whole texts through speaking. It will be easier than the traditional way. This part of the project will help us print Braille on paper automatically in the cheapest, fastest and easiest way, unlike the traditional method that not only takes a lot of time but also needs a professional. Our printer will only cost approximately 250$ compared to regular printers that cost 6500$! the principles of the code of the speech recognition are voice pickup in all languages as first step, second speech recognition, then speech translation, after that speech analysis and finally translation into Braille and printing it. As for the future, we will work on face, object and image recognition as a scanner to make the visually impaired people read the name of the object and recognize people’s faces like anyone else.

第五代行動通訊（5th generation mobile networks）是現今科技發展的趨勢，新技術的出現也衍生出很多新的問題，在基地台點對點傳輸時，需要精確角度的天線才足以準確地接收高頻波短的毫米波，雖然現今已經有精密儀器能測量精確的方位角，但價格較高且使用方法複雜，面對數量龐大的5G基地台時，維修成本過高。本研究利用手機拍照得到天線與目標物相對角度，結合預先得知目標物的方位角，再經過數學運算即可得到精確的天線指向。本研究希望以隨手可得的手機，配合簡單的方法，可得到精確的天線指向，解決第五代行動通訊可能面臨的問題。

In Singapore’s evolving cyber landscape, 96% of organisations have suffered at least one cyber attack and 95% of organisations have been reporting more sophisticated attacks in the frame of one year according to a 2019 report[1] by Carbon Black. As such, more tools must be utilised to counter increasingly refined attacks performed by malicious actors. Honeypots are effective tools for studying and mitigating these attacks. They work as decoy systems, typically deployed alongside real systems to capture and log the activities of the attacker. These systems are useful as they can actively detect potential attacks, help cybersecurity specialists study an attacker’s tactics and even misdirect attackers from their intended targets. Honeypots can be classified into two main categories: 1. Low-interaction honeypots merely emulate network services and internet protocols, allowing for limited interaction with the attacker. 2. High-interaction honeypots emulate operating systems, allowing for much more interaction with the attacker. Although honeypots are powerful tools, its value diminishes when its true identity is uncovered by attackers. This is especially so with attackers becoming more skilled through system fingerprinting or analysing network traffic from targets and hence, hindering honeypots from capturing more experienced attackers. While substantial research has been done to defend against system fingerprinting scans (see 1.1 Related Work), not much has been done to defend against network traffic analysis. As pointed out by Symantec[2][3], when attackers attempt to sniff network traffic of the system in question, the lack of network traffic raises a red flag, increasing the likelihood of the honeypot’s true identity being discovered. In addition, the main concern with regards to honeypot deployment being their ability to attract and engage attackers for a substantial period of time, an increased ability to interest malicious actors is invaluable. Producing human-like network activity on a honeypot would appeal to more malicious actors. Hence, this research aims to build an intelligent web-surfer which can learn and thus simulate human web-surfing behaviour, creating evidence of human network activities to disguise the identity of honeypots as production systems and luring in more attackers interested in packet sniffing for malicious purposes.

Recent studies showed that the probability of Taiwanese females developing breast cancer has risen dramatically over the past 30 years. We are now facing younger and more breast cancer patients in Taiwan. What makes the matter even more severe, is the fact that patients that take cancer treating medicine will suffer from its serious side effects, some may even lose the ability to reproduce. We hope to develop a new system that can help doctors and researchers develop new medicine for treating breast cancer, the way medicine cures cancer tumors are by attaching onto the infected cells’ receptors. After collecting MACCS data (converted from SMILES), the dataset will be used for training the machine learning program. Due to the problem of insufficient training data, we used an ensemble method to generate our machine learning model. Among the three basic ensemble techniques, Max Voting, Averaging, and Weighted Averaging. we selected the max voting technique to perform the prediction for this research. We created two separate datasets, positive and negative, the two datasets will later be used as training data for the program. We weren’t sure of the ratio of positive and negative in the training data, therefore we compare 40 different ratios and evaluate the results. By comparing the accuracy of the models, we found out that when the ratio between positive data and negative data is 1:3000, the machine learning program will have the highest precision. After we created the final model through voting among the 1000 models generated, we evaluate the precision of the model through the following methods, AUC, precision, recall. The ultimate goal of this research is to assist doctors and researchers shorten the process of developing and testing new medicines.

手語為聾啞人士日常溝通的工具，但對一般人來說這是一種難以理解的溝通方式。本實驗使用深度學習的 Yolov3 與 Yolov4 模型訓練37個國語注音符號手勢，然後再驗證模型對圖片、影片、即時(Real time)攝影辨識的正確率。 實驗結果顯示：Yolo v3 圖片辨識度效果還不錯，但影片辨識度很差，而Yolo v4 不管在靜態的圖片或動態影片都有不錯的辨識率，另外在即時的影像辨識也有不錯的效果。 雖然有部分符號的辨識度很低，但這可能是訓練時照片拍攝的問題，如果可以改進拍攝的數量和技巧，相信可以大幅提升判讀的準確率。

Two years ago, I attended a robot contest, in which one of the missions required the robot to follow the pedestrian to complete the task. At that time, I used their demo program to complete the task. Not long after, I found two main issues: 1. The program follows the closest point read by the depth camera, which if I walk close to a wall next to, the robot may likely ‘follow’ the wall. 2. Not to mention if another pedestrian crosses between the robot and the target. Regarding these two issues, I decided to improve it. We’ve designed a procedure of using YOLO Object Detection and Person re-identification to re-identify the target for continuous following.

Two years ago, I attended a robot contest, in which one of the missions required the robot to follow the pedestrian to complete the task. At that time, I used their demo program to complete the task. Not long after, I found two main issues: 1. The program follows the closest point read by the depth camera, which if I walk close to a wall next to, the robot may likely ‘follow’ the wall. 2. Not to mention if another pedestrian crosses between the robot and the target. Regarding these two issues, I decided to improve it. We’ve designed a procedure of using YOLO Object Detection and Person re-identification to re-identify the target for continuous following.

We study the creation of physical adversarial examples, which are robust to real-world transformations, using a limited number of queries to the target black-box neural networks. We observe that robust models tend to be especially susceptible to foreground manipulations, which motivates our novel Foreground attack. We demonstrate that gradient priors are a useful signal for black-box attacks and therefore introduce an improved version of the popular SimBA. We also propose an algorithm for transferable attacks that selects the most similar surrogates to the target model. Our black-box attacks outperform state-of-the-art approaches they are based on and support our belief that the concept of model similarity could be leveraged to build strong attacks in a limited-information setting.

2019年新型冠狀病毒的大流行，佩戴口罩已成為全球防止飛沫傳播病毒成本最低且有效的方法，目前雖已有團隊針對口罩有無正確配戴提出解決方案，但根據收集的資料，目前針對口罩有無正確配戴解決方案通常是使用類神經網路YOLO進行實作，YOLO使用於口罩辨識雖可達到有一定的效果，但對口鼻密合度不佳的細微狀態常有一些誤判的現象，就算民眾有配戴口罩，但若未與臉部、口鼻密合，仍有50％的空氣洩漏機會，無法有效阻隔飛沫傳染，形成防疫破口。 而本研究在這樣的基礎架構下再整合目前最強大的姿勢辨識之一的OpenPose，針對口罩與口鼻密合度不佳的細微狀態進行更深一步地探討，以期達到更好的偵測判斷效果。本研究針對的改善的方向為當神經網路YOLO判定為有配戴正確的資料時，再利用OpenPose以及本研究開發出的鼻心物件演算法，就鼻部密合度做細部偵測，進行誤判修正，最後證實出本算法能篩出56.25%被神經網路YOLO誤判為有戴好口罩的資料，可顯著提升口罩配戴辨識精準度，減少形成防疫破口的機會。

We study the creation of physical adversarial examples, which are robust to real-world transformations, using a limited number of queries to the target black-box neural networks. We observe that robust models tend to be especially susceptible to foreground manipulations, which motivates our novel Foreground attack. We demonstrate that gradient priors are a useful signal for black-box attacks and therefore introduce an improved version of the popular SimBA. We also propose an algorithm for transferable attacks that selects the most similar surrogates to the target model. Our black-box attacks outperform state-of-the-art approaches they are based on and support our belief that the concept of model similarity could be leveraged to build strong attacks in a limited-information setting.