電腦科學與資訊工程

平常聽音樂時經常有種似曾相識的感覺。為了描述這種感覺，我們展開了複音音樂片段相似性度量的研究。因為曾經使用過最長公共子序列實作卻效果不如預期，我們將音樂片段正規化後，視為座標平面上的時間、音高點對的集合，使用點對應與二分圖匹配的方法，定義兩個複音音樂片段的相似度為最大權重匹配的平均邊權。我們計算了資料集(JKUPDD)中相同、相異的音樂片段的相似性，調整算法中的參數，找出最適合的參數組合，並且透過音符之間的權重，畫出自相似度矩陣，發現樂曲中的重複片段。

本研究的腦波辨識基於特徵提取，可應用於身分認證，具有不能被仿冒的優點。我們用低成本高便利性的腦波儀，自行撰寫程式讀取原始腦波，建立一致性的實驗程序。首先用腦波專心度的高低來控制智能車，再用腦波來測謊，有隱藏說謊行為時會觸發高電位腦波，在兩項前期研究後發現可用腦波特徵進行身分認證。三位受測者於不同日期提取10份腦波，每份腦波紀錄5120筆數據。接著我們反覆嘗試組合數十種統計函數進行特徵提取，找到兩項最佳特徵，達成將大量凌亂腦波資料降低維度又具有辨識力。我們腦波辨識分類方法使用近鄰演算法，測試程序用盲測交叉驗證法，辨識正確率百分百。最後我們用Arduino板來展示腦波辨識應用於腦波身分認證，資料庫中只要儲存每位受測者的腦波特徵值，就能在數秒內正確辨識說出受測者身分，顯示每個人腦波是不同的，而且能用特徵將其分辨出來。

The number of natural disasters has risen significantly in recent years, and with climate change there is no end in sight. Consequently, the demands on rescue forces around the world are increasing. For this reason, I asked myself what I can do to improve the work of rescue teams. Advances in artificial intelligence and drone technology enable new possibilities for problem solving. Based on the technological advances mentioned above, an autonomous Search and Rescue drone was developed as part of this project. The system assists rescue workers in searching for survivors of natural disasters or missing people. This paper also suggests a method for prioritizing survivors based on their vitality. The system was implemented using a commercial Parrot ANAFI drone and Python. The software was tested on a simulated drone. To simplify the development, the whole system was divided into the following subsystems: Navigation System, Search System and Mission Abort System. These subsystems were tested independently. The testing of solutions and new concepts were performed using smaller test programs on the simulated drone and finally on the physical drone. The Search and Rescue system was successfully developed. The person detection system can detect humans and distinguish them from the environment. Furthermore, based on the movements of a person, the system can distinguish whether the person is a rescuer or a victim. In addition, an area to be flown over can be defined. If something goes wrong during the mission, the mission can be aborted by the Mission Abort System. In the simulation, the predefined area can successfully be flown over. Unfortunately, controlling the physical drone does not work. It stops in the air after takeoff due to the firmware of the drone. It does not change the flight state of the drone, which results in all subsequent commands from the system being ignored. This paper shows that artificial intelligence and drone technologies can be combined to deliver better rescue services. The same system can be applied to other applications.

遠距醫療及自我健康檢測在最近幾年逐漸崛起，其講求利用大眾化的工具即可掌握醫療知識與自我健康監測，並透過大數據分析及人工智慧技術，協助醫師與病患進行更有效的治療，但目前中醫在這方面的研究不多，與影像辨識相關的也只有舌診。目前對於手掌的研究多半止步於身分辨識，因此手診還需中醫師切脈或檢查。 本研究作品旨在發展自動手診方法，提供民眾自我健康監測。利用兩種方式1.整張手的CNN圖像分類 2.用YOLO物件偵測進行掌中的特徵點抓取，使其能分辨肝掌、富貴手、蜘蛛痣、汗皰疹、無症狀，最後，並將模型與手機APP結合。

Triage is the process by which nurses manage hospital emergency departments by assigning patients varying degrees of urgency. While triage algorithms such as the Emergency Severity Index (ESI) have been standardized worldwide, many of them are highly inconsistent, which could endanger the lives of thousands of patients. One way to improve on nurses’ accuracy is to use machine learning models (ML), which can learn from past data to make predictions. We tested six ML models: random forest, XGBoost, logistic regression, support vector machines, k-nearest neighbors, and multilayer perceptron. These models were tasked with predicting whether a patient would be admitted to the intensive care unit (ICU), another unit in the hospital, or be discharged. After training on data from more than 30,000 patients and testing using 10-fold cross-validation, we found that all six models outperformed ESI. Of the six, the random forest model achieved the highest average accuracy in predicting both ICU admission (81% vs. 69% using ESI; p<0.001) and hospitalization (75% vs. 57%; p<0.001). These models were then added to an Android application, which would accept patient data, predict their triage, and then add them to a priority-ordered waiting list. This approach may offer significant advantages over conventional triage: mainly, it has a higher accuracy than nurses and returns predictions instantaneously. It could also stand-in for triage nurses entirely in disasters, where medical personnel must deal with a large influx of patients in a short amount of time.

近年來由於電腦視覺的蓬勃發展，物件辨識模型被廣泛運用在生活中，例如自動駕駛、醫療影像、農作物檢測等等。對於要在戶外運作的模型，由於檢測物體的背景會隨著時間、地點、季節、光照強弱等因素不斷改變，通常需要大量且多元的資料才能避免模型過擬和，然而取得多元的資料需要花費大量的人力與時間在收集以及為這些新資料標籤。 本研究利用影像風格轉換模型作為資料增強的方法，將於晴天拍攝的街景圖轉成夜晚及雨天，使原本只有晴天的資料集有更多元的資料。結果證實使用風格轉換模型生成的影像訓練的物件辨識模型的準確率在某些情況下有顯著的提升。此方法的優點在於能夠快速產生多樣風格的資料，由於是對影像的風格做轉換，影像的內容沒有改變，因此能夠沿用原有的標籤，同時節省了蒐集及為新影像標籤的人力及時間。

The number of natural disasters has risen significantly in recent years, and with climate change there is no end in sight. Consequently, the demands on rescue forces around the world are increasing. For this reason, I asked myself what I can do to improve the work of rescue teams. Advances in artificial intelligence and drone technology enable new possibilities for problem solving. Based on the technological advances mentioned above, an autonomous Search and Rescue drone was developed as part of this project. The system assists rescue workers in searching for survivors of natural disasters or missing people. This paper also suggests a method for prioritizing survivors based on their vitality. The system was implemented using a commercial Parrot ANAFI drone and Python. The software was tested on a simulated drone. To simplify the development, the whole system was divided into the following subsystems: Navigation System, Search System and Mission Abort System. These subsystems were tested independently. The testing of solutions and new concepts were performed using smaller test programs on the simulated drone and finally on the physical drone. The Search and Rescue system was successfully developed. The person detection system can detect humans and distinguish them from the environment. Furthermore, based on the movements of a person, the system can distinguish whether the person is a rescuer or a victim. In addition, an area to be flown over can be defined. If something goes wrong during the mission, the mission can be aborted by the Mission Abort System. In the simulation, the predefined area can successfully be flown over. Unfortunately, controlling the physical drone does not work. It stops in the air after takeoff due to the firmware of the drone. It does not change the flight state of the drone, which results in all subsequent commands from the system being ignored. This paper shows that artificial intelligence and drone technologies can be combined to deliver better rescue services. The same system can be applied to other applications.

網路上常常會使用驗證碼(CAPTCHA)防止自動化程序取得網站資源，而一般而言，若驗證碼是可以輕易取得，十分容易被深度學習網路破解。然而，對抗式攻擊(adversarial attack)可以騙過許多深度學習網路。因此，本研究目的為建立能夠破解對抗式攻擊的深度學習網路。主要包含三個部分：建立Captcha breaker、使用對抗式攻擊影響breaker、防禦對抗式攻擊。Captcha breaker的部份使用模擬的目標驗證碼作為訓練資料，以解決訓練資料不足以及人工標籤的問題；而破解adversarial attack會使用adversarial training以及random noising的技術進行。

本研究針對學習圖論演算法的需求，設計一套使用者友善的繪圖軟體Graphene。Graphene繪圖程式除了提供高可讀性的繪製結果，作為輔助繪圖的工具外，也可直接輸入競賽題目的文字格式測試資料產生繪圖結果，並結合現有繪圖演算法，改善、優化樹與類樹圖的繪製結果。此外，也加入時間軸、自訂外觀、參數調整、匯出圖片等功能，幫助學習者理解圖論演算法，亦可幫助教師製作教材，有助於圖論演算法教學。 Graphene採用的繪圖演算法以force-directed graph drawing演算法為基礎，實作節點的分布。然而初始的節點分布會影響繪圖結果，因此我們利用biconnected component、block-cut tree等圖論結構對圖的繪製進行優化。首先找出圖的biconnected component及關節點，重新定義block-cut tree裡的block，接著利用radial tree的布局方式配置每個block，再套用force-directed graph drawing演算法，得到最後的布局結果。如此可以減少不同block之間的交錯，得到較佳的結果。

在生成性模型(Generative Models)中的一個主要應用就是“影像修復” (Image Inpainting) 也稱為“影像完成”(Image completion)。 影像修復經常被應用於許多影像處理，包含在生活照片中移除背景不必要的物件再回填移除後缺損的影像。 但是，或許之前的研究較多著墨於技術而非美學，至目前為止，很少有影像修復的研究著重於藝術作品的重建應用。 所以，本研究計畫提出三個新的模型來針對藝術作品做更優化的影像修復，以達到較一般處理日常照片所使用的如Places2 和ImageNet等影像修復技術在視覺上更為自然逼真的處理： 第一種模型是PConv (Partial Convolutions)，它利用部分旋積(partial convolution) 來避免一般由於遮蔽區域中畫素起始值設定而常見的影像模糊問題。 第二種模型是GLCIC (Globally and Locally Consistent Image Completion)，是一種以GAN (Generative Adversarial Network) 為基礎，進一步在全域鑑別器 (global discriminator) 之上，再建構一個區域性鑑別器(local discriminator)，以確保在整體畫面與細部畫面的合理與一致性的方法。 最後一個模型是一個在本研究中所提出的全新、整合性的模型–PConv-GAN。 在這個創新的模型中，我們將GLCIC模型中常用於旋積過程中”補零”(zero padding) 的手法，以PConv模型中部分旋積的方式來取代。最後我們會利用一系列的印象派畫作為例，以L1 loss 和PSNR (peak signal-to-noise ratio) 兩種方法來評估這三個模型。