全國中小學科展

依國際科展年度查詢

電腦科學與資訊工程

Face Pose Estimation using ResNet50 in the Metaverse

Face pose estimation has many possible applications, ranging from driver attention measurement systems to applications in the metaverse, which this project will be focused on. Rather than using a more traditional landmark-to-pose method where the head pose is estimated via keypoints, our method trains a simple convolutional neural network, using the dataset 300W_LP, where the images are simply inputted into the network. The model is fitted with three fully connected layers that are linked to the each of the three Euler angles (yaw, pitch, and roll), alongside multiple loss functions, which improve the robustness of the network.

Adversarial Attacks Against Detecting Bot Generated Text

With the introduction of the transformer architecture by Vaswani et al. (2017), contemporary Text Generation Models (TGMs) have shown incredible capabilities in generating neural text that, for humans, is nearly indistinguishable from human text (Radford et al., 2019; Zellers et al., 2019; Keskar et al., 2019). Although TGMs have many potential positive uses in writing, entertainment and software development (Solaiman et al., 2019), there is also a significant threat of these models being misused by malicious actors to generate fake news (Uchendu et al., 2020; Zellers et al., 2019), fake product reviews (Adelani et al., 2020), or extremist content (McGuffie & Newhouse, 2020). TGMs like GPT-2 generate text based on a given prompt, which limits the degree of control over the topic and sentiment of the neural text (Radford et al., 2019). However, other TGMs like GROVER and CTRL allow for greater control of the content and style of generated text, which increases its potential for misuse by malicious actors (Zellers et al., 2019; Keskar et al., 2019). Additionally, many state-of-the-art pre-trained TGMs are available freely online and can be deployed by low-skilled individuals with minimal resources (Solaiman et al., 2019). There is therefore an immediate and substantial need to develop methods that can detect misuse of TGMs on vulnerable platforms like social media or e-commerce websites. Several methods have been explored in detecting neural text. Gehrmann et al. (2019) developed the GLTR tool which highlights distributional differences in GPT-2 generated text and human text, and assists humans in identifying a piece of neural text. The other approach is to formulate the problem as a classification task to distinguish between neural text and human text and train a classifier model (henceforth a ‘detector’). Simple linear classifiers on TF-IDF vectors or topology of attention maps have also achieved moderate performance (Solaiman et al., 2019; Kushnareva et al., 2021). Zellers et al. (2019) propose a detector of GROVER generated text based on a linear classifier on top of the GROVER model and argue that the best TGMs are also the best detectors. However, later results by Uchendu et al. (2020) and Solaiman et al. (2019) show that this claim does not hold true for all TGMs. Consistent through most research thus far is that fine-tuning the BERT or RoBERTa language model for the detection task achieves state-of-the-art performance (Radford et al., 2019; Uchendu et al., 2020; Adelani et al., 2020; Fagni et al., 2021). I will therefore be focussing on attacks against a fine-tuned RoBERTa model. Although extensive research has been conducted on detecting generated text, there is a significant lack of research in adversarial attacks against such detectors (Jawahar et al., 2020). However, the present research that does exist preliminarily suggests that neural text detectors are not robust, meaning that the output can change drastically even for small changes in the text input and thus that these detectors are vulnerable to adversarial attacks (Wolff, 2020). In this paper, I extend on Wolff’s (2020) work on adversarial attacks on neural text detectors by proposing a series of attacks designed to counter detectors as well as an algorithm to optimally select for these attacks without compromising on the fluency of generated text. I do this with reference to a fine-tuned RoBERTa detector and on two datasets: (1) the GPT-2 WebText dataset (Radford et al., 2019) and (2) the Tweepfake dataset (Fagni et al., 2021). Additionally, I experiment with possible defences against these attacks, including (1) using count-based features, (2) stylometric features and (3) adversarial training.

以深度學習與遷移學習防範社群媒體片面新聞訊息之研究

現代民眾獲取新聞的途徑逐漸轉移到網路媒體,然而在網路資訊快速傳播以及媒體為追求報導曝光度以增加金錢利益的情形下,片面、誘導等形式的新聞標題與短句訊息在新聞媒體傳播中日益嚴重;本次研究透過Fake News Challenge提供的Stance Detection dataset,運用深度學習與遷移學習方法訓練可預測兩文本之間相關程度的自然語言處理模型,在過程中改善調參及訓練方式,並將其實際運用在預測美國新聞媒體於Facebook網路社群平台發文推播新聞的同時所附的短句與新聞報導文本內容之間的相關關係程度,分析社群平台中新聞可能造成的誤導式文句是否實際造成片面報導,而影響了受眾對於媒體的使用程度與信任程度。使此模型有助即時預警社群平台上的報導資訊型態品質,輔助使用者獲取新聞時所應具備的媒體識讀能力,進而改善片面報導於網路的流竄,同時提升未來媒體生態。

Automated Debugging System – Implementing Program Spectrum Analysis and Information Retrieval on Fault Localization

在程式專案開發中,偵測錯誤常為最耗時的環節,進而影響整個專案的開發時長。而現今雖有些許輔助開發者提升偵錯效能的工具,但這些工具也只能藉由提供編譯執行中的資訊讓開發者省去偵錯時的繁瑣步驟,仍須開發者自行評估每段程式碼的正確性。此研究透過程式段落分析與資訊檢索實現自動錯誤定位,在每個程式段落標記其成為臭蟲(bug)的可能性。在程式段落分析中,執行使用者之原始碼,並透過歸納最終結果為正確及錯誤之執行路徑差異分析出每個程式段落的可疑性。接著運用資訊檢索技術於資料庫中找尋相似之原始碼,並參考其偵錯結果優化現有之可疑性,形成最終之可疑性排名。此研究不只結合了上述兩種技術,更優化可疑程度之計算方法以及資訊檢索中的相似度比對機制,達到更完善的錯誤定位。(此指「臭蟲」非語法錯誤(Syntax Errors),而為邏輯錯誤(Logic Errors)。)

利用Yolo 模型辨識台灣國語口手語之研究

手語為聾啞人士日常溝通的工具,但對一般人來說這是一種難以理解的溝通方式。本實驗使用深度學習的 Yolov3 與 Yolov4 模型訓練37個國語注音符號手勢,然後再驗證模型對圖片、影片、即時(Real time)攝影辨識的正確率。 實驗結果顯示:Yolo v3 圖片辨識度效果還不錯,但影片辨識度很差,而Yolo v4 不管在靜態的圖片或動態影片都有不錯的辨識率,另外在即時的影像辨識也有不錯的效果。 雖然有部分符號的辨識度很低,但這可能是訓練時照片拍攝的問題,如果可以改進拍攝的數量和技巧,相信可以大幅提升判讀的準確率。

彩色二維條碼手持產品開發之探討

QR Code是由黑白模組組成的二維數位條碼,掃描後可讀取儲存的訊息。受限於設計原理,QR Code使用二進位制儲存資料。增加模組數目可增加資料量,但若在條碼內塞進太多模組時,尺寸太小的模組將無法被掃描器讀取。此外,目前QR Code掃描器僅支援單張掃描,並無法應付同時多張條碼掃描的實務需求。 如能克服顏色辨識,理論上彩色二維條碼將能克服現行QR Code的限制,但市面上並無相關產品可供測試。因此本專題設計了一款10×10、具8顏色的"Colour Matrix",並利用Raspberry Pi開發Colour Matrix在手持裝置上運作的軟硬體來進行實驗。此實驗成功利用機器學習演算法在Raspberry Pi上進行的顏色辨識。開發的程式在單張掃描上效能與使用pyzbar辨識QR Code相當;在多張掃描方面,使用pyzbar辨識QR Code的解碼成功率為3.1%,而本專題的方法將成功率提升至92.4%,擴增數位條碼的使用範圍,具商用價值。

Development of an autonomous Search and Rescue Drone

The number of natural disasters has risen significantly in recent years, and with climate change there is no end in sight. Consequently, the demands on rescue forces around the world are increasing. For this reason, I asked myself what I can do to improve the work of rescue teams. Advances in artificial intelligence and drone technology enable new possibilities for problem solving. Based on the technological advances mentioned above, an autonomous Search and Rescue drone was developed as part of this project. The system assists rescue workers in searching for survivors of natural disasters or missing people. This paper also suggests a method for prioritizing survivors based on their vitality. The system was implemented using a commercial Parrot ANAFI drone and Python. The software was tested on a simulated drone. To simplify the development, the whole system was divided into the following subsystems: Navigation System, Search System and Mission Abort System. These subsystems were tested independently. The testing of solutions and new concepts were performed using smaller test programs on the simulated drone and finally on the physical drone. The Search and Rescue system was successfully developed. The person detection system can detect humans and distinguish them from the environment. Furthermore, based on the movements of a person, the system can distinguish whether the person is a rescuer or a victim. In addition, an area to be flown over can be defined. If something goes wrong during the mission, the mission can be aborted by the Mission Abort System. In the simulation, the predefined area can successfully be flown over. Unfortunately, controlling the physical drone does not work. It stops in the air after takeoff due to the firmware of the drone. It does not change the flight state of the drone, which results in all subsequent commands from the system being ignored. This paper shows that artificial intelligence and drone technologies can be combined to deliver better rescue services. The same system can be applied to other applications.

圖論演算法學習用之繪圖程式

本研究針對學習圖論演算法的需求,設計一套使用者友善的繪圖軟體Graphene。Graphene繪圖程式除了提供高可讀性的繪製結果,作為輔助繪圖的工具外,也可直接輸入競賽題目的文字格式測試資料產生繪圖結果,並結合現有繪圖演算法,改善、優化樹與類樹圖的繪製結果。此外,也加入時間軸、自訂外觀、參數調整、匯出圖片等功能,幫助學習者理解圖論演算法,亦可幫助教師製作教材,有助於圖論演算法教學。 Graphene採用的繪圖演算法以force-directed graph drawing演算法為基礎,實作節點的分布。然而初始的節點分布會影響繪圖結果,因此我們利用biconnected component、block-cut tree等圖論結構對圖的繪製進行優化。首先找出圖的biconnected component及關節點,重新定義block-cut tree裡的block,接著利用radial tree的布局方式配置每個block,再套用force-directed graph drawing演算法,得到最後的布局結果。如此可以減少不同block之間的交錯,得到較佳的結果。

摘要演算法和語句分析之關聯性

在這個資訊發達的時代,網路充滿著五花八門的資訊,導致我們在查詢資料時會因為這些雜亂且未經過濾的資料浪費許多時間,其中最為氾濫的便是點擊誘餌(clickbait),此種新聞常常有著吸引人的標題,而內容卻不會與主題相符,人們也常常在讀完整篇文章後才意識到自己浪費了許多時間在無意義的資訊上面。解決此問題很常用的方法之一便是運用摘要演算法來讓讀者先對新聞有一個大概的理解,不過,雖然摘要演算法越來越普及,但產生出來的摘要仍會和人為判斷的結果有所差距,進而造成閱讀理解上的錯誤以及偏差,所以我們想要藉由這次研究,從一個嶄新的角度切入,探討摘要演算法和句型分析之間的關係,融合原本向量建構的方式以及語句結構的分析來測試摘要的準確度,並且由結果研發出一個可以產生出更為精確的主旨之摘要演算法,除此之外,我們也會融合實地調查以及搜集意見的方式來更進一步探討人們思模式與產生出的摘要之關聯性。

Development of an Android Application for Triage Prediction in Hospital Emergency Departments

Triage is the process by which nurses manage hospital emergency departments by assigning patients varying degrees of urgency. While triage algorithms such as the Emergency Severity Index (ESI) have been standardized worldwide, many of them are highly inconsistent, which could endanger the lives of thousands of patients. One way to improve on nurses’ accuracy is to use machine learning models (ML), which can learn from past data to make predictions. We tested six ML models: random forest, XGBoost, logistic regression, support vector machines, k-nearest neighbors, and multilayer perceptron. These models were tasked with predicting whether a patient would be admitted to the intensive care unit (ICU), another unit in the hospital, or be discharged. After training on data from more than 30,000 patients and testing using 10-fold cross-validation, we found that all six models outperformed ESI. Of the six, the random forest model achieved the highest average accuracy in predicting both ICU admission (81% vs. 69% using ESI; p<0.001) and hospitalization (75% vs. 57%; p<0.001). These models were then added to an Android application, which would accept patient data, predict their triage, and then add them to a priority-ordered waiting list. This approach may offer significant advantages over conventional triage: mainly, it has a higher accuracy than nurses and returns predictions instantaneously. It could also stand-in for triage nurses entirely in disasters, where medical personnel must deal with a large influx of patients in a short amount of time.