葉力維

Li-WeiYeh

碩士論文（2013）

擬人化之影像概念描述研究

On Personified Image Conceptualization: A Preliminary Research

關鍵字 Keywords

影像註解、擬人化、影像概念描述

image annotation、anthropomorphic、image concept description

摘要

「影像」如同文字內容，係由作者所創作、拍攝或編輯而成，故影像必潛藏作者所要傳達的訊息。過去之研究多透過影像註解(Image Annotation)達到獲取作者擬表達意涵之目的，但仍存有不足之處，如影像註解產出之物件標記無法完整描述影像之意涵。故本研究提出一「擬人化影像概念描述」之方法，模擬人類推論影像的思考流程，首先標記物件，並透過物件間的關係判斷場景，再從物件與場景來推論影像中的事件，最後以簡單之句子描述影像所要傳達的概念。由於影像多以生活照為主，故本研究針對生活照影像進行測試，實驗數據顯示，描述影像語句在受測者判斷下，準確率為87.3%，證明大部分的描述影像文句皆能被人們所接受。

Abstract

“Images” as writings, are created, taken or edited by authors, which might carry the intent of the authors. In previous researches, “image annotation” method was used to indicate the concepts of image. However, object labels which are the outputs of “image annotation” can’t describe the meanings completely. This study proposes a method for image conceptualization by referencing the image realization process of humans. First of all, objects are annotated and scene is classified according to the relations between objects. Then an event of the image is inferred based on the objects and the scene identified in the previous step. Finally, the concept of the image is described using a simple sentence. Owing to the fact that most of images are living photos, this study focused on living photos for experiments of image conceptualization. The experiment showed that the accuracy of sentences for image concept description, which were evaluated by humans, is up to 87.3%. It also proved the applicability of the proposed image conceptualization method.