Evaluating the Premises and Results of Metaphor Identification Systems

Dunn, J. (2013). “Evaluating the Premises and Results of Four Metaphor Identification Systems.” In Proceedings of the Conference on Intelligent Text Processing and Computational Linguistics, Vol. 1 (CICLING 2013). Heidelberg: Springer. 471-486.

Abstract. This study first examines the implicit and explicit premises of four systems for identifying metaphoric utterances from unannotated input text. All four systems are then evaluated on a common data set in order to see which premises are most successful. The goal is to see if these systems can find metaphors in a corpus that is mostly non-metaphoric without over-identifying literal and humorous utterances as metaphors. Three of the systems are distributional semantic systems, including a source-target mapping method; a word abstractness measurement method; and a semantic similarity measurement method. The fourth is a knowledge-based system which uses a domain interaction method based on the SUMO ontology, implementing the hypothesis that metaphor is a product of the interactions among all of the concepts represented in an utterance.

[Data: https://drive.google.com/open?id=0B6oBPlj4dynZcWttNnhPblRjZ0k]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s