Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/817
Title: | The measures precision, recall, fallout and miss in function of the number of retrieved documents and their mutual interrelations | Authors: | EGGHE, Leo | Issue Date: | 2008 | Publisher: | Pergamon Press, Inc | Source: | INFORMATION PROCESSING & MANAGEMENT, 44(2). p. 856-876 | Abstract: | In this paper, for the first time, we present global curves for the measures precision, recall, fallout and miss in function of the number of retrieved documents. Different curves apply for different retrieved systems, for which we give exact definitions in terms of a retrieval density function: perverse retrieval, perfect retrieval, random retrieval, normal retrieval, hereby extending results of Buckland and Gey and of Egghe in the following sense: mathematicallymore advanced methods yield a better insight into these curves, more types of retrieval are considered and, very importantly, the theory is developed for the “complete” set of measures: precision, recall, fallout and miss. Next we study the interrelationships between precision, recall, fallout and miss in these different types of retrieval, hereby again extending results of Buckland and Gey (incl. a correction) and of Egghe. In the case of normal retrieval we prove that precision in function of recall and recall in function of miss is a concavely decreasing relationship while recall in function of fallout is a concavely increasing relationship. We also show, by producing examples, that the relationships between fallout and precision, miss and precision and miss and fallout are not always convex or concave. | Keywords: | precision; recall; fallout; miss; retrieved documents; perverse retrieval, perfect retrieval; random retrieval; normal retrieval | Document URI: | http://hdl.handle.net/1942/817 | ISSN: | 0306-4573 | e-ISSN: | 1873-5371 | DOI: | 10.1016/j.ipm.2007.03.014 | ISI #: | 000254813200025 | Category: | A1 | Type: | Journal Contribution | Validations: | ecoom 2009 |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
measures 1.pdf Restricted Access | Published version | 220.2 kB | Adobe PDF | View/Open Request a copy |
measures 2.pdf | Peer-reviewed author version | 530.6 kB | Adobe PDF | View/Open |
SCOPUSTM
Citations
25
checked on Sep 3, 2020
WEB OF SCIENCETM
Citations
33
checked on Apr 30, 2024
Page view(s)
12
checked on Sep 7, 2022
Download(s)
38
checked on Sep 7, 2022
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.