Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/25149
Title: | A comparative study of existing quality measures for process discovery | Authors: | JANSSENSWILLEN, Gert Donders, Niels JOUCK, Toon DEPAIRE, Benoit |
Issue Date: | 2017 | Source: | INFORMATION SYSTEMS, 71, p. 1-15 | Abstract: | Evaluating the quality of discovered process models is an important task in many process mining analyses. Currently, several metrics measuring the fitness, precision and generalization of a discovered model are implemented. However, there is little empirical evidence how these metrics relate to each other, both within and across these different quality dimensions. In order to better understand these relationships, a large-scale comparative experiment was conducted. The statistical analysis of the results shows that, although fitness and precision metrics behave very similar within their dimension, some are more pessimistic while others are more optimistic. Furthermore, it was found that there is no agreement between generalization metrics. The results of the study can be used to inform decisions on which quality metrics to use in practice. Moreover, they highlight issues which give rise to new directions for future research in the area of quality measurement. | Notes: | Janssenswillen, G (reprint author), UHasselt Hasselt Univ, Fac Business Econ, Agoralaan, B-3590 Diepenbeek, Belgium. gert.janssenswillen@uhasselt.be; ndonders93@gmail.com; toon.jouck@uhasselt.be; benoit.depaire@uhasselt.be | Keywords: | process discovery; process quality; conformance checking; process metric | Document URI: | http://hdl.handle.net/1942/25149 | ISSN: | 0306-4379 | e-ISSN: | 1873-6076 | DOI: | 10.1016/j.is.2017.06.002 | ISI #: | 000413385200001 | Rights: | (C) 2017 Elsevier Ltd. All rights reserved. | Category: | A1 | Type: | Journal Contribution | Validations: | ecoom 2018 |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
A comparative study of existing quality measures REVISED.pdf | Peer-reviewed author version | 1.07 MB | Adobe PDF | View/Open |
janssenswillen2017.pdf Restricted Access | Published version | 3.18 MB | Adobe PDF | View/Open Request a copy |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.