Publication:
Evaluating Case-Base Maintenance algorithms

Loading...
Thumbnail Image
Date
2014
relationships.isAuthorOfPublication
relationships.isSecondaryAuthorOf
relationships.isDirectorOf
Authors
Lupani, Eduardo ; Juarez, Jose M. ; Palma Méndez, José Tomás
item.page.secondaryauthor
item.page.director
Publisher
publication.page.editor
DOI
doi.org/10.1016/j.knosys.2014.05.014
item.page.type
info:eu-repo/semantics/annotation
Description
© <2014>. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/ This document is the Accepted Manuscript version of a Published Work that appeared in final form in [Knowledge-Based Systems].
Abstract
he success of a Case-Based Reasoning (CBR) system closely depends on its knowledge-base, named the case-base. The life cycle of CBR systems usually implies updating the case-base with new cases. However, it also implies removing useless cases for reasons of efficiency. This process is known as Case-Base Maintenance (CBM) and, in recent decades, great efforts have been made to automatise this process using different kind of algorithms (deterministic and non-deterministic). Indeed, CBR system designers find it difficult to choose from the wealth of algorithms available to maintain the case-base. Despite the importance of such a key decision, little attention has been paid to evaluating these algorithms. Although classical validation methods have been used, such as Cross-Validation and Hold-Out, they are not always valid for non-deterministic algorithms. In this work, we analyse this problem from a methodological point of view, providing an exhaustive review of these evaluation methods supported by experimentation. We also propose a specific methodology for evaluating Case-Base Maintenance algorithms (the αβ evaluation). Experiment results show that this method is the most suitable for evaluating most of the algorithms and datasets studied.
Citation
Knowledge-Based Systems, Volume 67, 2014, Pages 180-194
item.page.embargo
Collections