Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

J-measure based pruning for advancing classification performance of information entropy based rule generation

Liu, Han, Cocea, Mihaela and Ding, Weili 2018. J-measure based pruning for advancing classification performance of information entropy based rule generation. Presented at: International Conference on Machine Learning and Cybernetics, Chengdu, China, 15-18 July 2018.

WarningThere is a more recent version of this item available.
[img]
Preview
PDF - Accepted Post-Print Version
Download (257kB) | Preview

Abstract

Learning of classification rules is a popular approach of machine learning, which can be achieved through two strategies, namely divide-and-conquer and separate-and-conquer. The former is aimed at generating rules in the form of a decision tree, whereas the latter generates if-then rules directly from training data. From this point of view, the above two strategies are referred to as decision tree learning and rule learning, respectively. Both learning strategies can lead to production of complex rule based classifiers that overfit training data, which has motivated researchers to develop pruning algorithms towards reduction of overfitting. In this paper, we propose a J-measure based pruning algorithm, which is referred to as Jmean-pruning. The proposed pruning algorithm is used to advance the performance of the information entropy based rule generation method that follows the separate and conquer strategy. An experimental study is reported to show how Jmean-pruning can effectively help the above rule learning method avoid overfitting. The results show that the use of Jmean-pruning achieves to advance the performance of the rule learning method and the improved performance is very comparable or even considerably better than the one of C4.5.

Item Type: Conference or Workshop Item (Paper)
Date Type: Completion
Status: Unpublished
Schools: Computer Science & Informatics
Related URLs:
Date of First Compliant Deposit: 8 May 2018
Last Modified: 12 Jun 2018 10:23
URI: http://orca.cf.ac.uk/id/eprint/111267

Available Versions of this Item

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics