Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Scalable real-time classification of data streams with concept drift

Tennant, Mark, Stahl, Frederic, Rana, Omer and Gomes, João Bártolo 2017. Scalable real-time classification of data streams with concept drift. Future Generation Computer Systems 75 , pp. 187-199. 10.1016/j.future.2017.03.026
Item availability restricted.

[img] PDF - Published Version
Restricted to Repository staff only until 9 April 2018 due to copyright restrictions.
Available under License Creative Commons Attribution.

Download (2MB)

Abstract

Inducing adaptive predictive models in real-time from high throughput data streams is one of the most challenging areas of Big Data Analytics. The fact that data streams may contain concept drifts (changes of the pattern encoded in the stream over time) and are unbounded, imposes unique challenges in comparison with predictive data mining from batch data. Several real-time predictive data stream algorithms exist, however, most approaches are not naturally parallel and thus limited in their scalability. This paper highlights the Micro-Cluster Nearest Neighbour (MC-NN) data stream classifier. MC-NN is based on statistical summaries of the data stream and a nearest neighbour approach, which makes MC-NN naturally parallel. In its serial version MC-NN is able to handle data streams, the data does not need to reside in memory and is processed incrementally. MC-NN is also able to adapt to concept drifts. This paper provides an empirical study on the serial algorithm’s speed, adaptivity and accuracy. Furthermore, this paper discusses the new parallel implementation of MC-NN, its parallel properties and provides an empirical scalability study.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Uncontrolled Keywords: Parallel data stream classification; Adaptation to concept drift; High velocity data streams
Publisher: Elsevier
ISSN: 0167-739X
Last Modified: 31 Jul 2017 13:05
URI: http://orca.cf.ac.uk/id/eprint/100328

Citation Data

Cited 1 time in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item

Full Text Downloads from ORCA for this publication

Top Downloads of this item by Country

Monthly Full Text Downloads of this item

More statistics for this item...