Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

An optimal task-scheduling strategy for large-scale astronomical workloads using in-transit computation model

Wang, Xiaoli, Veeravalli, Bharadwaj and Rana, Omer Farooq 2018. An optimal task-scheduling strategy for large-scale astronomical workloads using in-transit computation model. International Journal of Computational Intelligence Systems 11 (1) , pp. 600-607. 10.2991/ijcis.11.1.45

[img]
Preview
PDF - Published Version
Available under License Creative Commons Attribution Non-commercial.

Download (591kB) | Preview

Abstract

The Sloan Digital Sky Survey (SDSS) has been one of the most successful sky surveys in the history of astronomy. To map the universe, SDSS uses their telescopes to take pictures of the sky over the whole survey area. Now the total SDSS data volume is larger than 125 TB since every night telescopes produce about 200 GB of data. To improve the processing efficiency of such large-scale astronomical data, we develop an optimal task-scheduling strategy by using in-transit computation model under fog computing. Within the proposed strategy, we design a global optimization technique to derive an optimal load distribution among heterogeneously computational resources. Finally, we conduct various experiments to illustrate the correctness and effectiveness of the proposed strategy. Experimental results show that it can significantly decrease the processing time of large-scale workloads.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: Taylor & Francis
ISSN: 1875-6883
Last Modified: 03 Apr 2018 11:04
URI: http://orca.cf.ac.uk/id/eprint/110420

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics