Scientific Workflow Scheduling with Provenance Support in Multisite Cloud

Ji Liu 1, 2, 3 Esther Pacitti 3, 1 Patrick Valduriez 3, 1, * Marta Mattoso 4
* Corresponding author
3 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Recently, some Scientific Workflow Management Systems (SWfMSs) with provenance support (e.g. Chiron) have been deployed in the cloud. However, they typically use a single cloud site. In this paper, we consider a multisite cloud, where the data and computing resources are distributed at different sites (possibly in different regions). Based on a multisite architecture of SWfMS, i.e. multisite Chiron, we propose a multisite task scheduling algorithm that considers the time to generate provenance data. We performed an experimental evaluation of our algorithm using Microsoft Azure multisite cloud and two real-life scientific workflows, i.e. Buzz and Montage. The results show that our scheduling algorithm is up to 49.6% better than baseline algorithms in terms of execution time.
Document type :
Conference papers
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal-lirmm.ccsd.cnrs.fr/lirmm-01342190
Contributor : Patrick Valduriez <>
Submitted on : Tuesday, July 5, 2016 - 2:59:35 PM
Last modification on : Friday, March 15, 2019 - 1:15:00 AM
Long-term archiving on : Thursday, October 6, 2016 - 1:08:33 PM

File

VECPAR.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : lirmm-01342190, version 1

Collections

Citation

Ji Liu, Esther Pacitti, Patrick Valduriez, Marta Mattoso. Scientific Workflow Scheduling with Provenance Support in Multisite Cloud. VECPAR, Faculty of Engineering of the University of Porto, Portugal, Jun 2016, Porto, Portugal. pp.8. ⟨lirmm-01342190⟩

Share

Metrics

Record views

1028

Files downloads

620