Scientific Workflow Scheduling with Provenance Support in Multisite Cloud

Ji Liu 1, 2, 3 Esther Pacitti 3, 1 Patrick Valduriez 3, 1, * Marta Mattoso 4
* Corresponding author
1 IBC - Institut de Biologie Computationnelle
2 MSR - INRIA - Microsoft Research - Inria Joint Centre
3 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
4 COPPE-UFRJ - COPPE - Instituto Alberto Luiz Coimbra de Pós-Graduação e Pesquisa de Engenharia
Abstract : Recently, some Scientific Workflow Management Systems (SWfMSs) with provenance support (e.g. Chiron) have been deployed in the cloud. However, they typically use a single cloud site. In this paper, we consider a multisite cloud, where the data and computing resources are distributed at different sites (possibly in different regions). Based on a multisite architecture of SWfMS, i.e. multisite Chiron, we propose a multisite task scheduling algorithm that considers the time to generate provenance data. We performed an experimental evaluation of our algorithm using Microsoft Azure multisite cloud and two real-life scientific workflows, i.e. Buzz and Montage. The results show that our scheduling algorithm is up to 49.6% better than baseline algorithms in terms of execution time.
Keywords : scientific workflow scientific workflow management system parallel execution multisite cloud Scheduling
Document type :
Conference papers
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download
https://hal-lirmm.ccsd.cnrs.fr/lirmm-01342190
Contributor : Patrick Valduriez <>
Submitted on : Tuesday, July 5, 2016 - 2:59:35 PM
Last modification on : Friday, March 15, 2019 - 1:15:00 AM
Long-term archiving on : Thursday, October 6, 2016 - 1:08:33 PM

File

VECPAR.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : lirmm-01342190, version 1

Collections

LIRMM | ZENITH | INRIA | INRA | IBC | MIPS | UNIV-MONTPELLIER

Citation

Ji Liu, Esther Pacitti, Patrick Valduriez, Marta Mattoso. Scientific Workflow Scheduling with Provenance Support in Multisite Cloud. VECPAR, Faculty of Engineering of the University of Porto, Portugal, Jun 2016, Porto, Portugal. pp.8. ⟨lirmm-01342190⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

1028

Files downloads

620

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD