Skip to Main content Skip to Navigation

DfAnalyzer: Runtime Dataflow Analysis of Scientific Applications using Provenance

Vítor Silva 1 Daniel de Oliveira 2 Patrick Valduriez 3 Marta Mattoso 1
3 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : We present DfAnalyzer, a tool that enables monitoring, debugging, steering, and analysis of dataflows while being generated by scientific applications. It works by capturing strategic domain data, registering provenance and execution data to enable queries at runtime. DfAnalyzer provides lightweight dataflow monitoring components to be invoked by high performance applications. It can be plugged in scripts, or Spark applications, in the same way users already plug visualization library components. During this demo, we will show how DfAnalyzer captures the dataflow, provenance, as well as how it provides runtime data analyses of applications. We will also encourage attendees to use DfAnalyzer for their own applications. PVLDB Reference Format: Vítor Silva, Daniel de Oliveira, Patrick Valduriez, Marta Mattoso. Word Template for VLDB Conferences. PVLDB, 11(5): xxxx-2018, 2018. DOI: https://doi.org/TBD
Document type :
Journal articles
Complete list of metadatas

Cited literature [10 references]  Display  Hide  Download

https://hal-lirmm.ccsd.cnrs.fr/lirmm-01867887
Contributor : Patrick Valduriez <>
Submitted on : Tuesday, September 4, 2018 - 4:52:09 PM
Last modification on : Monday, March 30, 2020 - 11:17:50 AM
Document(s) archivé(s) le : Wednesday, December 5, 2018 - 7:13:50 PM

File

VLDB-Demo-DfAnalyzer.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Vítor Silva, Daniel de Oliveira, Patrick Valduriez, Marta Mattoso. DfAnalyzer: Runtime Dataflow Analysis of Scientific Applications using Provenance. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2018, 11 (12), pp.2082-2085. ⟨10.14778/3229863.3236265⟩. ⟨lirmm-01867887⟩

Share

Metrics

Record views

375

Files downloads

186