DfAnalyzer: Runtime Dataflow Analysis of Scientific Applications using Provenance
Abstract
We present DfAnalyzer, a tool that enables monitoring, debugging, steering, and analysis of dataflows while being generated by scientific applications. It works by capturing strategic domain data, registering provenance and execution data to enable queries at runtime. DfAnalyzer provides lightweight dataflow monitoring components to be invoked by high performance applications. It can be plugged in scripts, or Spark applications, in the same way users already plug visualization library components. During this demo, we will show how DfAnalyzer captures the dataflow, provenance, as well as how it provides runtime data analyses of applications. We will also encourage attendees to use DfAnalyzer for their own applications. PVLDB Reference Format: Vítor Silva, Daniel de Oliveira, Patrick Valduriez, Marta Mattoso. Word Template for VLDB Conferences. PVLDB, 11(5): xxxx-2018, 2018. DOI: https://doi.org/TBD
Domains
Databases [cs.DB]Origin | Files produced by the author(s) |
---|
Loading...