Reproducible, Accurately Rounded and Efficient BLAS

Chemseddine Chohra 1 Philippe Langlois 1 David Parello 1
1 DALI - Digits, Architectures et Logiciels Informatiques
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, UPVD - Université de Perpignan Via Domitia
Abstract : Numerical reproducibility failures rise in parallel computation because floating-point summation is non-associative. Massively parallel and optimized executions dynamically modify the floating-point operation order. Hence, numerical results may change from one run to another. We propose to ensure reproducibility by extending as far as possible the IEEE-754 correct rounding property to larger operation sequences. We introduce our RARE-BLAS (Reproducible, Accurately Rounded and Efficient BLAS) that benefits from recent accurate and efficient summation algorithms. Solutions for level 1 (asum, dot and nrm2) and level 2 (gemv) routines are presented. Their performance is studied compared to Intel MKL library and other existing reproducible algorithms. For both shared and distributed memory parallel systems, we exhibit an extra-cost of 2× in the worst case scenario, which is satisfying for a wide range of applications. For Intel Xeon Phi accelerator a larger extra-cost (4× to 6×) is observed, which is still helpful at least for debugging and validation steps.
Type de document :
Communication dans un congrès
REPPAR: Reproducibility in Parallel Computing, Aug 2016, Grenoble, France. 3rd International Workshop on Reproducibility in Parallel Computing, 2016, 〈http://reppar.org/index.html〉
Liste complète des métadonnées

Littérature citée [15 références]  Voir  Masquer  Télécharger
https://hal-lirmm.ccsd.cnrs.fr/lirmm-01280324
Contributeur : Philippe Langlois <>
Soumis le : jeudi 28 juillet 2016 - 13:22:03
Dernière modification le : jeudi 24 mai 2018 - 15:59:23

Fichier

REPPAR16.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : lirmm-01280324, version 2

Collections

LIRMM | DALI | UNIV-PERP | MIPS | UNIV-MONTPELLIER

Citation

Chemseddine Chohra, Philippe Langlois, David Parello. Reproducible, Accurately Rounded and Efficient BLAS. REPPAR: Reproducibility in Parallel Computing, Aug 2016, Grenoble, France. 3rd International Workshop on Reproducibility in Parallel Computing, 2016, 〈http://reppar.org/index.html〉. 〈lirmm-01280324v2〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

233

Téléchargements de fichiers

431

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD