Level 1 Parallel RTN-BLAS: Implementation and Efficiency Analysis

Chemseddine Chohra 1, * Philippe Langlois 1 David Parello 1
* Corresponding author
1 DALI - Digits, Architectures et Logiciels Informatiques
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, UPVD - Université de Perpignan Via Domitia
Abstract : Modern high performance computation (HPC) performs a huge amount of floating point operations on massively multi-threaded systems. Those systems interleave operations and include both dynamic scheduling and non-deterministic reductions that prevent numerical reproducibility, i.e. getting identical results from multiple runs, even on one given machine. Floating point addition is non-associative and the results depend on the computation order. Of course, numerical reproducibility is important to debug, check the correctness of programs and validate the results. Some solutions have been proposed like parallel tree scheme [1] or new Demmel and Nguyen's reproducible sums [2]. Reproducibility is not equivalent to accuracy: a reproducible result may be far away from the exact result. Another way to guarantee the numerical reproducibility is to calculate the correctly rounded value of the exact result, i.e. extending the IEEE-754 rounding properties to larger computing sequences. When such computation is possible, it is certainly more costly. But is it unacceptable in practice? We are motivated by round-to-nearest parallel BLAS. We can imple-ment such RTN-BLAS thanks to recent algorithms that compute correctly rounded sums. This work is a first step for the level 1 of the BLAS.
Complete list of metadatas

https://hal-lirmm.ccsd.cnrs.fr/lirmm-01095172
Contributor : Philippe Langlois <>
Submitted on : Saturday, June 27, 2015 - 1:38:32 PM
Last modification on : Tuesday, February 19, 2019 - 8:28:01 PM
Long-term archiving on : Wednesday, September 16, 2015 - 1:37:26 AM

Files

Licence


Distributed under a Creative Commons Attribution - NoDerivatives 4.0 International License

Identifiers

  • HAL Id : lirmm-01095172, version 1

Collections

Citation

Chemseddine Chohra, Philippe Langlois, David Parello. Level 1 Parallel RTN-BLAS: Implementation and Efficiency Analysis. SCAN: Scientific Computing, Computer Arithmetic and Validated Numerics, Sep 2014, Wurzburg, Germany. ⟨lirmm-01095172⟩

Share

Metrics

Record views

588

Files downloads

442