BOUNDS ON NON-LINEAR ERRORS FOR VARIANCE COMPUTATION WITH STOCHASTIC ROUNDING - Laboratoire d'Informatique Parallélisme Réseaux Algorithmes Distribués
Article Dans Une Revue SIAM Journal on Scientific Computing Année : 2024

BOUNDS ON NON-LINEAR ERRORS FOR VARIANCE COMPUTATION WITH STOCHASTIC ROUNDING

Résumé

The main objective of this work is to investigate non-linear errors and pairwise summation using stochastic rounding (SR) in variance computation algorithms. We estimate the forward error of computations under SR through two methods: the first is based on a bound of the variance and Bienaymé-Chebyshev inequality, while the second is based on martingales and Azuma-Hoeffding inequality. The study shows that for pairwise summation, using SR results in a probabilistic bound of the forward error proportional to log(n)u rather than the deterministic bound in O(log(n)u) when using the default rounding mode. We examine two algorithms that compute the variance, called "textbook" and "two-pass", which both exhibit non-linear errors. Using the two methods mentioned above, we show that these algorithms' forward errors have probabilistic bounds under SR in O(√ nu) instead of nu for the deterministic bounds. We show that this advantage holds using pairwise summation for both textbook and two-pass, with probabilistic bounds of the forward error proportional to log(n)u.
Fichier principal
Vignette du fichier
main.pdf (446.31 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04056057 , version 1 (03-09-2024)
hal-04056057 , version 2 (15-10-2024)

Identifiants

Citer

El-Mehdi El Arar, Devan Sohier, Pablo de Oliveira Castro, Eric Petit. BOUNDS ON NON-LINEAR ERRORS FOR VARIANCE COMPUTATION WITH STOCHASTIC ROUNDING. SIAM Journal on Scientific Computing, In press, ⟨10.1137/23M1563001⟩. ⟨hal-04056057v2⟩
216 Consultations
93 Téléchargements

Altmetric

Partager

More