Tail Index Estimation for Discrete Heavy-Tailed Distributions with Application to Statistical Inference for Regular Markov Chains - Laboratoire Traitement et Communication de l'Information
Preprints, Working Papers, ... Year : 2023

Tail Index Estimation for Discrete Heavy-Tailed Distributions with Application to Statistical Inference for Regular Markov Chains

Abstract

It is the purpose of this paper to investigate the issue of estimating the regularity index β > 0 of a discrete heavy-tailed r.v. S, i.e. a r.v. S valued in N * such that P(S > n) = L(n) • n −β for all n ≥ 1, where L : R * + → R+ is a slowly varying function. Such discrete probability laws, referred to as generalized Zipf's laws sometimes, are commonly used to model rank-size distributions after a preliminary range segmentation in a wide variety of areas such as e.g. quantitative linguistics, social sciences or information theory. As a first go, we consider the situation where inference is based on independent copies S1,. .. , Sn of the generic variable S. Just like the popular Hill estimator in the continuous heavy-tail situation, the estimator β we propose can be derived by means of a suitable reformulation of the regularly varying condition, replacing S's survivor function by its empirical counterpart. Under mild assumptions, a non-asymptotic bound for the deviation between β and β is established, as well as limit results (consistency and asymptotic normality). Beyond the i.i.d. case, the inference method proposed is extended to the estimation of the regularity index of a regenerative β-null recurrent Markov chain. Since the parameter β can be then viewed as the tail index of the (regularly varying) distribution of the return time of the chain X to any (pseudo-) regenerative set, in this case, the estimator is constructed from the successive regeneration times. Because the durations between consecutive regeneration times are asymptotically 1 independent, we can prove that the consistency of the estimator promoted is preserved. In addition to the theoretical analysis carried out, simulation results provide empirical evidence of the relevance of the inference technique proposed.
Fichier principal
Vignette du fichier
Tail_index_for_discrete_random_variables_with_applications_to_null_recurrent_Markov_chains.pdf (1.12 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04299756 , version 1 (22-11-2023)

Identifiers

  • HAL Id : hal-04299756 , version 1

Cite

Patrice Bertail, Stephan Clémençon, Carlos Fernández. Tail Index Estimation for Discrete Heavy-Tailed Distributions with Application to Statistical Inference for Regular Markov Chains. 2023. ⟨hal-04299756⟩
136 View
53 Download

Share

More