Satz von Berry-Esseen

Satz von Berry-Esseen (Umgeleitet vom Berry-Esséen-Theorem) Zur Navigation springen Zur Suche springen In der Wahrscheinlichkeitstheorie, der zentrale Grenzwertsatz sagt das aus, unter bestimmten Umständen, Die Wahrscheinlichkeitsverteilung des skalierten Mittelwerts einer Zufallsstichprobe konvergiert gegen eine Normalverteilung, wenn die Stichprobengröße auf unendlich zunimmt. Unter stärkeren Annahmen, das Berry-Esseen-Theorem, oder Berry-Esseen-Ungleichung, liefert ein eher quantitatives Ergebnis, weil es auch die Rate angibt, mit der diese Konvergenz stattfindet, indem es eine Grenze für den maximalen Näherungsfehler zwischen der Normalverteilung und der wahren Verteilung des skalierten Stichprobenmittelwerts angibt. Die Annäherung wird durch die Kolmogorov-Smirnov-Distanz gemessen. Bei unabhängigen Stichproben, die Konvergenzrate ist n−1/2, wobei n die Stichprobengröße ist, und die Konstante wird in Bezug auf die dritten absoluten normalisierten Momente geschätzt.

Inhalt 1 Aussage des Theorems 1.1 Identisch verteilte Summanden 1.2 Nicht identisch verteilte Summanden 1.3 Mehrdimensionale Version 2 Siehe auch 3 Anmerkungen 4 Verweise 5 External links Statement of the theorem Statements of the theorem vary, wie es von zwei Mathematikern unabhängig voneinander entdeckt wurde, Andreas C. Beere (in 1941) und Carl-Gustav Essen (1942), Wer denn, zusammen mit anderen Autoren, verfeinerte es in den folgenden Jahrzehnten immer wieder.

Identically distributed summands One version, Der Übersichtlichkeit halber etwas Allgemeingültigkeit opfern, ist das Folgende: Es existiert eine positive Konstante C, so dass wenn X1, X2, ..., sind i.i.d. Zufallsvariablen mit E(X1) = 0, E(X12) = σ2 > 0, und E(|X1|3) = p < ∞,[note 1] and if we define {displaystyle Y_{n}={X_{1}+X_{2}+cdots +X_{n} over n}} the sample mean, with Fn the cumulative distribution function of {displaystyle {Y_{n}{sqrt {n}} over {sigma }},} and Φ the cumulative distribution function of the standard normal distribution, then for all x and n, {displaystyle left|F_{n}(x)-Phi (x)right|leq {Crho over sigma ^{3}{sqrt {n}}}. (1)} Illustration of the difference in cumulative distribution functions alluded to in the theorem. That is: given a sequence of independent and identically distributed random variables, each having mean zero and positive variance, if additionally the third absolute moment is finite, then the cumulative distribution functions of the standardized sample mean and the standard normal distribution differ (vertically, on a graph) by no more than the specified amount. Note that the approximation error for all n (and hence the limiting rate of convergence for indefinite n sufficiently large) is bounded by the order of n−1/2. Calculated values of the constant C have decreased markedly over the years, from the original value of 7.59 by Esseen (1942), to 0.7882 by van Beek (1972), then 0.7655 by Shiganov (1986), then 0.7056 by Shevtsova (2007), then 0.7005 by Shevtsova (2008), then 0.5894 by Tyurin (2009), then 0.5129 by Korolev & Shevtsova (2010a), then 0.4785 by Tyurin (2010). The detailed review can be found in the papers Korolev & Shevtsova (2010a) and Korolev & Shevtsova (2010b). The best estimate as of 2012, C < 0.4748, follows from the inequality {displaystyle sup _{xin mathbb {R} }left|F_{n}(x)-Phi (x)right|leq {0.33554(rho +0.415sigma ^{3}) over sigma ^{3}{sqrt {n}}},} due to Shevtsova (2011), since σ3 ≤ ρ and 0.33554 · 1.415 < 0.4748. However, if ρ ≥ 1.286σ3, then the estimate {displaystyle sup _{xin mathbb {R} }left|F_{n}(x)-Phi (x)right|leq {0.3328(rho +0.429sigma ^{3}) over sigma ^{3}{sqrt {n}}},} which is also proved in Shevtsova (2011), gives an even tighter upper estimate. Esseen (1956) proved that the constant also satisfies the lower bound {displaystyle Cgeq {frac {{sqrt {10}}+3}{6{sqrt {2pi }}}}approx 0.40973approx {frac {1}{sqrt {2pi }}}+0.01079.} Non-identically distributed summands Let X1, X2, ..., be independent random variables with E(Xi) = 0, E(Xi2) = σi2 > 0, und E(|Xi|3) = ρi < ∞. Also, let {displaystyle S_{n}={X_{1}+X_{2}+cdots +X_{n} over {sqrt {sigma _{1}^{2}+sigma _{2}^{2}+cdots +sigma _{n}^{2}}}}} be the normalized n-th partial sum. Denote Fn the cdf of Sn, and Φ the cdf of the standard normal distribution. For the sake of convenience denote {displaystyle {vec {sigma }}=(sigma _{1},ldots ,sigma _{n}), {vec {rho }}=(rho _{1},ldots ,rho _{n}).} In 1941, Andrew C. Berry proved that for all n there exists an absolute constant C1 such that {displaystyle sup _{xin mathbb {R} }left|F_{n}(x)-Phi (x)right|leq C_{1}cdot psi _{1}, (2)} where {displaystyle psi _{1}=psi _{1}{big (}{vec {sigma }},{vec {rho }}{big )}={Big (}{textstyle sum limits _{i=1}^{n}sigma _{i}^{2}}{Big )}^{-1/2}cdot max _{1leq ileq n}{frac {rho _{i}}{sigma _{i}^{2}}}.} Independently, in 1942, Carl-Gustav Esseen proved that for all n there exists an absolute constant C0 such that {displaystyle sup _{xin mathbb {R} }left|F_{n}(x)-Phi (x)right|leq C_{0}cdot psi _{0}, (3)} where {displaystyle psi _{0}=psi _{0}{big (}{vec {sigma }},{vec {rho }}{big )}={Big (}{textstyle sum limits _{i=1}^{n}sigma _{i}^{2}}{Big )}^{-3/2}cdot sum limits _{i=1}^{n}rho _{i}.} It is easy to make sure that ψ0≤ψ1. Due to this circumstance inequality (3) is conventionally called the Berry–Esseen inequality, and the quantity ψ0 is called the Lyapunov fraction of the third order. Moreover, in the case where the summands X1, ..., Xn have identical distributions {displaystyle psi _{0}=psi _{1}={frac {rho _{1}}{sigma _{1}^{3}{sqrt {n}}}},} and thus the bounds stated by inequalities (1), (2) and (3) coincide apart from the constant. Regarding C0, obviously, the lower bound established by Esseen (1956) remains valid: {displaystyle C_{0}geq {frac {{sqrt {10}}+3}{6{sqrt {2pi }}}}=0.4097ldots .} The upper bounds for C0 were subsequently lowered from the original estimate 7.59 due to Esseen (1942) to (considering recent results only) 0.9051 due to Zolotarev (1967), 0.7975 due to van Beek (1972), 0.7915 due to Shiganov (1986), 0.6379 and 0.5606 due to Tyurin (2009) and Tyurin (2010). As of 2011 the best estimate is 0.5600 obtained by Shevtsova (2010). Multidimensional version As with the multidimensional central limit theorem, there is a multidimensional version of the Berry–Esseen theorem.[1][2] Let {displaystyle X_{1},dots ,X_{n}} be independent {displaystyle mathbb {R} ^{d}} -valued random vectors each having mean zero. Write {displaystyle S=sum _{i=1}^{n}X_{i}} and assume {displaystyle Sigma =operatorname {Cov} [S]} is invertible. Let {displaystyle Zsim operatorname {N} (0,Sigma )} be a {displaystyle d} -dimensional Gaussian with the same mean and covariance matrix as {displaystyle S} . Then for all convex sets {displaystyle Usubseteq mathbb {R} ^{d}} , {displaystyle {big |}Pr[Sin U]-Pr[Zin U],{big |}leq Cd^{1/4}gamma } , where {displaystyle C} is a universal constant and {displaystyle gamma =sum _{i=1}^{n}operatorname {E} {big [}|Sigma ^{-1/2}X_{i}|_{2}^{3}{big ]}} (the third power of the L2 norm). The dependency on {displaystyle d^{1/4}} is conjectured to be optimal, but might not be.[2] See also Chernoff's inequality Edgeworth series List of inequalities List of mathematical theorems Concentration inequality Notes ^ Since the random variables are identically distributed, X2, X3, ... all have the same moments as X1. References ^ Bentkus, Vidmantas. "A Lyapunov-type bound in Rd." Theory of Probability & Its Applications 49.2 (2005): 311–323. ^ Jump up to: a b Raič, Martin (2019). "A multivariate Berry--Esseen theorem with explicit constants". Bernoulli. 25 (4A): 2824–2853. arXiv:1802.06475. doi:10.3150/18-BEJ1072. ISSN 1350-7265. S2CID 119607520. Berry, Andrew C. (1941). "The Accuracy of the Gaussian Approximation to the Sum of Independent Variates". Transactions of the American Mathematical Society. 49 (1): 122–136. doi:10.1090/S0002-9947-1941-0003498-3. JSTOR 1990053. Durrett, Richard (1991). Probability: Theory and Examples. Pacific Grove, CA: Wadsworth & Brooks/Cole. ISBN 0-534-13206-5. Esseen, Carl-Gustav (1942). "On the Liapunoff limit of error in the theory of probability". Arkiv för Matematik, Astronomi och Fysik. A28: 1–19. ISSN 0365-4133. Esseen, Carl-Gustav (1956). "A moment inequality with an application to the central limit theorem". Skand. Aktuarietidskr. 39: 160–170. Feller, William (1972). An Introduction to Probability Theory and Its Applications, Volume II (2nd ed.). New York: John Wiley & Sons. ISBN 0-471-25709-5. Korolev, V. Yu.; Shevtsova, I. G. (2010a). "On the upper bound for the absolute constant in the Berry–Esseen inequality". Theory of Probability and Its Applications. 54 (4): 638–658. doi:10.1137/S0040585X97984449. Korolev, Victor; Shevtsova, Irina (2010b). "An improvement of the Berry–Esseen inequality with applications to Poisson and mixed Poisson random sums". Scandinavian Actuarial Journal. 2012 (2): 1–25. arXiv:0912.2795. doi:10.1080/03461238.2010.485370. S2CID 115164568. Manoukian, Edward B. (1986). Modern Concepts and Theorems of Mathematical Statistics. New York: Springer-Verlag. ISBN 0-387-96186-0. Serfling, Robert J. (1980). Approximation Theorems of Mathematical Statistics. New York: John Wiley & Sons. ISBN 0-471-02403-1. Shevtsova, I. G. (2008). "On the absolute constant in the Berry–Esseen inequality". The Collection of Papers of Young Scientists of the Faculty of Computational Mathematics and Cybernetics (5): 101–110. Shevtsova, Irina (2007). "Sharpening of the upper bound of the absolute constant in the Berry–Esseen inequality". Theory of Probability and Its Applications. 51 (3): 549–553. doi:10.1137/S0040585X97982591. Shevtsova, Irina (2010). "An Improvement of Convergence Rate Estimates in the Lyapunov Theorem". Doklady Mathematics. 82 (3): 862–864. doi:10.1134/S1064562410060062. S2CID 122973032. Shevtsova, Irina (2011). "On the absolute constants in the Berry Esseen type inequalities for identically distributed summands". arXiv:1111.6554 [math.PR]. Shiganov, I.S. (1986). "Refinement of the upper bound of a constant in the remainder term of the central limit theorem". Journal of Soviet Mathematics. 35 (3): 109–115. doi:10.1007/BF01121471. S2CID 120112396. Tyurin, I.S. (2009). "On the accuracy of the Gaussian approximation". Doklady Mathematics. 80 (3): 840–843. doi:10.1134/S1064562409060155. S2CID 121383741. Tyurin, I.S. (2010). "An improvement of upper estimates of the constants in the Lyapunov theorem". Russian Mathematical Surveys. 65 (3(393)): 201–202. doi:10.1070/RM2010v065n03ABEH004688. van Beek, P. (1972). "An application of Fourier methods to the problem of sharpening the Berry–Esseen inequality". Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete. 23 (3): 187–196. doi:10.1007/BF00536558. S2CID 121036017. Zolotarev, V. M. (1967). "A sharpening of the inequality of Berry–Esseen". Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete. 8 (4): 332–342. doi:10.1007/BF00531598. S2CID 122347713. External links Gut, Allan & Holst Lars. Carl-Gustav Esseen, retrieved Mar. 15, 2004. "Berry–Esseen inequality", Encyclopedia of Mathematics, EMS Press, 2001 [1994] Categories: Probabilistic inequalitiesTheorems in statisticsCentral limit theorem