On the Condition of Independence of Linear Forms with a Random Number of Summands

Abstract

The property of independence of two random forms with a non-degenerate random number of summands contradicts the Gaussianity of the summands.

1. Introduction

The interest in the characterization of probability distributions appeared during the 1920s. The original document was an article by G. Polya [1], which highlights an interesting characteristic of Gaussian distribution due to the property of the identity distribution of a random variable and a special linear form. The first result on the characterization of the distribution by the independence of two linear forms of two random variables was achieved by S.N. Bernstein [2], which again appears to be a characterization of the Gaussian distribution. The result obtained by S.N. Bernstein was essentially generalized by Skitovich [3] and Darmois [4]. In their works, the independence of two linear forms from an arbitrary number of random variables was considered. However, the result appeared to be the same. Independence took place for normally distributed variables only. In 1972, the first monograph on the characterization problems in statistics was published, written by A.M. Kagan, Yu.V. Linnik and C.R. Rao [5]. The monograph contained the results on the characterization of probability distributions from many fields of statistics, probability and their applications. Among these were, of course, the results related to independence properties, generalizing those noted above. Nevertheless, all results on the independence of linear forms led to the characterizations of normal distribution. Note that previously unsolved problems were formulated in the monograph [5], the solutions of which could contribute to a better understanding of the role and significance of the characterizations of probability distributions. During the period since the publication of [5], some of these problems have been solved, which led to the further development of the corresponding theory. One of the unsolved problems remained the following (see [5], pp. 460–461): let $\{X_i\}$ be a sequence of independent (and to start with, identically distributed) r.v.’s, let $\{a_i\}$ and $\{b_i\}$ be two sequences of real numbers, and let $\tau$ be a Markovian stopping time (cf. Chapter 12 also): then, construct the ‘linear forms’ with a random number of summands:

$L_1\hspace{0.17em}=\hspace{0.17em}\sum _{i=1}^{\tau }{a}_i{X}_i\mathrm{and}{L}_2\hspace{0.17em}=\hspace{0.17em}\sum _{i=1}^{\tau }{b}_i{X}_i.$

Investigate the conditions for the independence of $L_1$ and $L_2$. Under what conditions on $\tau$ and the sequences $\{a_i\}$ and $\{b_i\}$ would the independence of $L_1$ and $L_2$ imply the normality of $X_i$?

Here, we consider the case:

$L_1\hspace{0.17em}=\hspace{0.17em}\sum _{i=1}^{{\tau }_1}{a}_i{X}_i\mathrm{and}{L}_2\hspace{0.17em}=\hspace{0.17em}\sum _{i=1}^{{\tau }_2}{b}_i{X}_i.$

when ${\tau }_1$ and ${\tau }_2$ are identically distributed random variables independent of the sequence $\{X_i\}$ and from each other. The variant with ${\tau }_1={\tau }_2=\tau$ may almost surely be considered in the same way which would lead to the same result.

2. Main Result

Our main result is given by the following Theorem.

Theorem 1.

Suppose that $\{X_i\}$ is a sequence of independent non-degenerate random variables and τ is a positive integer-valued random variable independent on $\{X_i\}$. Linear forms:

$L_1\hspace{0.17em}=\hspace{0.17em}\sum _{i=1}^{{\tau }_1}{a}_i{X}_{i}and{L}_2\hspace{0.17em}=\hspace{0.17em}\sum _{i=1}^{{\tau }_2}{b}_i{X}_i$

are independent for normally distributed $\{X_i\}$ if and only if ${\tau }_1\hspace{0.17em}=\hspace{0.17em}{\tau }_2\hspace{0.17em}=\hspace{0.17em}n$ with probability 1 (n is a positive integer constant) and ${\sum }_{i=1}^n{a}_i{b}_i{\sigma }_j^2\hspace{0.17em}=\hspace{0.17em}0$ where ${\sigma }_j^2$ is a variance of $X_j$.

Proof. 

Suppose the opposite. This means that there are normally distributed $X_j$ with the parameters $m_j\in {\mathbb{R}}^1$, ${\sigma }_j\in {\mathbb{R}}_{+}^1$ ($j\hspace{0.17em}=\hspace{0.17em}1,2,\dots$) and a positive integer-valued non-degenerated random variable $\tau$ independent of the sequence $\{X_j\}$ and such that $L_1$ and $L_2$ are independent. The independence of $L_1$ and $L_2$ may be written in terms of characteristic functions, which has the form:

$\mathbb{E}exp\{is{L}_1+it{L}_2\}\hspace{0.17em}=\hspace{0.17em}\mathbb{E}exp\{is{L}_1\}\mathbb{E}exp\{it{L}_2\},$

or, in a more detailed form:

(1)$\sum _{k=1}^{\infty }\prod _{j=1}^k{f}_j(a_{j}s+b_{j}t)p_k\hspace{0.17em}=\hspace{0.17em}\sum _{k=1}^{\infty }\prod _{j=1}^k{f}_j\left(a_{j}s\right)p_k\sum _{n=1}^{\infty }\prod _{j=1}^n{f}_j\left(b_{j}t\right)p_n,$

where $p_k\hspace{0.17em}=\hspace{0.17em}\mathbb{P}\{\tau =k\}$, and $f_j\left(u\right)\hspace{0.17em}=\hspace{0.17em}exp\{i{m}_{j}t-{\sigma }_j^2{u}^2/2\}$ is a characteristic function of the normal distribution with the parameters $m_j$ and ${\sigma }_j$ ($j\hspace{0.17em}=\hspace{0.17em}1,2,\dots$). The relation (1) may be written in more detail as

(2)$\begin{array}{c}\sum _{k=1}^{\infty }{p}_{k}exp\{is\sum _{j=1}^k{a}_j{m}_j+it\sum _{j=1}^k{b}_j{m}_j-\frac{s^2}{2}{A}_k-st{C}_k-\frac{t^2}{2}{B}_k\}=\\ =\sum _{k=1}^{\infty }{p}_{k}exp\{is\sum _{j=1}^k{a}_j{m}_j-\frac{s^2}{2}{A}_k\}·\sum _{n=1}^{\infty }{p}_{n}exp\{it\sum _{j=1}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\},\end{array}$

where:

(3)$A_k\hspace{0.17em}=\hspace{0.17em}\sum _{j=1}^k{a}_j^2{\sigma }_j^2,B_k\hspace{0.17em}=\hspace{0.17em}\sum _{j=1}^k{b}_j^2{\sigma }_j^2,C_k\hspace{0.17em}=\hspace{0.17em}\sum _{j=1}^k{a}_j{b}_j{\sigma }_j^2.$

Let us note that $A_k$ and $B_k$ are non-decreasing functions of k and strictly increasing on the set of all k for which $p_k\ne 0$.

Denote by $k_o$ the minimal value of k for which $p_k\ne 0$. Let us fix arbitrary t in (2) and let $s\to \infty$. It is clear that the right-hand-side of (2) tends toward zero and:

(4)$\begin{array}{c}\sum _{k=1}^{\infty }{p}_{k}exp\{is\sum _{j=1}^k{a}_j{m}_j-\frac{s^2}{2}{A}_k\}·\sum _{n=1}^{\infty }{p}_{n}exp\{it\sum _{j=1}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\}=\\ p_{k_o}exp\{is\sum _{j=1}^{k_o}{a}_j{m}_j-A_{k_o}{s}^2/2\}\sum _{n=1}^{\infty }{p}_{n}exp\{it\sum _{j=1}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\}\left(1+o\left(1\right)\right)\end{array}$

as $s\to \infty$.

However, for the left-hand-side of (2) we have:

(5)$\begin{array}{c}\sum _{k=1}^{\infty }{p}_{k}exp\{is\sum _{j=1}^k{a}_j{m}_j+it\sum _{j=1}^k{b}_j{m}_j-\frac{s^2}{2}{A}_k-st{C}_k-\frac{t^2}{2}{B}_k\}=\\ p_{k_o}exp\{is\sum _{j=1}^{k_o}{a}_j{m}_j+it\sum _{j=1}^{k_o}{b}_j{m}_j-\frac{s^2}{2}{A}_{k_o}-st{C}_{k_o}-\frac{t^2}{2}{B}_{k_o}\}\left(1+o\left(1\right)\right)\end{array}$

as $s\to \infty$. From (4) and (5), it follows that:

$p_{k_o}exp\{is\sum _{j=1}^{k_o}{a}_j{m}_j-A_{k_o}{s}^2/2\}\sum _{n=1}^{\infty }{p}_{n}exp\{it\sum _{j=1}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\}=$

$p_{k_o}exp\{is\sum _{j=1}^{k_o}{a}_j{m}_j+it\sum _{j=1}^{k_o}{b}_j{m}_j-\frac{s^2}{2}{A}_{k_o}-st{C}_{k_o}-\frac{t^2}{2}{B}_{k_o}\}\left(1+o\left(1\right)\right)$

or

(6)$\sum _{n=k_o}^{\infty }{p}_{n}exp\{it\sum _{j=k_o}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\}=exp\{it\sum _{j=1}^{k_o}{b}_j{m}_j-st{C}_{k_o}-\frac{t^2}{2}{B}_{k_o}\}\left(1+o\left(1\right)\right)$

as $s\to \infty$ for arbitrary fixed $t\in {\mathbb{R}}^1$. The left-hand-side of (6) does not depend on s. Therefore, $C_{k_o}={\sum }_{j=1}^{k_o}{a}_j{b}_j{\sigma }_j^2=0$ and:

(7)$\sum _{n=k_o}^{\infty }{p}_{n}exp\{it\sum _{j=k_o}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\}=exp\{it\sum _{j=1}^{k_o}{b}_j{m}_j-\frac{t^2}{2}{B}_{k_o}\}\left(1+o\left(1\right)\right).$

However, $B_n>B_{k_o}$ for any $n>k_o$ and t is arbitrary. Therefore, $exp\{it{\sum }_{j=k_o}^n{b}_j{m}_j-\frac{t^2}{2}{B}_n\}/exp\{-\frac{t^2}{2}{B}_{k_o}\}=o\left(1\right)$ as $t\to 0$. Taking this into account and passing to absolute values in both sides of (7), we can see that:

(8)$p_{o}exp\{-\frac{t^2}{2}{B}_{k_o}\}=exp\{-\frac{t^2}{2}{B}_{k_o}\}\left(1+o\left(1\right)\right).$

The relation (8) implies $p_o=1$. □

3. Conclusions

As mentioned in the introduction, the independence of two linear forms usually leads to the normality of the corresponding random variables. Our Theorem 1 shows that this is not the case in the situation under consideration. The reason for this dependence of the forms for non-degenerate distributed, ${\tau }_1$ and ${\tau }_2$, lies in the random number of random variables used. Similar facts may be found in the publications [6,7] for the cases of some different problems. One can see a big difference between problems with a fixed or a random number of variables involved.

Author Contributions

Conceptualization, A.M.K. and L.B.K.; methodology, A.M.K. and L.B.K.; formal analysis, A.M.K. and L.B.K.; investigation, A.M.K. and L.B.K.; writing—original draft preparation, A.M.K. and L.B.K.; writing—review and editing, A.M.K. and L.B.K.; funding acquisition, L.B.K. Both authors have read and agreed to the published version of the manuscript.

Funding

The study was partially supported by grant GAČR 19-04412S (Lev Klebanov).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.