## Practice Problem Set 1 – Order Statistics

This post presents exercises on order statistics, reinforcing the concepts discussed in two blog posts in a companion blog on mathematical statistics.

The first blog post from the companion blog is an introduction to order statistics. That post presents the probability distributions of the order statistics, both individually and jointly. The second post presents basic examples illustrating how to calculate the order statistics.

$\text{ }$

 Practice Problem 1-A A random sample of size 4 is drawn from a population that has a uniform distribution on the interval $(0,5)$. The resulting order statistics are $X_{(1)}$, $X_{(2)}$, $X_{(3)}$ and $X_{(4)}$. Determine the cumulative distribution function (CDF) of the 3rd order statistic $X_{(3)}$. Evaluate the probability $P(X_{(3)}>2)$.

$\text{ }$

 Practice Problem 1-B As in Problem 1-A, a random sample of size 4 is drawn from a population that has a uniform distribution on the interval $(0,5)$. The resulting order statistics are $X_{(1)}$, $X_{(2)}$, $X_{(3)}$ and $X_{(4)}$. Evaluate the conditional probability $P(X_{(4)}>4 \lvert X_{(3)} >2)$.

$\text{ }$

 Practice Problem 1-C The random sample $X_1,X_2,\cdots,X_9$ of size 9 is drawn from a population that has a uniform distribution on the interval $(0,10)$. Evaluate the mean and variance of the 7th order statistic $X_{(7)}$.

$\text{ }$

 Practice Problem 1-D Suppose that the random sample $X_1,X_2$ of size 2 is drawn from a population that has an exponential distribution with mean 10. Let $X_{(1)}$ be the sample minimum and let $X_{(2)}$ be the sample maximum. Evaluate the conditional probability $P(X_{(1)}<5 \lvert X_{(2)} <10)$.

$\text{ }$

 Practice Problem 1-E Suppose that $X_1,X_2,X_3$ is a random sample drawn from an exponential distribution with mean 10. The sample median here is the 2nd order statistic $X_{(2)}$. Evaluate the probability that the sample median is between 5 and 10.

$\text{ }$

 Practice Problem 1-F Suppose that $X_1,X_2,X_3$ is a random sample drawn from a uniform distribution on the interval $(0,2)$. Let $R=X_{(3)}-X_{(1)}$ be the sample range. Determine the CDF of the sample range $R$. Evaluate the mean and variance of the sample range $R$.

$\text{ }$

 Practice Problem 1-G As in Problem 1-F, $X_1,X_2,X_3$ is a random sample drawn from a uniform distribution on the interval $(0,2)$. Let $R=X_{(3)}-X_{(1)}$ be the sample range. The following relationship relates the variance of the sample range $R$ with the variances and covariance of $X_{(1)}$ and $X_{(3)}$. $Var(R)=Var(X_{(1)})+Var(X_{(3)})-2 \ Cov(X_{(1)},X_{(3)})$ Evaluate $Cov(X_{(1)},X_{(3)})$ using the above relationship. Evaluate the correlation coefficient $\rho$ of $X_{(1)}$ and $X_{(3)}$.

$\text{ }$

 Practice Problem 1-H Suppose that $X_1,X_2,X_3$ is a random sample drawn from a uniform distribution on the interval $(0,5)$. Let $X_{(1)}$,$X_{(2)}$ and $X_{(3)}$ be the resulting order statistics. Determine the conditional density function of $X_{(3)}$ given that $X_{(1)}=x, X_{(2)}=y$ for all $0. What is the distribution indicated by the conditional density function? Evaluate the condition mean $E(X_{(3)} \lvert X_{(1)}=x, X_{(2)}=y)$ and the conditional variance $Var(X_{(3)} \lvert X_{(1)}=x, X_{(2)}=y)$.

$\text{ }$

 Practice Problem 1-I Suppose that $X_1,X_2,X_3$ is a random sample drawn from an exponential distribution with mean $\theta$. Let $X_{(1)}$,$X_{(2)}$ and $X_{(3)}$ be the resulting order statistics. Determine the conditional density function of $X_{(3)}$ given that $X_{(1)}=x, X_{(2)}=y$ for all $0. What is the distribution indicated by the conditional density function? Evaluate the condition mean $E(X_{(3)} \lvert X_{(1)}=x, X_{(2)}=y)$ and the conditional variance $Var(X_{(3)} \lvert X_{(1)}=x, X_{(2)}=y)$.

$\text{ }$

 Practice Problem 1-J Suppose that $X_1,X_2,X_3$ is a random sample drawn from a continuous distribution with density function $f(x)=2x$ where $0. Let the resulting order statistics be $X_{(1)}$, $X_{(2)}$ and $X_{(3)}$ where $X_{(1)}$ is the sample minimum, $X_{(2)}$ is the sample median and $X_{(3)}$ is the sample maximum. Evaluate the mean and variance of the sample minimum $X_{(1)}$. Evaluate the mean and variance of the sample maximum $X_{(3)}$.

$\text{ }$

 Practice Problem 1-K As in Problem 1-J, suppose that $X_1,X_2,X_3$ is a random sample drawn from a continuous distribution with density function $f(x)=2x$ where $0. Let the resulting order statistics be $X_{(1)}$, $X_{(2)}$ and $X_{(3)}$ where $X_{(1)}$ is the sample minimum, $X_{(2)}$ is the sample median and $X_{(3)}$ is the sample maximum. Evaluate the covariance between $X_{(1)}$ and $X_{(3)}$. Evaluate the correlation between $X_{(1)}$ and $X_{(3)}$.

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

1-A
• $\displaystyle F_{X_{(3)}}(x)=\frac{20}{625} \ x^3-\frac{3}{625} \ x^4$
• $\displaystyle \frac{513}{625}=0.8208$
1-B
• $\displaystyle \frac{337}{513}=0.65692$
1-C
• $E(X_{(7)}=7$
• $\displaystyle Var(X_{(7)}=\frac{21}{11}=1.9$
1-D
• $\displaystyle P(X_{(2)}<10)=(1-e^{-1})^2$
• $\displaystyle P(X_{(1)}<5 \lvert X_{(2)}<10)=\frac{1-3 e^{-1}+2 e^{-1.5}}{(1-e^{-1})^2}=0.8575$
1-E
• $\displaystyle 3 \ (e^{-1}-e^{-2})-2 \ (e^{-1.5}-e^{-3})=0.3509$
1-F
• $\displaystyle F_R(r)=\frac{3}{4} \ r^2-\frac{1}{4} \ r^3$
• $\displaystyle E(R)=1$
• $\displaystyle Var(R)=\frac{1}{5}$
1-G
• $\displaystyle Cov(X_{(1)},X_{(3)})=\frac{1}{20}$
• $\displaystyle \rho=\frac{1}{3}$
1-H
• For $0, $\displaystyle f_{X_{(3)} \lvert X_{(1)}=x,X_{(2)}=y}(z \lvert x, y)=\frac{1}{5-y} \ \ \ \ \ y
• This is a uniform distribution on $(y,5)$
• $\displaystyle E(X_{(3)} \lvert X_{(1)}=x,X_{(2)}=y)=\frac{1}{2} \ (y+5)$
• $\displaystyle Var(X_{(3)} \lvert X_{(1)}=x,X_{(2)}=y)=\frac{(5-y)^2}{12}$
1-I
• For $0, $\displaystyle f_{X_{(3)} \lvert X_{(1)}=x,X_{(2)}=y}(z \lvert x, y)=\frac{\frac{1}{\theta} e^{-z/\theta}}{e^{-y/\theta}} \ \ \ \ \ y
• This is an exponential distribution conditional on $z>y$
• $\displaystyle E(X_{(3)} \lvert X_{(1)}=x,X_{(2)}=y)=y+\theta$
• $\displaystyle Var(X_{(3)} \lvert X_{(1)}=x,X_{(2)}=y)=\theta^2$
1-J
• $\displaystyle E(X_{(1)})=\frac{16}{35}$
• $\displaystyle Var(X_{(1)})=\frac{201}{4900}$
• $\displaystyle E(X_{(3)})=\frac{6}{7}$
• $\displaystyle Var(X_{(3)})=\frac{3}{196}$
1-K
• $\displaystyle Cov(X_{(1)},X_{(3)})=\frac{2}{245}$
• $\displaystyle \rho=\frac{8}{\sqrt{603}}=0.326$

Daniel Ma mathematics

Dan Ma math

Daniel Ma probability

Dan Ma probability

Daniel Ma statistics

Dan Ma statistics

$\copyright$ 2018 – Dan Ma

## Practice problems for order statistics and multinomial probabilities

This post presents exercises on calculating order statistics using multinomial probabilities. These exercises are to reinforce the calculation demonstrated in this blog post.

_____________________________________________________________________________________

Practice Problems

Practice Problems 1
Draw a random sample $X_1,X_2,\cdots,X_{11}$ of size 11 from the uniform distribution $U(0,4)$. Calculate the following:

• $P(Y_4<2
• $P(Y_4<2

$\text{ }$

Practice Problems 2
Draw a random sample $X_1,X_2,\cdots,X_7$ of size 7 from the uniform distribution $U(0,5)$. Calculate the probability $P(Y_4<2<4.

$\text{ }$

Practice Problems 3
Same setting as in Practice Problem 2. Calculate $P(Y_7>4 \ | \ Y_4<2)$ and $P(Y_7>4)$. Compare the conditional probability with the unconditional probability. Does the answer for $P(Y_7>4 \ | \ Y_4<2)$ make sense in relation to $P(Y_7>4)$?

$\text{ }$

Practice Problems 4
Same setting as in Practice Problem 2. Calculate the following:

• $P(Y_4<2
• $P(2
• $P(2
• Does the answer for $P(2 make sense in relation to $P(2?

$\text{ }$

Practice Problems 5
Draw a random sample $X_1,X_2,\cdots,X_6$ of size 6 from the uniform distribution $U(0,4)$. Consider the conditional distribution $Y_3 \ | \ Y_5<2$. Calculate the following:

• $P(Y_3 \le t \ | \ Y_5<2)$
• $f_{Y_3}(t \ | \ Y_5<2)$
• $E(Y_3 \ | \ Y_5<2)$
• $E(Y_3)$

where $0. Compare $E(Y_3)$ and $E(Y_3 \ | \ Y_5<2)$. Does the answer for the conditional mean make sense?

$\text{ }$

Practice Problems 6
Draw a random sample $X_1,X_2,\cdots,X_7$ of size 7 from the uniform distribution $U(0,5)$. Calculate the following:

• $P(Y_4 > 4 \ | \ Y_2>2)$
• $P(Y_4 > 4)$
• Compare the two probabilities. Does the answer for the conditional probability make sense?

$\text{ }$
_____________________________________________________________________________________

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$
_____________________________________________________________________________________

Practice Problems 1

• $\displaystyle \frac{11550}{177147}$
• $\displaystyle \frac{18480}{177147}$

$\text{ }$

Practice Problems 2

• $\displaystyle \frac{11088}{78125}$

$\text{ }$

Practice Problems 3

• $\displaystyle P(Y_7>4 \ | \ Y_4<2)=\frac{11088}{22640}$
• $\displaystyle P(Y_7>4)=\frac{61741}{78125}$

$\text{ }$

Practice Problems 4

• $\displaystyle P(Y_4<2
• $\displaystyle P(2
• $\displaystyle P(2

$\text{ }$

Practice Problems 5

• $\displaystyle P(Y_3 \le t \ | \ Y_5<2)=\frac{-10t^6+84t^5-300t^4+400t^3}{448}$
• $\displaystyle f_{Y_3}(t \ | \ Y_5<2)=\frac{-60t^5+420t^4-1200t^3+1200t^2}{448}$
• $\displaystyle E(Y_3 \ | \ Y_5<2)=\frac{55}{49}$
• $\displaystyle E(Y_3)=\frac{84}{49}$

$\text{ }$

Practice Problems 6

• $\displaystyle \frac{3641}{12393}$
• $\displaystyle \frac{2605}{78125}$

$\text{ }$

_____________________________________________________________________________________

$\copyright \ 2015 \text{ by Dan Ma}$

## Calculating the probability distributions of order statistics

This post presents exercises on finding the probability distributions of order statistics to complement a discussion of the same topic.

Consider a random sample $X_1,X_2,\cdots,X_n$ drawn from a continuous distribution with common distribution function $F(x)$. The order statistics $Y_1 are obtained by ranking the sample items in increasing order. In this post, we present some exercises to complement this previous post. The thought processes illustrated by these exercises will be helpful in non-parametric inference, specifically in the construction of confidence intervals for unknown population percentiles.

In the problems that follow, $Y_1 are the order statistics that arise from the random sample $X_1,X_2,\cdots,X_n$. There are two ways to work with the probability distribution of an order statistic $Y_j$. One is to find the distribution function $F_{Y_j}(y)=P(Y_j \le y)$. Once this is obtained, the density function $f_{Y_j}(y)$ is derived by taking derivative. Another way is to derive $f_{Y_j}(y)$ directly.

We assume that the random sample $X_1,X_2,\cdots,X_n$ is drawn from a probability distribution with distribution function $F(x)=P(X \le x)$ and with density function $f(x)$. To compute $F_{Y_j}(y)=P(Y_j \le y)$, note that for the event $Y_j \le y$ to occur, at least $j$ many sample items $X_i$ are less than $y$. So the random drawing of each sample item is a Bernoulli trial with probability of success $F(y)=P(X \le y)$. Thus $F_{Y_j}(y)=P(Y_j \le y)$ is the following probability computed from a binomial distribution.

$\displaystyle F_{Y_j}(y)=P(Y_j \le y)=\sum \limits_{k=j}^n \ \binom{n}{k} \ F(y)^k \ \biggl[1-F(y) \biggr]^{n-k} \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ (1)$

Once the distribution function $F_{Y_j}(y)$ is found, the density function $f_{Y_j}(y)$ can be derived by taking derivative on $F_{Y_j}(y)$. The density function $f_{Y_j}(y)$ can also be obtained directly by this thought process. Think of the density function $f_{Y_j}(y)$ as the probability that the $j$th order statistic $Y_j$ is right around $y$. So there must be $j-1$ sample items less than $y$ and $n-j$ sample items above $y$. One way this can happen is:

$\displaystyle F(y)^{j-1} \ f(y) \ \biggl[1-F(y) \biggr]^{n-j}$

The first term is the probability that $j-1$ sample terms are less than $y$. The second term is the probability that one sample item is right around $y$. The third term is the probability that $n-j$ sample items are above $y$. But this is only one way. To capture all possibilities, we multiply it by the multinomial coefficient.

$\displaystyle f(_{Y_j}(y)=\frac{n!}{(j-1)! \ 1! \ (n-j)!} \ F(y)^{j-1} \ f(y) \ \biggl[1-F(y) \biggr]^{n-j} \ \ \ \ \ \ \ \ \ \ (2)$

_____________________________________________________________________________________

Practice Problems

Practice Problems 1
Draw a random sample $X_1,X_2,\cdots,X_8$ of size 8 from the uniform distribution $U(0,4)$. Calculate the probability $P(Y_3>3)$ where $Y_3$ is the third order statistic.

$\text{ }$

Practice Problems 2
Draw a random sample $X_1,X_2,X_3,X_4,X_5$ of size 5 from a continuous distribution with density function $f(x)=\frac{x}{2}$ where $0. Find the probability that the sample median is less than 1.

$\text{ }$

Practice Problems 3
Draw a random sample $X_1,X_2,X_3,X_4,X_5$ of size 5 from the uniform distribution $U(0,4)$.

1. Calculate the distribution function $P(Y_4 \le y)$ for the fourth order statistic. Then differentiate it to obtain the density function $f_{Y_4}(y)$ of $Y_4$.
2. Use the thought process behind formula (2) above to directly write down the density function $f_{Y_4}(y)$ directly.

$\text{ }$

Practice Problems 4
Draw a random sample $X_1,X_2,\cdots,X_9$ of size 9 from an exponential distribution with mean $\frac{1}{\alpha}$.

1. Calculate the distribution function $P(Y_1 \le y)$ for the first order statistic (the minimum). Then differentiate it to obtain the density function $f_{Y_1}(y)$ of $Y_1$.
2. Use the thought process behind formula (2) above to directly write down the density function $f_{Y_1}(y)$ directly.

$\text{ }$

Practice Problems 5
Draw a random sample $X_1,X_2,\cdots,X_9$ of size 9 from an exponential distribution with mean $\frac{1}{\alpha}$.

1. Calculate the distribution function $P(Y_2 \le y)$ for the second order statistic. Then differentiate it to obtain the density function $f_{Y_2}(y)$ of $Y_2$.
2. Use the thought process behind formula (2) above to directly write down the density function $f_{Y_2}(y)$ directly.

$\text{ }$

Practice Problems 6
Draw a random sample $X_1,X_2,\cdots,X_8$ of size 8 from the uniform distribution $U(0,1)$. Find $E(Y_6)$, the expected value of the sixth order statistic.

$\text{ }$

Practice Problems 7
Draw a random sample $X_1,X_2,\cdots,X_{10}$ of size 10 from the uniform distribution $U(0,1)$. Find $Var(Y_9)$, the variance of the ninth order statistic.

$\text{ }$

Practice Problems 8
Draw a random sample $X_1,X_2,\cdots,X_{6}$ of size 6 from a population whose 25th percentile is 83. Find the probability the third order statistic $Y_3$ is less than 83.

$\text{ }$

Practice Problems 9
Draw a random sample $X_1,X_2,\cdots,X_{6}$ of size 6 from a population whose 75th percentile is 105. Find the probability the third order statistic $Y_3$ is less than 105.

$\text{ }$

Practice Problems 10
Draw a random sample $X_1,X_2,X_3,X_4$ of size 4 from an exponential distribution with mean 10. Calculate $P(Y_4>15 \ | \ Y_4 > 10)$.

$\text{ }$

Practice Problems 11
Draw a random sample $X_1,X_2,X_3,X_4,X_5$ of size 5 from a continuous distribution with density function $f(x)=\frac{x}{2}$ where $0. Find $E(Y_5)$, the expected value of the sample maximum.

$\text{ }$

Practice Problems 12
Draw a random sample of size 12 from an exponential distribution with mean 2. Calculate $P(Y_1>0.5 | Y_1 > 0.25)$.

$\text{ }$

_____________________________________________________________________________________

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$

$\text{ }$
_____________________________________________________________________________________

Practice Problems 1

• $\displaystyle P(Y_3>3)=\frac{277}{65536}$

$\text{ }$

Practice Problems 2

• $\displaystyle P(Y_3<1)=\frac{106}{1024}$

$\text{ }$

Practice Problems 3

• $\displaystyle f_{Y_4}(y)=20 \ \biggl( \frac{y}{4} \biggr)^3 \ \frac{1}{4} \ \biggl(1- \frac{y}{4} \biggr)$

$\text{ }$

Practice Problems 4

• $\displaystyle f_{Y_1}(y)=9 \alpha \ e^{-9 \alpha y}$

$\text{ }$

Practice Problems 5

• $\displaystyle f_{Y_2}(y)=72 \ \biggl(1-e^{-\alpha y} \biggr) \ \alpha e^{-\alpha y} \ \biggl( e^{-\alpha y} \biggr)^7$

$\text{ }$

Practice Problems 6

• $\displaystyle E(Y_6)=\frac{2}{3}$

$\text{ }$

Practice Problems 7

• $\displaystyle Var(Y_9)=\frac{3}{242}$

$\text{ }$

Practice Problems 8

• $\displaystyle P(Y_3<83)=\frac{694}{4096}$

$\text{ }$

Practice Problems 9

• $\displaystyle P(Y_3<105)=\frac{3942}{4096}$

$\text{ }$

Practice Problems 10

• $\displaystyle P(Y_4>15 \ | \ Y_4 > 10)$ = 0.756546693

$\text{ }$

Practice Problems 11

• $\displaystyle E(Y_5)=\frac{20}{11}$

$\text{ }$

Practice Problems 12

• $\displaystyle P(Y_1>0.5 | Y_1 > 0.25)=e^{-1.5}$

_____________________________________________________________________________________

$\copyright \ 2015 \text{ by Dan Ma}$