Tutorials › Statistical Theory I - Probability and Distribution Theory › Central Quantiles and Tail Quantiles Across Families

Normal and Tail Families · Tutorial 191 of 994

Central Quantiles and Tail Quantiles Across Families

Learn to calculate central and upper-tail quantiles across five distribution families and interpret what their parameters do to the results.

Intermediate 11 min read

What You'll Learn

  • Define quantiles consistently and identify when they are unique.
  • Calculate medians, interquartile ranges, and high quantiles for five distribution families.
  • Derive each family’s quantile formula by inverting its CDF.
  • Distinguish the effects of location, scale, and shape parameters.
  • Check quantile calculations against the corresponding tail probabilities.

Why Compare Quantiles?

A median describes the halfway point of a distribution, and the interquartile range (IQR) describes the width of its middle half. A high quantile, such as the 95th percentile, describes a point below which most observations lie. Together, these summaries distinguish the center and central spread from the upper tail. They are especially useful when comparing distributions whose tails behave differently.

The formulas below use the normal, logistic, and Laplace location-scale parameterizations, the Weibull shape-scale parameterization, and the Pareto Type I parameterization. The goal is not only to calculate a quantile, but also to see which parts of its formula respond to location, scale, or shape.

Quantiles and the Central Summaries

Definition: For a distribution function \(F\) and \(0<p<1\), the \(p\)-quantile is \(q_p=\inf\{x:F(x)\ge p\}\). If \(F\) is continuous and strictly increasing on its support where it rises, then \(q_p\) is the unique point in that support satisfying \(F(q_p)=p\). The median is \(q_{0.5}\), and the interquartile range is \(\operatorname{IQR}=q_{0.75}-q_{0.25}\).

All five families considered here have continuous CDFs that are strictly increasing on their supports where they rise, so their quantiles for \(0<p<1\) are unique. For the Weibull and Pareto distributions, the CDF is zero below the lower endpoint of the support; it is not strictly increasing on the whole real line. This does not prevent their interior quantiles from being uniquely determined.

An upper-tail probability \(\varepsilon\) corresponds to the quantile \(q_{1-\varepsilon}\): for these continuous distributions, \(P(X>q_{1-\varepsilon})=\varepsilon\). Thus the 95th percentile is a threshold with 5% of the probability above it.

Quantile Formulas Across the Five Families

Write \(\Phi\) for the standard normal CDF and \(\Phi^{-1}\) for its inverse. For \(X\sim N(\mu,\sigma^2)\), with \(\sigma>0\), the quantile is \(q_p=\mu+\sigma\Phi^{-1}(p)\). Symmetry gives a median of \(\mu\); since \(\Phi^{-1}(0.75)\approx0.67449\), the IQR is approximately \(1.34898\sigma\). The 95th percentile is \(\mu+1.64485\sigma\).

For a logistic distribution with location \(\mu\) and scale \(s>0\), inversion of its CDF gives \(q_p=\mu+s\log\{p/(1-p)\}\). Its median is \(\mu\), its IQR is \(2s\log 3\), and its 95th percentile is \(\mu+s\log 19\).

For a Laplace distribution with location \(\mu\) and scale \(b>0\), the quantile formula is piecewise: \(q_p=\mu+b\log(2p)\) for \(0<p\le 0.5\), and \(q_p=\mu-b\log\{2(1-p)\}\) for \(0.5\le p<1\). The two expressions agree at \(p=0.5\). Consequently, its median is \(\mu\), its IQR is \(2b\log 2\), and its 95th percentile is \(\mu+b\log 10\).

For a Weibull distribution with shape \(k>0\) and scale \(\lambda>0\), supported on \([0,\infty)\), the CDF is \(F(x)=1-\exp\{-(x/\lambda)^k\}\) for \(x\ge0\). Solving \(F(q_p)=p\) gives \(q_p=\lambda[-\log(1-p)]^{1/k}\). Thus its median is \(\lambda(\log 2)^{1/k}\), its IQR is \(\lambda\{(\log 4)^{1/k}-[\log(4/3)]^{1/k}\}\), and its 95th percentile is \(\lambda(\log 20)^{1/k}\).

For a Pareto Type I distribution with minimum \(x_m>0\) and shape \(\alpha>0\), supported on \([x_m,\infty)\), the CDF on its support is \(F(x)=1-(x_m/x)^\alpha\). Inverting gives \(q_p=x_m(1-p)^{-1/\alpha}\). Its median is \(x_m2^{1/\alpha}\), its IQR is \(x_m\{4^{1/\alpha}-(4/3)^{1/\alpha}\}\), and its 95th percentile is \(x_m20^{1/\alpha}\).

Worked Example: Normal Median, IQR, and 95th Percentile

Let \(X\sim N(10,4)\), so the mean is 10 and the standard deviation is \(\sigma=2\), not 4. By symmetry, the median is \(q_{0.5}=10\).

The standard normal quartiles are approximately \(\Phi^{-1}(0.75)=0.67449\) and \(\Phi^{-1}(0.25)=-0.67449\). Therefore \(q_{0.75}=10+2(0.67449)=11.34898\) and \(q_{0.25}=10-2(0.67449)=8.65102\).

Subtracting gives \(\operatorname{IQR}=11.34898-8.65102=2.69796\). The 95th percentile is \(q_{0.95}=10+2(1.644853627)\approx13.28971\). Under this model, approximately 5% of observations exceed 13.28971.

Worked Example: Comparing Logistic and Laplace Quantiles

Compare a logistic distribution with \(\mu=0,s=2\) and a Laplace distribution with \(\mu=0,b=2\). Both are symmetric about zero, so both medians are 0.

For the logistic distribution, \(q_{0.75}=2\log 3\approx2.19722\) and \(q_{0.25}=-2\log 3\approx-2.19722\). Hence its IQR is \(4\log 3\approx4.39445\). Its 95th percentile is \(2\log19\approx5.88888\).

For the Laplace distribution, \(q_{0.75}=2\log2\approx1.38629\) and \(q_{0.25}=-2\log2\approx-1.38629\). Its IQR is \(4\log2\approx2.77259\). Its 95th percentile is \(2\log10\approx4.60517\).

With these equal numerical scale parameters, the logistic distribution has both the larger IQR and the larger 95th percentile. This comparison concerns these quantiles and parameter values; it does not imply that one distribution has a larger quantile at every possible probability level.

Worked Example: Weibull Quantiles and Shape Effects

Let \(X\) have a Weibull distribution with \(k=2\) and \(\lambda=3\). Its median is \(q_{0.5}=3(\log2)^{1/2}\approx2.49766\).

The quartiles are \(q_{0.75}=3(\log4)^{1/2}\approx3(1.17741)=3.53223\) and \(q_{0.25}=3[\log(4/3)]^{1/2}\approx3(0.53636)=1.60908\). Thus the IQR is approximately \(3.53223-1.60908=1.92315\).

The 95th percentile is \(q_{0.95}=3(\log20)^{1/2}\approx3(1.73082)=5.19246\). For a fixed probability \(p\), the scale \(\lambda\) multiplies the quantile directly. The effect of changing \(k\) depends on \(p\): it is not correct to say that increasing the Weibull shape always raises, or always lowers, every quantile.

Worked Example: Pareto Upper Quantiles

Let \(X\) have a Pareto Type I distribution with \(x_m=1\) and \(\alpha=2\). Its median is \(q_{0.5}=1\cdot2^{1/2}\approx1.41421\).

The first and third quartiles are \(q_{0.25}=(4/3)^{1/2}\approx1.15470\) and \(q_{0.75}=4^{1/2}=2\), so the IQR is approximately \(2-1.15470=0.84530\).

The 95th percentile is \(q_{0.95}=20^{1/2}\approx4.47214\). Checking the upper tail, \(P(X>4.47214)=(1/4.47214)^2\approx0.05\), as required.

Why the Parameter Effects Differ

Theorem: If \(Y=a+cX\) for constants \(a\in\mathbb{R}\) and \(c>0\), then \(q_p(Y)=a+cq_p(X)\) for every \(0<p<1\). Consequently, the median changes to \(a+cq_{0.5}(X)\), and the IQR changes to \(c\operatorname{IQR}(X)\).

Proof. The CDF of \(Y\) is \(F_Y(y)=P(a+cX\le y)=F_X((y-a)/c)\), because \(c>0\). Since \(c>0\), \(\{y:F_Y(y)\ge p\}=\{a+cx:F_X(x)\ge p\}\), so taking infima gives \(q_p(Y)=a+cq_p(X)\). Subtracting the transformed first quartile from the transformed third quartile gives \((a+cq_{0.75}(X))-(a+cq_{0.25}(X))=c\operatorname{IQR}(X)\). \(\square\)

This result explains why \(\mu\) shifts normal, logistic, and Laplace quantiles without changing their IQRs, while their positive scale parameters multiply both the quantiles’ distances from the center and the IQR. It also explains why the Weibull scale \(\lambda\) and Pareto minimum \(x_m\) multiply their quantiles and IQRs when their shape parameters are held fixed.

For the Weibull distribution, put \(A=-\log(1-p)>0\). Its quantile can be written \(q_p=\lambda A^{1/k}\), so \(\log q_p=\log\lambda+(\log A)/k\). Differentiation with respect to \(k\) gives \(\partial\log q_p/\partial k=-(\log A)/k^2\). Since \(A<1\) when \(p<1-e^{-1}\), the quantile increases with \(k\) at those probabilities. It decreases with \(k\) when \(p>1-e^{-1}\), and is unchanged when \(p=1-e^{-1}\). In particular, the median decreases as \(k\) increases because \(\log2<1\); the 95th percentile increases because \(\log20>1\).

For Pareto, \(q_p=x_m\exp\{\log(1/(1-p))/\alpha\}\). At fixed \(p\in(0,1)\), the exponent is positive, so increasing \(\alpha\) decreases \(q_p\), while increasing \(x_m\) scales it linearly. The IQR also decreases with \(\alpha\): writing \(t=1/\alpha\), its factor apart from \(x_m\) is \(4^t-(4/3)^t\), which increases with \(t>0\). Indeed, its derivative is \(4^t\log4-(4/3)^t\log(4/3)>0\), since \(4^t>(4/3)^t\) and \(\log4>\log(4/3)>0\).

Common Mistake and a Practical Check

  • Using the wrong normal parameter. In \(N(\mu,\sigma^2)\), the second argument is the variance; the standard deviation used in quantile calculations is its square root.
  • Confusing a high quantile with an upper-tail probability. The 95th percentile has 5% above it, not 95%.
  • Assuming a shape parameter has one effect at every quantile. For the Weibull family, increasing \(k\) lowers the median but raises the 95th percentile when \(\lambda\) is fixed.
  • Claiming strict increase on the whole real line for every CDF here. Weibull and Pareto CDFs are flat below their support. Their interior quantiles are nevertheless unique because each CDF is continuous and strictly increasing where it rises on its support.

A useful check after calculating an upper quantile is to substitute it into the survival probability. For example, the Pareto 95th percentile satisfies \((x_m/q_{0.95})^\alpha=0.05\), and the Weibull 95th percentile satisfies \(\exp\{-(q_{0.95}/\lambda)^k\}=0.05\). Such checks catch errors in signs, complements, or parameter placement.

Check Your Understanding

Use the quantile formulas and parameter interpretations developed above.

  1. For \(X\sim N(4,9)\), identify the standard deviation and calculate the median and 95th percentile.
  2. For a logistic distribution with location 3 and scale 1, write its median, IQR, and 95th percentile.
  3. For a Laplace distribution with \(\mu=0\) and \(b=1\), calculate \(q_{0.25}\) and \(q_{0.75}\), then find the IQR.
  4. For a Weibull distribution with \(\lambda=2\) and \(k=1\), use the quantile formula to find its median and 95th percentile.
  5. For a Pareto Type I distribution, explain how multiplying \(x_m\) by a positive constant affects every quantile and the IQR.