Tutorials › Statistical Theory I - Probability and Distribution Theory › Mean, Median, and Mode in Skewed Families

Normal and Tail Families · Tutorial 193 of 994

Mean, Median, and Mode in Skewed Families

Derive and compare the mean, median, and mode for three skewed distribution families, including cases where a summary is undefined or their ordering changes.

Intermediate 10 min read

What You'll Learn

  • Derive the lognormal mean, median, and mode from its log-scale normal model.
  • Calculate the three summaries for Weibull distributions across different shape regimes.
  • Identify when a Weibull density has an interior mode or a boundary mode.
  • Determine Pareto medians and modes, and check when the mean exists.
  • Compare the summaries without assuming that every right-skewed distribution has the same ordering.
  • Distinguish an undefined mean from a finite median or mode.

Why These Three Summaries Can Disagree

For a symmetric distribution, the mean, median, and mode often coincide. In a skewed distribution, they can separate: a long right tail can pull the mean above the median, while the mode still marks where the density is highest. The amount and even the ordering of that separation depend on the distribution family and its parameters.

This tutorial compares these summaries for lognormal, Weibull, and Pareto distributions. The mean is an expectation, so it need not be finite. A median is a central quantile, while a mode describes the density's peak; neither should be treated as interchangeable with the mean.

Definition: A median of a random variable \(X\) is a value \(m\) such that \(P(X\leq m)\geq 1/2\) and \(P(X\geq m)\geq 1/2\). For a continuous distribution with a strictly increasing CDF, it is the unique value satisfying \(F(m)=1/2\). For a continuous distribution with density \(f\), a mode is a point where \(f\) attains its global maximum. If the density is unbounded at a boundary, we will identify the boundary as the limiting mode and note that no finite density value is attained there.

Lognormal: Three Different Locations on the Original Scale

Use the convention \(X\sim\operatorname{Lognormal}(\mu,\sigma^2)\) when \(Y=\log X\sim N(\mu,\sigma^2)\), with \(\sigma>0\). Thus \(X>0\), and the normal parameters describe the logarithm of \(X\), not \(X\) itself.

Because \(P(X\leq x)=P(Y\leq\log x)\) for \(x>0\), the median is \(\exp(\mu)\): the normal variable \(Y\) has median \(\mu\). The mean follows by completing the square in the normal integral:

$$ E[X]=E[e^Y] =\frac{1}{\sigma\sqrt{2\pi}}\int_{-\infty}^{\infty} \exp\left(y-\frac{(y-\mu)^2}{2\sigma^2}\right)\,dy =\exp\left(\mu+\frac{\sigma^2}{2}\right). $$

For the mode, the lognormal density for \(x>0\) is \(f(x)=\frac{1}{x\sigma\sqrt{2\pi}}\exp\left(-\frac{(\log x-\mu)^2}{2\sigma^2}\right)\). Differentiating its log-density gives \(\frac{d}{dx}\log f(x)=-\frac{1}{x}-\frac{\log x-\mu}{\sigma^2x}\). The derivative vanishes at \(\log x=\mu-\sigma^2\); it is positive below this point and negative above it. Hence this point is the density's maximum.

Result: If \(X\sim\operatorname{Lognormal}(\mu,\sigma^2)\) with \(\sigma>0\), then \(E[X]=\exp(\mu+\sigma^2/2)\), the median is \(\exp(\mu)\), and the mode is \(\exp(\mu-\sigma^2)\). In particular, mean \(>\) median \(>\) mode.

Worked Example: A Lognormal Distribution

Let \(X\sim\operatorname{Lognormal}(0,1)\). The log-scale standard deviation is \(1\), so the formulas give

$$ E[X]=e^{0+1/2}=e^{1/2}\approx1.649,\qquad \operatorname{median}(X)=e^0=1,\qquad \operatorname{mode}(X)=e^{0-1}=e^{-1}\approx0.368. $$

The mean is more than four times the mode. The right tail contributes enough large values to raise the mean, even though the density peaks below \(1\). All three summaries are finite; the large gap reflects the shape, not a failure of the mean to exist.

Weibull: Shape Can Change the Ordering

Use the scale-shape convention \(X\sim\operatorname{Weibull}(k,\lambda)\), where \(k>0\) is the shape and \(\lambda>0\) is the scale. Its CDF and density for \(x>0\) are \(F(x)=1-\exp[-(x/\lambda)^k]\) and \(f(x)=\frac{k}{\lambda}(x/\lambda)^{k-1}\exp[-(x/\lambda)^k]\).

Solving \(F(m)=1/2\) gives the median. For the mean, substitute \(u=(x/\lambda)^k\) in the density integral; then \(x=\lambda u^{1/k}\) and the resulting integral is the defining gamma integral. For the mode, differentiating the log-density locates its interior stationary point when one exists.

$$ \operatorname{median}(X)=\lambda(\log 2)^{1/k},\qquad E[X]=\lambda\Gamma(1+1/k), $$

where \(\Gamma(a)=\int_0^\infty u^{a-1}e^{-u}\,du\) for \(a>0\). To determine the mode, write \(\log f(x)=\log(k/\lambda)+(k-1)\log(x/\lambda)-(x/\lambda)^k\). For \(k>1\), setting its derivative to zero yields \((x/\lambda)^k=(k-1)/k\), so the mode is \(\lambda((k-1)/k)^{1/k}\). When \(k=1\), the density is decreasing from its largest value at zero. When \(0<k<1\), the density diverges as \(x\) decreases to zero; zero is the limiting boundary mode, but the density has no finite maximum value there.

Worked Example: Weibull Shape Below One

Take \(k=1/2\) and \(\lambda=2\). The mean is \(2\Gamma(3)=2(2!)=4\), since \(\Gamma(3)=2\). The median is

$$ 2(\log 2)^{1/(1/2)} =2(\log 2)^2 \approx2(0.48045)=0.961. $$

Here the density increases without bound as \(x\) approaches zero, so the limiting boundary mode is \(0\) (not a point with a finite density maximum). The mean is finite and much larger than the median, while the density's peak is at the lower boundary.

Worked Example: Weibull Shape Changes the Ordering

First let \(k=2\), \(\lambda=3\). Using \(\Gamma(3/2)=\sqrt{\pi}/2\), the mean is \(3\sqrt{\pi}/2\approx2.659\). The median is \(3\sqrt{\log 2}\approx2.498\), and the mode is \(3(1/2)^{1/2}\approx2.121\). Thus mean \(>\) median \(>\) mode in this case.

Now let \(k=4\), \(\lambda=1\). The mean is \(\Gamma(5/4)\approx0.9064\), the median is \((\log 2)^{1/4}\approx0.9124\), and the mode is \((3/4)^{1/4}\approx0.9306\). Now mean \(<\) median \(<\) mode. These calculations show why a fixed ordering should not be assumed for the Weibull family: changing the shape changes the density and the locations of its summaries.

Pareto: A Finite Median Does Not Guarantee a Finite Mean

For a Type I Pareto distribution, let \(X\) have support \(x\geq x_m\), where \(x_m>0\) is the minimum value, and shape \(\alpha>0\). Its CDF is \(F(x)=1-(x_m/x)^\alpha\) on the support. Inverting \(F(m)=1/2\) gives a finite median for every \(\alpha>0\). The density decreases on the support, so its maximum is at the endpoint \(x_m\).

The mean requires more care: its density integral is \(\alpha x_m^\alpha x^{-\alpha-1}\), and the expectation is finite only when the corresponding integral of \(x^{-\alpha}\) over \([x_m,\infty)\) converges. When \(\alpha>1\), direct integration gives

$$ E[X]=\int_{x_m}^{\infty}x\alpha x_m^\alpha x^{-\alpha-1}\,dx =\frac{\alpha x_m}{\alpha-1}. $$

For \(0<\alpha\leq1\), that integral diverges and the mean is infinite. The median and mode remain finite: \(\operatorname{median}(X)=x_m2^{1/\alpha}\), and the mode is \(x_m\).

Result: For a Type I Pareto distribution with \(x_m>0\) and \(\alpha>0\), the median is \(x_m2^{1/\alpha}\) and the density mode is \(x_m\). The mean is \(\alpha x_m/(\alpha-1)\) if \(\alpha>1\), and is infinite if \(0<\alpha\leq1\). When finite, the mean exceeds the median: setting \(t=1/\alpha\in(0,1)\), \(\log(\alpha/(\alpha-1))=-\log(1-t)>t>\!t\log 2\).

Worked Example: Pareto Summaries With a Finite Mean

Let \(x_m=2\) and \(\alpha=3\). The mean is \(3(2)/(3-1)=3\). The median is \(2\cdot2^{1/3}\approx2.520\), and the density mode is the lower endpoint \(2\). Therefore the ordering is mean \(>\) median \(>\) mode.

Keep \(x_m=2\), but take \(\alpha=0.8\). The median remains finite: \(2\cdot2^{1/0.8}=2\cdot2^{1.25}\approx4.757\), and the mode remains \(2\). The mean is infinite because \(\alpha\leq1\). It would be incorrect to substitute \(\alpha=0.8\) into \(\alpha x_m/(\alpha-1)\) and report a negative mean: that formula was derived only for \(\alpha>1\), and the defining integral diverges otherwise.

Interpreting the Comparisons

The mean responds to the magnitude of all observations, including rare extreme values; the median depends only on which side of it contains half the probability; the mode concerns the density peak. The examples illustrate three distinct patterns: the lognormal has mean \(>\) median \(>\) mode for positive log-scale variance; the Pareto has mean \(>\) median \(>\) mode when its mean exists; and the Weibull ordering can change with its shape.

A common mistake is to claim that every right-skewed distribution must have mean \(>\) median \(>\) mode. That is a useful pattern in some familiar cases, not a general theorem about skewness. The Weibull calculations with \(k=4\) directly contradict it. Another mistake is to report a mean formula without checking its existence condition, as the Pareto example shows. Always identify the parameter regime first, and distinguish an infinite or undefined mean from a large but finite one.

Check Your Understanding

Use the parameter conventions and existence conditions stated above.

  1. For \(X\sim\operatorname{Lognormal}(1,4)\), calculate its mean, median, and mode. Which is largest?
  2. For a Weibull distribution with \(k=1\), what are its median and mode? Describe the density at the mode.
  3. Why is zero called a limiting boundary mode for a Weibull density with \(0<k<1\), rather than a point where the density attains a finite maximum?
  4. For a Type I Pareto distribution with \(x_m=5\) and \(\alpha=1\), which of the mean, median, and mode are finite? Calculate the finite summaries.
  5. Give the Weibull example above that reverses the mean-median-mode ordering seen for \(k=2\), and state its ordering.