Tutorials › Introduction to Statistics › Periodicity and Ordering Pitfalls in Systematic Sampling

Sampling Methods and Bias · Tutorial 35 of 996

Periodicity and Ordering Pitfalls in Systematic Sampling

Learn why a random start does not protect a systematic sample from repeating patterns in the list, and how to diagnose and respond to this risk.

Beginner 9 min read

What You'll Learn

  • Explain how a repeating order can align with a systematic sampling interval.
  • Calculate which phases of a repeating cycle a systematic sample can include.
  • Distinguish equal inclusion chances from protection against periodicity.
  • Diagnose potential distortions in shift schedules and production cycles.
  • Identify practical ways to reduce the risk created by list ordering.

Why the Order of a List Matters

A systematic sample is selected from an ordered list by choosing a random starting position and then taking every \(k\)th unit. The order makes the procedure straightforward and spreads selected positions through the list. But if the list itself has a repeating pattern, the sampling interval can repeatedly land on the same part of that pattern. A random start chooses where the pattern is encountered; it does not necessarily prevent the sample from following the pattern in a misleading way.

This matters when the pattern is related to the variable being measured. A list organized by repeating work shifts, production stages, or delivery routes may place similar units at regular intervals. If the sample repeatedly selects one shift or production stage while missing others, its results can differ substantially from the population, even though every unit has a known chance of selection.

Definition: A periodicity problem occurs when a repeating pattern in an ordered sampling frame aligns with the interval used for systematic sampling, so that selected units overrepresent or omit particular parts of the pattern. The repeating sequence is called a cycle; its period is the number of positions before the sequence repeats.

For clarity, consider the common case where the frame contains \(N\) units, the sample size is \(n\), and \(N=nk\) for an integer interval \(k\). A random start \(R\) is chosen uniformly from positions \(1,\ldots,k\), and the selected positions are \(R, R+k, R+2k,\ldots,R+(n-1)k\). This is the systematic sampling procedure introduced in Systematic Sampling With a Random Start. The concern here is not how to carry out that procedure, but how its interval interacts with the frame's order.

A Random Start Does Not Remove Every Risk

Suppose employees appear in a roster in the repeating order Day, Evening, Night. If the sample interval is a multiple of three, each selected position has the same shift as the starting position. The random start determines which shift is sampled, but all selected employees come from that one shift. If outcomes differ by shift, the sample can miss important differences among employees.

The size of the alignment can be understood by comparing the cycle period \(d\) with the interval \(k\). Moving from one selected position to the next advances \(k\) places through a cycle of \(d\) positions. If \(k\) is divisible by \(d\), the sample remains at one phase of the cycle. If it is not, the sample moves among phases. The number of distinct phases reached before the sequence repeats is \(d/\gcd(d,k)\), where \(\gcd(d,k)\) is the greatest common divisor of the two integers. This count diagnoses alignment; it does not by itself guarantee a representative sample.

Worked Example: A Shift Roster That Repeats Every Three Positions

A hypothetical roster contains 24 employees in the order Day, Evening, Night, repeated eight times. A systematic sample of 4 employees is planned, so \(k=N/n=24/4=6\). Suppose the measured outcome is a score, and the scores are constant within each shift: 10 for Day, 20 for Evening, and 30 for Night. Find the population mean and describe the possible systematic sample means.

Check the alignment. The cycle period is \(d=3\), and the interval is \(k=6\). Since \(6\) is divisible by \(3\), stepping forward six positions returns to the same shift. For example, a start at position 1 selects positions 1, 7, 13, and 19, all Day employees. A start at position 2 selects only Evening employees; a start at position 3 selects only Night employees.

Find the population mean. There are eight employees on each shift, so the population contains eight scores of each value:

$$ \mu=\frac{8(10)+8(20)+8(30)}{24} =\frac{480}{24}=20 $$

Every possible random start from 1 through 6 selects four employees from just one shift. Depending on the start, the sample mean is therefore 10, 20, or 30. The sample can miss the population mean by 10 score points in either direction, despite being selected with a random start.

The start is not biased toward any one shift: two of the six starts select each shift. The problem is that a particular realized sample contains no mix of shifts. Randomization allows different possible samples, but it does not make every possible sample a good miniature of the population.

What Equal Inclusion Chances Do—and Do Not—Guarantee

In the integer-interval setup above, each unit has the same probability of inclusion: \(1/k=n/N\). To see why, note that positions \(1,\ldots,N\) fall into \(k\) groups according to their remainder when divided by \(k\). Each group has \(n\) positions, and exactly one group is selected for each possible random start. A particular position belongs to one such group, so it is included for exactly one of the \(k\) possible starts.

Equal inclusion probabilities are useful, but they do not make all samples equally informative. For the sample mean, the average across all possible random starts equals the population mean in this setup. Let \(I_i\) equal 1 if unit \(i\) is selected and 0 otherwise, and let \(y_i\) be its measured value. Since \(P(I_i=1)=n/N\), the expected sample mean is:

$$ E(\bar{x}_{\text{sys}}) =E\left(\frac{1}{n}\sum_{i=1}^{N} I_i y_i\right) =\frac{1}{n}\sum_{i=1}^{N} E(I_i)y_i =\frac{1}{n}\sum_{i=1}^{N}\frac{n}{N}y_i =\frac{1}{N}\sum_{i=1}^{N}y_i =\mu $$

This derivation establishes that the systematic sample mean is unbiased over the random start, under the stated setup. It does not show that any single sample will be close to \(\mu\). With a periodic frame, the possible sample means may be far apart, as in the shift example. A design can give every unit the same inclusion chance and still be vulnerable to large variation across its possible samples.

Worked Example: A Four-Stage Production Cycle

A hypothetical production line records 24 items in a repeating four-stage order: A, B, C, D, repeated six times. Items from stages A and C are defective, while items from B and D are not. An inspector selects \(n=4\) items systematically with a random start from positions 1 through \(k=24/4=6\). What defect proportions can the sample produce?

Check the phases reached. The cycle period is \(d=4\) and the interval is \(k=6\). Since \(\gcd(4,6)=2\), the sample reaches \(4/2=2\) distinct phases of the cycle. Advancing six positions is the same as advancing two positions modulo four, so a sample starting in phase A alternates A, C, A, C. A start in phase B instead alternates B, D, B, D.

Calculate the population defect proportion. Of the 24 items, 12 occupy stages A or C and are defective:

$$ p=\frac{12}{24}=0.50 $$

Among the six possible starts, starts at positions 1, 3, and 5 select only A and C items, giving \(\hat{p}=4/4=1\). Starts at positions 2, 4, and 6 select only B and D items, giving \(\hat{p}=0/4=0\). Thus the sample defect proportion is either 100% or 0%, although half the population is defective. The example shows why checking only that the start was random is not enough: the interval repeatedly visits just two of the four stages.

Diagnosing the Pattern Before Sampling

A useful check is to ask whether the order of the frame is connected to the variable of interest. The order might be explicitly cyclical, as with a shift schedule or a machine that alternates among production stages. It might also be less obvious: a file may sort records by route, department, location, or time, and those categories may recur at regular intervals. A repeating order is a concern when the cycle's different phases tend to have different values on the outcome being measured.

The arithmetic check is a starting point, not a substitute for understanding the frame. Identify a plausible cycle length \(d\), compare it with the sampling interval \(k\), and determine how many phases are reached. If \(k\) is a multiple of \(d\), the sample stays at one phase. If the sample reaches several phases, ask whether it reaches all of them and whether it includes them in useful proportions. A sample with some representation from each phase may still be unbalanced if the cycle is short relative to the sample or if outcomes vary within phases.

Worked Example: An Interval That Moves Through Every Shift

A different hypothetical employee roster repeats Day, Evening, Night, and contains 30 employees, 10 from each shift. A systematic sample of 6 is planned, giving \(k=30/6=5\). Suppose each shift's measured scores are constant at 12, 18, and 24, respectively. Does the sample necessarily miss shifts as it did in the earlier roster example?

Here \(d=3\) and \(k=5\), so \(\gcd(3,5)=1\). The sample advances by two positions in the three-part cycle each time, because \(5\) has the same remainder as \(2\) when divided by \(3\). Starting from any phase, six selections visit all three phases twice. Thus each sample contains two employees from each shift.

The population mean is:

$$ \mu=\frac{10(12)+10(18)+10(24)}{30} =\frac{540}{30}=18 $$

Every systematic sample under this exact repeating pattern has mean:

$$ \bar{x}=\frac{2(12)+2(18)+2(24)}{6} =\frac{108}{6}=18 $$

In this example, the interval moves through every shift in equal numbers, so the cycle does not distort the sample mean. This conclusion depends on the stated repeating pattern and constant shift scores; it is not a general guarantee that an interval not divisible by the cycle period will produce a representative sample.

Reducing the Risk of Periodicity

When a plausible cycle aligns with the interval, do not rely on the random start alone to solve the problem. First, inspect how the frame was ordered and whether the relevant outcome could vary across cycle phases. Then consider whether a different approach to ordering or sample design is warranted. The appropriate choice depends on the purpose of the study and what is known about the population.

  • Use a randomized order when suitable. Randomly reordering the frame before systematic selection can disrupt a fixed cycle. The resulting sample still depends on the specified design, and the order should not be randomized if doing so would violate a necessary structure or complicate the study.
  • Choose an interval that avoids a known alignment. A different interval may reach more phases of a cycle, but changing the interval does not guarantee balance for every pattern or every outcome. Check the resulting phase sequence rather than assuming a smaller or larger interval is automatically safer.
  • Use a design that deliberately covers important groups. If each shift or production stage must be represented, a design that samples within those groups, such as stratified sampling, can address that requirement more directly than hoping a systematic sample happens to include them.
  • Record the order and the reason for the design choice. Knowing whether a list was sorted, scheduled, or arranged by production sequence makes it easier to assess whether periodicity could affect the findings.

Systematic sampling can still be effective when the frame has no relevant periodic pattern, or when its order helps spread selections across a gradual trend. Ordering is not automatically harmful. The practical question is whether the interval repeatedly selects similar positions in a pattern associated with the variable of interest.

Common Mistake

Wrong reasoning: “The start was random, and each unit had the same chance of selection, so the sample cannot be distorted by the order.”

Correction: A random start determines which systematic sequence is selected; it does not guarantee that any one sequence represents the whole population. Equal inclusion chances describe how often individual units appear across the possible starts, not how well a particular sample covers the phases of a cycle. Check the frame's order and the interval together, especially when shifts, stages, routes, or other repeating patterns may be related to the outcome.

Key takeaway: Before using a systematic sample, look for repeating structure in the ordered frame. Compare the cycle period with the sampling interval, determine which phases the sample can reach, and do not confuse equal inclusion chances with guaranteed representation in a realized sample.

Check Your Understanding

Use the relationship between the list's order, its cycle, and the sampling interval to answer these questions.

  1. A list repeats four job roles, and the systematic interval is 8. How many distinct phases of the cycle does the sample reach? What does that imply about the roles represented?
  2. Why does a random start not guarantee that a systematic sample includes every shift in a roster?
  3. In the production example, why could the sample defect proportion be 0 or 1 even though the population proportion was 0.50?
  4. What does equal inclusion probability establish in the integer-interval setup, and what does it not establish about a particular sample?
  5. Name one practical way to reduce the risk of a periodicity problem, and state a limitation or condition to consider when using it.