Why Rare and Missing Responses Need Care
A categorical display can be mathematically correct yet still give readers the wrong impression. A tiny bar might represent a genuinely uncommon answer, or it might represent a handful of responses grouped together. A blank answer is different again: it does not tell us which category a person chose. Displaying all three situations with no explanation can hide useful detail or make missing data look like a substantive response.
The aim is not to make every graph equally simple or equally detailed. It is to make clear which answers were recorded, what any combined group contains, and how many eligible observations are represented. A category should not disappear merely because its count is small, and a missing response should not be presented as though it were an answer to the survey question.
Deciding Whether to Combine Rare Categories
There is no universal count or percentage below which a category must be combined. The decision depends on the purpose of the display and whether readers need to see that category on its own. If a small group is important to the question, meaningful to the audience, or substantively different from other groups, retain it as a separate category and label it clearly. If a display would be difficult to read with many very small categories, combining some responses may be reasonable, provided the combination is transparent and does not blur distinctions that matter.
A sound “Other” group follows several practical rules:
- Combine valid response categories, not blanks, nonresponses, or responses that were not applicable.
- Choose the categories to combine for a stated reason, rather than concealing an inconvenient result.
- Use a label such as “Other (scooter or skateboard)” when space permits, or state the component categories in a note or accompanying table.
- Keep the original category counts available. If the components could matter to interpretation, report them even when the display groups them.
- Use the same grouping rule when making comparisons, so a change in the displayed categories does not create a misleading comparison.
“Other” should not be a label for an unexplained collection. When categories are combined, the reader should be able to tell what was combined and how the total was formed. A category with a small count can still be important; grouping it is a display choice, not evidence that the responses are unimportant.
Worked Example: Combining Two Uncommon Transportation Responses
In a hypothetical survey, 120 students report their usual way of getting to campus. The counts are: bus, 31; walking, 38; bicycle, 42; scooter, 5; skateboard, 4. A compact display is desired, but readers should still be able to tell which less common responses were grouped.
First check the total: \(31+38+42+5+4=120\). If scooter and skateboard are grouped, the combined count is \(5+4=9\). As a percentage of all 120 valid answers, that group represents
The display could show bus, walking, bicycle, and “Other (scooter or skateboard).” Its displayed counts would be 31, 38, 42, and 9, which still add to 120. The combined label is explicit, and the original counts remain available: scooter, 5; skateboard, 4.
This grouping is a defensible choice if the goal is a shorter display and the separate scooter and skateboard counts are not central to the question. If either response is important on its own, show it separately instead. The small count alone does not settle the decision.
Missing Is Not a Substantive Answer
A person who leaves a question blank has not supplied a category for that question. Similarly, a response recorded as unknown or not applicable does not necessarily identify a substantive answer. These cases should be distinguished from valid answers such as “none” or “prefer not to say.” “None” answers the question when it is an available option. “Prefer not to say” is an explicit response about answering; it is not the same as a blank, though it is not a substantive choice among the question’s answer categories.
For a display of the distribution of answers, calculate percentages among the valid responses to that question. Report how many responses were missing or declined separately, so readers can see how many people did not contribute a substantive answer. If the purpose is to describe response completion, show these counts in a separate note or response-status display. If a graph places a “No response” bar beside answer categories, make its separate status unmistakable; do not let it appear to be another substantive answer.
Worked Example: Reporting Blank and Declined Responses
In a hypothetical survey of 150 eligible students, 74 select “morning,” 58 select “afternoon,” 12 leave the question blank, and 6 select “prefer not to answer.” The counts sum to \(74+58+12+6=150\). The first two categories are substantive answers; the blank and the explicit decline should be reported as separate response statuses.
There are \(74+58=132\) valid answers to the morning-or-afternoon question. The percentage selecting “morning” among valid answers is
The percentage selecting “afternoon” among valid answers is
These percentages sum to 100% apart from rounding, because the denominator includes exactly the two valid answer categories. A suitable display is titled “Time preference among 132 students who gave a valid answer.” A note can say that 12 students left the item blank and 6 preferred not to answer. The title and note make both the denominator and the response statuses visible.
If the question instead is what fraction of all 150 eligible students selected “morning,” the calculation is \(74/150\times100\%=49.3\%\). This is a different quantity: it describes the recorded morning selections as a fraction of all eligible students, not the distribution among valid answers. Neither denominator is automatically correct for every purpose; the display must identify which one it uses.
Why Percentages Among Valid Answers Sum to 100%
The denominator rule can be seen directly from the arithmetic. Suppose a question has \(k\) valid response categories, with counts \(c_1,c_2,\ldots,c_k\), and let \(V\) be the number of valid answers. By definition, \(V=c_1+c_2+\cdots+c_k\). The valid-answer percentage for category \(i\) is \(100c_i/V\). Adding the percentages gives
The result holds because the valid categories account for all \(V\) valid answers. If the denominator is instead the total number of eligible people, the displayed substantive-answer percentages generally sum to less than 100% when some people did not provide a valid answer. That shortfall reflects unanswered or unusable items; it should not be silently redistributed across the substantive categories.
Worked Example: Making an “Other” Group Auditable
A hypothetical campus survey asks 240 respondents which student group they attend most often. The recorded counts are: programming, 84; environmental, 63; sports, 52; arts, 23; debate, 11; language, 7. The counts total \(84+63+52+23+11+7=240\). Suppose the display needs fewer bars, and debate and language are grouped as “Other.”
The count in “Other” is \(11+7=18\), and its percentage among the 240 valid responses is
For comparison, the programming category represents
The grouped counts are 84, 63, 52, 23, and 18; they still sum to 240. The graph should label the final bar “Other (debate 11; language 7)” or use a note that gives those two component counts. If debate or language has particular importance to the survey, keeping those categories separate is better than grouping them for convenience. In either case, retaining the component counts prevents the combined bar from hiding what it represents.
The display should also say that it summarizes the 240 valid answers. If some eligible respondents did not answer the question, their status and count should be reported separately, not added to “Other.”
Common Mistakes and Better Practice
- Wrong: “The blank answers are just another category, so I included them in the preference chart.” Correction: A blank does not state a preference. Show it as a response-status count or note, and make clear whether percentages use valid answers or all eligible people.
- Wrong: “Every category under five responses must go into Other.” Correction: There is no universal cutoff. Consider the purpose of the display and whether a rare response is meaningful enough to show separately.
- Wrong: “The Other bar is small, so the reader does not need to know its contents.” Correction: Give the component categories and, when useful, their individual counts. A combined label should explain the combination.
- Wrong: “I can put ‘prefer not to answer’ and a blank together without explanation.” Correction: An explicit decline and an unanswered item are different response statuses. Keep them distinct when that difference is relevant, and do not treat either as a substantive choice unless the question specifically concerns response status.
- Wrong: “The percentages do not add to 100%, so I should adjust the categories.” Correction: First check the denominator. Percentages among valid answers sum to 100% (apart from rounding); percentages of all eligible people may not when some answers are missing.
A careful display helps readers see both the pattern of answers and the limits of the recorded data. Keep important rare categories visible, make every “Other” group traceable to its component responses, and report missingness without implying that it represents an answer. Always state the population counted in the denominator.
Check Your Understanding
For each question, consider what the display should show and how the denominator should be described.
- A valid-answer category has only three responses, but it is central to the survey question. Should it automatically be combined with other categories? Explain.
- A survey records 40 “Yes” answers, 30 “No” answers, and 10 blank items. What is the percentage of “Yes” among valid answers, and what denominator would you use?
- Why is it usually misleading to combine blank responses with an “Other” group of valid answers?
- A graph combines two small categories. What information should accompany the “Other” label so the grouping is transparent?
- In what situation might it be useful to show “No response” in a display, and how should it be distinguished from substantive answer categories?