Department of Labor Logo United States Department of Labor
Dot gov

The .gov means it's official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Bureau of Labor Statistics > Office of Survey Methods and Research > Publications > Browse Research Papers

Evaluating Numeric Rating Scales: Replicated Results

Roberta L. Sangster and Fern Willits

Abstract

The use of numeric rating scales is very common in survey research. However, studies have found that responses vary by changing numeric scale labels from all positive integers (0 to 10, continuum scale) to include negative and positive integers (-5 to +5, bipolar scale) (Schwarz et al., 1991). The intent of this research is to generalize Schwarz et al's finding across different questions and samples using replicated experiments. The data comes from 8 mail or self-administered surveys that together contain 31 experiments. In general, people are less likely to choose zero or negative integers from a bipolar scale than equidistant integers on a continuum scale. The consistency of the pattern is remarkable across the mail and self-administered surveys. The reluctance to select negative integers can mean that part of a bipolar scale will be virtually unused. In such cases, the spread of the scale values is attenuated, leading to a relatively high mean score and a reduced variance. However, this disappears for less skewed data. We suggest several ideas for designing and using continuum and bipolar measures based on these results.