An official website of the United States government

The .gov means it's official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Standard Errors

Measures of Reliability: Standard Errors

To assist users in ascertaining the reliability of Occupational Requirements Survey estimates, BLS provides standard errors with each publication.Standard errors provide a measure of the precision of an estimate to ensure that it is within an acceptable range for its intended purpose. Standard errors are available through the public database and can be accessed using the data retrieval tools or in XLSX format with the complete datasets.

Sources of Error

Occupational Requirements Survey estimates are derived from a sample survey and thus are subject to sampling errors. Standard errors relate to differences that occur from sampling errors, but not from nonsampling errors.

Sampling errors are differences between the results computed from a sample of observations and those computed from all observations in the population. In the case of the Occupational Requirements Survey, the population of an estimate is an occupation in the civilian sector. Estimates derived from different samples selected using the same sample design may differ from each other.

Nonsampling errors are not measured. One type of nonsampling error is survey nonresponse, when survey respondents are unwilling or unable to participate in the survey. Other nonsampling errors include inaccurate or incorrectly entered data, and processing errors. BLS quality assurance programs contain procedures for reducing nonsampling errors. These procedures include data collection reinterviews, observed interviews, and systematic reviews of collected data. Finally, field economists (data collectors) undergo extensive training to maintain high data collection standards.

Using Standard Errors

Standard errors can be used to measure the precision with which an estimate from a particular sample approximates the expected result (value) of all possible samples (population). The chances are about 68 out of 100 that an estimate from the survey differs from a population result within one standard error.

Standard errors can be used to calculate confidence intervals around an estimate. With a 90 percent confidence interval, the chances are about 90 out of 100 that this difference would be within 1.645 standard errors. If all possible samples were selected and an estimate of a value and its sampling error were computed for each, then (for approximately 90 percent of the samples) the intervals from 1.645 standard errors below the estimate to 1.645 standard errors above the estimate would include the "true" average value.

Example 1: Constructing confidence intervals

Evaluate the statement: “The ability to pause work was present for 53.5 percent of workers in 2025, with a standard error of 0.9 percent.”

Confidence interval = estimate +/- (standard error * critical value)

90% confidence interval = estimate +/- (standard error * 1.645)

= 53.5+/- (0.9 * 1.645)

= 53.5 +/- 1.4805

≈ [52, 55]

If all possible samples were drawn from the target population, and each time a new estimate and confidence interval were calculated, then 90 percent of those confidence intervals would contain the true population value. Therefore, we are 90 percent confident that the interval [52%, 55%] will contain all possible sample means with ORS sample design.

If you wish to calculate a 95 percent confidence interval, replace the critical value of 1.645 with 1.960. For a 99 percent confidence interval, use 2.576 as the critical value.

Comparative statements appearing in Occupational Requirements Survey publications are statistically significant at the 90 percent level of confidence, unless otherwise indicated. A statistically significant difference is a result that is not attributed to chance alone. Differences between estimates which may appear to be substantial at first glance may not be statistically significant.

Example 2: Comparing estimates through statistical significance tests

Evaluate the statement: “In 2025, bartenders were required to stand for a greater percentage of the day than software developers.”

Step 1. Calculate a statistical significance test statistic

Bartenders: 98.3 percent of the workday with 0.7 standard error

Software developers: 2.9 percent of the workday with 1.3 standard error

$T e s t S t a t i s t i c = \frac{| f i r s t e s t i m a t e - s e c o n d e s t i m a t e |}{\sqrt{{f i r s t s t a n d a r d e r r o r}^{2} + {s e c o n d s t a n d a r d e r r o r}^{2}}}$

$T e s t S t a t i s t i c = \frac{|98.3 - 2.9|}{\sqrt{{0.7}^{2} + {1.3}^{2}}}$

$T e s t S t a t i s t i c = \frac{95.4}{1.476}$

Test Statistic = 64.634

Step 2. Compare against the critical value

A difference is statistically significant if the test statistic is greater than the critical value.

64.634>1.645

The test statistic (64.634) is greater than the critical value (1.645). Therefore, the difference between the estimates is statistically significant. That is, the comparative statement that in 2025, bartenders were required to stand for a greater percentage of the day than software developers passes the statistical significance test.

Note: examples are for illustrative purposes only and are not intended to represent current data.

More Information

For a more detailed explanation of standard errors, including how they are calculated, see the section Reliability of ORS estimates in the Handbook of Methods: Calculation.