
An official website of the United States government
Authors: Grayson Armstrong, Gray Jones, Tucker Miller, and Laura Petit
This paper was published as part of the Consumer Expenditure Surveys Program Report Series.
Overview
Highlights
1. Final disposition rates of eligible sample units (Diary and Interview Surveys)
2. Records Use (Interview Survey)
3. Information Booklet use (Diary and Interview Surveys)
4. Expenditure edit rates (Diary and Interview Surveys)
5. Income imputation rates (Diary and Interview Surveys)
6. Respondent burden (Interview Survey)
7. Survey mode (Diary and Interview Surveys)
8. Survey Response Time (Diary and Interview Surveys)
Summary
References
The Bureau of Labor Statistics (BLS) is committed to producing consistently high quality data (i.e., accurate, objective, relevant, timely, and accessible) in accordance with Statistical Policy Directive No. 1.[1] This Directive, issued by the Office of Management and Budget, affirms the fundamental responsibilities of Federal Statistical Agencies, and recognized statistical units in the design, collection, processing, editing, compilation, storage, analysis, release, and dissemination of statistical information. The BLS Consumer Expenditure Surveys (CE) program provides data users with a variety of resources to assist them in analyzing overall CE data quality. CE data users can evaluate quality on their own by utilizing the following:
In addition, the Data Quality Profile (DQP) provides a comprehensive set of quality metrics such as records use and expenditure edit rates that are timely, routinely updated, and accessible to users. For data users, DQP metrics are an indication of quality for both the Interview Survey and the Diary Survey.[4] For internal stakeholders, these metrics signal areas for improvements to the surveys.
This DQP includes, for each metric, a brief description of the metric, along with accompanying results, which are tabulated and graphed. The DQP Reference Guide gives detailed descriptions of the metrics, computations, and methodology, along with summaries of events that have impacted data collection (Armstrong, Jones, Miller, and Petit, 2024). The intention of the DQP report series is to highlight recent trends in the aforementioned metrics that may impact CE data quality, and for this purpose, the analysis within the DQP reports cover the three most recent years of available data. The BLS does, however, provide the data series associated with each metric chart in tabular form, going back as far as 2016. To access this tabular data, simply select the "Show chart data" option that is beneath each chart in the report below.
Prior DQPs are available on the CE Library Page. BLS began publishing annual DQPs beginning with 2017 data, though prototype DQPs are available for 2013 and 2015. Midyear DQPs started with the 2020 midyear data release, which covered the period of July 2019 through June 2020.
The data quality metrics are reported in a quarterly format, where the quarter represents the three-month period in which the survey data were collected. Because Interview Survey respondents are asked to recall expenditures from the prior three months, the data collected in the first quarter of 2024 include expenditures made in the fourth quarter of 2023. For example, an interview conducted in January 2024 would include expenditures from October, November, and December of 2023. In contrast, respondents to the Diary Survey report expenditures on the days that they were incurred in two consecutive one-week diary keeping periods. This is why this report’s Interview Survey metrics appear to be “ahead” of the Diary Survey by a quarter (e.g., the first quarter of 2024 for the Interview Survey and the fourth quarter of 2023 for the Diary Survey).
This section highlights noteworthy metric trends from the past three years. This time frame covers the first quarter of 2021 through the fourth quarter of 2023 for the CE Diary survey, and the second quarter of 2021 through the first quarter of 2024 for the CE Interview survey. Subsequent sections will describe all the individual metrics with detailed data tables.
Recent Trends of Note
Diary Survey response rates fell back below 40.0 percent (38.2 percent) in the fourth quarter of 2023, which is consistent with fourth quarter response rates for 2021 and 2022 (See Chart 1.1).
Interview Survey other nonresponse rates rose sharply in the two most recent quarters of data from 1.7 percent in the third quarter of 2023 to 13.2 percent in the fourth quarter of 2023 and again to 15.1 percent in the first quarter of 2024. This jump was expected and can be attributed to cost-cutting measures implemented by BLS beginning in the fourth quarter of 2023.[5] These measures removed Wave 4 Interview cases in which all previous waves resulted in Type-A nonresponses from the caseload of Census Field Representatives (FRs), with the goal of reducing costs by discontinuing collection attempts for unproductive cases (See Chart 1.2).[6]
Interview Survey refusal rates experienced major declines in recent quarters, falling from 39.7 percent in the third quarter of 2023 to 31.2 percent in the fourth quarter of 2023, then declined again to 30.4 in the first quarter of 2024. This decline corresponds with the rise in nonresponse rates, which was the result of the previously described cost-cutting measures (See Chart 1.2).
Allocation rates in the Diary Survey have continued to fall, dropping from 7.3 percent in the second quarter of 2023 to 6.9 percent in the fourth quarter of 2023, and once more to 6.2 percent in the first quarter of 2024. This recent fall in diary allocation is explained by the consolidation of many Universal Classification Codes (UCCs) at the beginning of 2023 (See Chart 4.1).
Rates of complete online expenditure diaries increased from 26.3 percent in the second quarter of 2023 to 29.1 percent in the fourth quarter of 2023 (See Chart 7.2).
Final disposition rates of eligible sample units represent the final participation outcomes of field staff's survey recruitment efforts. The BLS classifies the "final outcome" of eligible sample units into the following four main categories:
More information on nonresponse reclassification edits, other nonresponse categories, and how BLS staff calculate response rates can be found in the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024).
The primary interest in response rates is their relationship with nonresponse bias. That is, low response rates can indicate the potential for nonresponse bias in expenditure estimates if the cause of nonresponse is correlated with that expenditure category. While recent research on nonresponse bias for both the CE Interview Survey and the CE Diary Survey have not shown bias in the CE survey estimates during the COVID-19 pandemic (Ash, Nix, and Steinberg, 2022), BLS continues to monitor this risk.
Response rates in this report are presented as unweighted estimates. This is because weights are used to estimate results from the population, and the goal of this analysis is to measure the effectiveness of our actual data collection efforts rather than make inferences about the wider public.
Diary Survey Summary
Response rates fluctuated between 37.0 percent and 43.9 percent from the first quarter of 2021 to the fourth quarter of 2023 (See Chart 1.1).
Refusal rates fluctuated but continued their upward trend, increasing by 4.0 percentage points from the first quarter of 2021 (34.4 percent) to the fourth quarter of 2023 (38.4 percent) (See Chart 1.1).
Noncontact rates hovered between 7.6 percent and 12.1 percent since the first quarter of 2021 but have increased every quarter after the first quarter of 2023 (See Chart 1.1).
Overall, other nonresponse rates have declined from the first quarter of 2021 (18.6 percent) to the fourth quarter of 2023 (12.1 percent). However, due to cost containment measures implemented in the fourth quarter of 2023, the other nonresponse rate increased by 3.6 percent from the third quarter of 2023 (8.5 percent) to the fourth quarter of 2023 (12.1 percent), the largest increase observed over the past 3 years. [7]
Quarter | Number of eligible sample units | Interview | Refusal | Noncontact | Other nonresponse |
---|---|---|---|---|---|
Q1 2016 |
5,050 | 58.4 | 16.8 | 5.8 | 18.9 |
Q2 2016 |
5,108 | 57.6 | 16.7 | 6.0 | 19.8 |
Q3 2016 |
5,076 | 57.9 | 17.9 | 4.9 | 19.3 |
Q4 2016 |
5,157 | 52.7 | 18.3 | 6.1 | 22.9 |
Q1 2017 |
4,972 | 57.1 | 24.8 | 6.0 | 12.0 |
Q2 2017 |
5,054 | 59.4 | 23.3 | 5.5 | 11.8 |
Q3 2017 |
4,916 | 59.1 | 23.3 | 5.1 | 12.5 |
Q4 2017 |
5,168 | 56.3 | 25.3 | 6.8 | 11.6 |
Q1 2018 |
5,032 | 55.5 | 25.0 | 6.9 | 12.7 |
Q2 2018 |
5,015 | 55.5 | 25.9 | 6.4 | 12.2 |
Q3 2018 |
5,014 | 57.8 | 24.8 | 6.2 | 11.2 |
Q4 2018 |
5,072 | 51.5 | 27.9 | 7.3 | 13.3 |
Q1 2019 |
4,926 | 54.2 | 28.5 | 4.9 | 12.4 |
Q2 2019 |
5,082 | 53.4 | 27.2 | 6.1 | 13.2 |
Q3 2019 |
5,020 | 54.7 | 25.8 | 6.1 | 13.4 |
Q4 2019 |
5,216 | 48.9 | 29.9 | 7.6 | 13.5 |
Q1 2020 |
7,474 | 44.0 | 22.5 | 7.3 | 26.3 |
Q2 2020 |
7,409 | 26.1 | 12.1 | 2.7 | 59.1 |
Q3 2020 |
7,784 | 32.9 | 22.2 | 7.2 | 37.7 |
Q4 2020 |
7,774 | 36.5 | 34.7 | 10.1 | 18.8 |
Q1 2021 |
7,488 | 39.4 | 34.4 | 7.6 | 18.6 |
Q2 2021 |
7,584 | 42.5 | 34.9 | 8.8 | 13.8 |
Q3 2021 |
7,456 | 40.7 | 37.0 | 11.1 | 11.2 |
Q4 2021 |
7,676 | 37.3 | 39.0 | 11.9 | 11.8 |
Q1 2022 |
7,645 | 43.9 | 36.3 | 9.5 | 10.3 |
Q2 2022 |
7,556 | 42.9 | 36.9 | 9.8 | 10.4 |
Q3 2022 |
7,594 | 42.8 | 36.9 | 9.7 | 10.7 |
Q4 2022 |
7,749 | 37.0 | 39.8 | 12.1 | 11.1 |
Q1 2023 |
7,610 | 41.6 | 39.2 | 10.1 | 9.1 |
Q2 2023 |
7,695 | 40.2 | 39.7 | 10.3 | 9.9 |
Q3 2023 |
7,570 | 40.5 | 40.5 | 10.4 | 8.5 |
Q4 2023 |
8,032 | 38.2 | 38.4 | 11.2 | 12.1 |
Interview Survey Summary
Response rates were 5.8 percent lower in the first quarter of 2024 (40.9 percent) than what was observed in the second quarter of 2021 (46.7 percent) (See Chart 1.2).
Other nonresponse rates were impacted by the implementation of cost containment measures that took effect during the three-year period.[8]
The temporary cost containment measures implemented in the third quarter of 2022 resulted in a 17.0 percent increase in the other nonresponse rate from the previous quarter.
The indefinite cost containment measures implemented in the fourth quarter of 2023 resulted in a 13.4 percent increase in the other nonresponse rate from the third quarter of 2023 (1.7 percent) to the first quarter of 2024 (15.1 percent) (See Chart 1.2).
Noncontact rates stayed below 10 percent before sharply increasing in the third quarter of 2022 (16.4 percent). After reaching a series high of 20.1 percent in the fourth quarter of 2022, noncontact rates have declined to 13.6 percent in the first quarter of 2024 (See Chart 1.2).
Refusal rates varied considerably between the second quarter of 2021 and the first quarter of 2024. After reaching a series high of 44.3 percent in the fourth quarter of 2021, refusal rates fluctuated between 43.5 percent (the second quarter of 2022) and 23.8 percent (the third quarter 2022). As expected, major declines in the refusal rate correspond with the implementation of cost-cutting measures over the three-year period (See Chart 1.2).
Quarter | Number of eligible sample units | Interview | Refusal | Noncontact | Other nonresponse |
---|---|---|---|---|---|
Q1 2016 |
10,123 | 63.5 | 25.7 | 6.6 | 4.2 |
Q2 2016 |
10,101 | 62.8 | 25.7 | 7.2 | 4.4 |
Q3 2016 |
10,037 | 63.5 | 25.5 | 6.0 | 5.0 |
Q4 2016 |
10,114 | 62.3 | 26.5 | 6.1 | 5.1 |
Q1 2017 |
10,113 | 61.4 | 28.7 | 5.3 | 4.6 |
Q2 2017 |
9,988 | 61.8 | 28.0 | 5.5 | 4.6 |
Q3 2017 |
9,954 | 61.2 | 28.9 | 5.1 | 4.9 |
Q4 2017 |
10,138 | 59.2 | 30.7 | 5.7 | 4.4 |
Q1 2018 |
10,077 | 58.7 | 31.1 | 5.7 | 4.5 |
Q2 2018 |
10,075 | 58.6 | 31.1 | 5.5 | 4.8 |
Q3 2018 |
10,053 | 57.4 | 32.6 | 5.5 | 4.5 |
Q4 2018 |
10,161 | 54.8 | 34.7 | 5.5 | 5.0 |
Q1 2019 |
10,108 | 55.6 | 34.3 | 4.8 | 5.2 |
Q2 2019 |
10,075 | 54.5 | 35.5 | 5.0 | 5.0 |
Q3 2019 |
10,036 | 53.2 | 36.5 | 5.6 | 4.8 |
Q4 2019 |
10,170 | 51.6 | 36.8 | 6.1 | 5.5 |
Q1 2020 |
9,956 | 52.2 | 33.8 | 4.7 | 9.3 |
Q2 2020 |
10,581 | 45.9 | 15.4 | 0.8 | 37.9 |
Q3 2020 |
11,190 | 44.5 | 24.2 | 3.9 | 27.4 |
Q4 2020 |
11,185 | 46.5 | 36.8 | 6.3 | 10.4 |
Q1 2021 |
11,125 | 46.0 | 38.9 | 6.8 | 8.3 |
Q2 2021 |
11,120 | 46.7 | 41.1 | 9.5 | 2.7 |
Q3 2021 |
11,117 | 46.1 | 43.0 | 8.4 | 2.5 |
Q4 2021 |
11,275 | 43.5 | 44.3 | 9.9 | 2.3 |
Q1 2022 |
11,320 | 45.8 | 42.8 | 9.3 | 2.1 |
Q2 2022 |
11,202 | 46.2 | 43.5 | 8.3 | 2.0 |
Q3 2022 |
11,235 | 40.8 | 23.8 | 16.4 | 19.0 |
Q4 2022 |
11,248 | 41.0 | 33.9 | 23.0 | 2.0 |
Q1 2023 |
11,299 | 42.5 | 36.5 | 20.1 | 0.9 |
Q2 2023 |
11,308 | 42.0 | 38.0 | 18.9 | 1.1 |
Q3 2023 |
11,383 | 41.9 | 39.7 | 16.8 | 1.7 |
Q4 2023 |
11,515 | 40.5 | 31.2 | 15.1 | 13.2 |
Q1 2024 |
11,453 | 40.9 | 30.4 | 13.6 | 15.1 |
The Records Use metric measures the proportion of respondents who refer to records while answering the Interview Survey questions, as reported by Census Field Representatives (FRs). Examples of records include, but are not limited to: receipts, bills, checkbooks, and bank statements. Records use is retrospectively recorded by the interviewer at the end of the interview. Past research has shown that respondents who use expenditure records report more expenditures with lower rates of missing data (Abdirizak, Erhard, Lee, and McBride, 2017), so a higher prevalence of records use is desirable. Metrics in this section are presented by survey wave.[9] More information on the Records Use metric can be found in the DQP Reference Guide (Armstrong, Jones, Miller, and Pham, 2024).
Interview Survey Summary
Records use have experienced a general upward trend across all waves since the third quarter of 2021 (See Chart 2.1).
Wave 1 records use reached a three-year high of 62.6 percent in the first quarter of 2024 (See Chart 2.1).
In the first quarter of 2024, records use in Waves 2 & 3 and Wave 4 interviews reached series highs of 60.5 percent and 63.1 percent, respectively (See Chart 2.1).
Quarter | Wave | Number of respondents | Used | Did not use | Missing response |
---|---|---|---|---|---|
Q1 2016 |
Wave 1 | 1,631 | 43.0 | 55.9 | 1.1 |
Q1 2016 |
Waves 2 & 3 | 3,172 | 41.7 | 57.8 | 0.5 |
Q1 2016 |
Wave 4 | 1,623 | 42.0 | 57.2 | 0.9 |
Q2 2016 |
Wave 1 | 1,633 | 42.3 | 56.1 | 1.6 |
Q2 2016 |
Waves 2 & 3 | 3,102 | 40.3 | 59.2 | 0.5 |
Q2 2016 |
Wave 4 | 1,607 | 41.8 | 57.6 | 0.7 |
Q3 2016 |
Wave 1 | 1,688 | 69.9 | 29.6 | 0.5 |
Q3 2016 |
Waves 2 & 3 | 3,087 | 49.0 | 50.5 | 0.5 |
Q3 2016 |
Wave 4 | 1,597 | 50.8 | 48.6 | 0.6 |
Q4 2016 |
Wave 1 | 1,660 | 70.3 | 29.0 | 0.7 |
Q4 2016 |
Waves 2 & 3 | 3,108 | 53.8 | 45.8 | 0.5 |
Q4 2016 |
Wave 4 | 1,533 | 49.2 | 49.5 | 1.2 |
Q1 2017 |
Wave 1 | 1,557 | 51.3 | 47.4 | 1.3 |
Q1 2017 |
Waves 2 & 3 | 3,078 | 55.1 | 44.3 | 0.6 |
Q1 2017 |
Wave 4 | 1,573 | 50.3 | 49.0 | 0.7 |
Q2 2017 |
Wave 1 | 1,573 | 52.7 | 46.5 | 0.8 |
Q2 2017 |
Waves 2 & 3 | 3,003 | 50.9 | 48.6 | 0.5 |
Q2 2017 |
Wave 4 | 1,601 | 56.2 | 43.3 | 0.5 |
Q3 2017 |
Wave 1 | 1,581 | 49.1 | 50.1 | 0.8 |
Q3 2017 |
Waves 2 & 3 | 2,933 | 45.8 | 53.6 | 0.6 |
Q3 2017 |
Wave 4 | 1,576 | 53.2 | 46.0 | 0.8 |
Q4 2017 |
Wave 1 | 1,592 | 48.2 | 50.5 | 1.3 |
Q4 2017 |
Waves 2 & 3 | 2,935 | 49.2 | 50.3 | 0.5 |
Q4 2017 |
Wave 4 | 1,477 | 49.2 | 50.1 | 0.7 |
Q1 2018 |
Wave 1 | 1,501 | 53.7 | 45.2 | 1.1 |
Q1 2018 |
Waves 2 & 3 | 2,951 | 49.5 | 50.0 | 0.5 |
Q1 2018 |
Wave 4 | 1,464 | 52.7 | 46.4 | 0.9 |
Q2 2018 |
Wave 1 | 1,529 | 50.2 | 48.7 | 1.1 |
Q2 2018 |
Waves 2 & 3 | 2,884 | 47.4 | 52.0 | 0.6 |
Q2 2018 |
Wave 4 | 1,486 | 50.1 | 49.4 | 0.5 |
Q3 2018 |
Wave 1 | 1,494 | 50.3 | 48.9 | 0.9 |
Q3 2018 |
Waves 2 & 3 | 2,815 | 48.8 | 50.9 | 0.4 |
Q3 2018 |
Wave 4 | 1,464 | 48.9 | 50.2 | 0.9 |
Q4 2018 |
Wave 1 | 1,399 | 53.3 | 45.7 | 0.9 |
Q4 2018 |
Waves 2 & 3 | 2,782 | 48.7 | 50.8 | 0.4 |
Q4 2018 |
Wave 4 | 1,390 | 51.5 | 47.4 | 1.1 |
Q1 2019 |
Wave 1 | 1,465 | 55.2 | 43.8 | 1.0 |
Q1 2019 |
Waves 2 & 3 | 2,730 | 51.1 | 48.4 | 0.5 |
Q1 2019 |
Wave 4 | 1,428 | 52.7 | 46.9 | 0.4 |
Q2 2019 |
Wave 1 | 1,443 | 51.6 | 47.6 | 0.8 |
Q2 2019 |
Waves 2 & 3 | 2,653 | 51.7 | 47.9 | 0.4 |
Q2 2019 |
Wave 4 | 1,397 | 53.6 | 45.5 | 0.9 |
Q3 2019 |
Wave 1 | 1,401 | 50.1 | 48.7 | 1.2 |
Q3 2019 |
Waves 2 & 3 | 2,651 | 49.0 | 50.2 | 0.8 |
Q3 2019 |
Wave 4 | 1,285 | 51.3 | 48.1 | 0.6 |
Q4 2019 |
Wave 1 | 1,318 | 53.0 | 46.2 | 0.8 |
Q4 2019 |
Waves 2 & 3 | 2,637 | 48.8 | 51.0 | 0.2 |
Q4 2019 |
Wave 4 | 1,293 | 53.1 | 46.3 | 0.5 |
Q1 2020 |
Wave 1 | 1,239 | 53.6 | 45.2 | 1.2 |
Q1 2020 |
Waves 2 & 3 | 2,601 | 50.7 | 48.9 | 0.4 |
Q1 2020 |
Wave 4 | 1,362 | 53.4 | 46.2 | 0.4 |
Q2 2020 |
Wave 1 | 965 | 51.9 | 47.3 | 0.8 |
Q2 2020 |
Waves 2 & 3 | 2,559 | 50.0 | 49.7 | 0.3 |
Q2 2020 |
Wave 4 | 1,334 | 52.4 | 47.1 | 0.5 |
Q3 2020 |
Wave 1 | 1,143 | 49.3 | 49.3 | 1.4 |
Q3 2020 |
Waves 2 & 3 | 2,444 | 49.4 | 50.3 | 0.3 |
Q3 2020 |
Wave 4 | 1,393 | 51.0 | 48.7 | 0.4 |
Q4 2020 |
Wave 1 | 1,230 | 50.1 | 49.6 | 0.3 |
Q4 2020 |
Waves 2 & 3 | 2,589 | 50.1 | 49.3 | 0.5 |
Q4 2020 |
Wave 4 | 1,386 | 51.9 | 47.8 | 0.2 |
Q1 2021 |
Wave 1 | 1,250 | 52.0 | 47.4 | 0.6 |
Q1 2021 |
Waves 2 & 3 | 2,515 | 50.3 | 49.4 | 0.4 |
Q1 2021 |
Wave 4 | 1,350 | 52.4 | 47.0 | 0.7 |
Q2 2021 |
Wave 1 | 1,325 | 49.8 | 49.6 | 0.6 |
Q2 2021 |
Waves 2 & 3 | 2,534 | 47.8 | 51.4 | 0.7 |
Q2 2021 |
Wave 4 | 1,337 | 50.5 | 48.9 | 0.6 |
Q3 2021 |
Wave 1 | 1,352 | 53.0 | 46.1 | 1.0 |
Q3 2021 |
Waves 2 & 3 | 2,488 | 48.6 | 50.6 | 0.8 |
Q3 2021 |
Wave 4 | 1,281 | 49.6 | 49.6 | 0.8 |
Q4 2021 |
Wave 1 | 1,229 | 54.8 | 44.4 | 0.8 |
Q4 2021 |
Waves 2 & 3 | 2,450 | 53.2 | 46.4 | 0.4 |
Q4 2021 |
Wave 4 | 1,223 | 54.0 | 45.3 | 0.7 |
Q1 2022 |
Wave 1 | 1,347 | 60.3 | 39.2 | 0.5 |
Q1 2022 |
Waves 2 & 3 | 2,551 | 53.9 | 45.7 | 0.4 |
Q1 2022 |
Wave 4 | 1,289 | 56.7 | 42.7 | 0.5 |
Q2 2022 |
Wave 1 | 1,325 | 55.4 | 43.5 | 1.1 |
Q2 2022 |
Waves 2 & 3 | 2,532 | 52.6 | 46.6 | 0.8 |
Q2 2022 |
Wave 4 | 1,320 | 54.4 | 45.1 | 0.5 |
Q3 2022 |
Wave 1 | 1,277 | 57.6 | 40.3 | 2.1 |
Q3 2022 |
Waves 2 & 3 | 2,153 | 55.7 | 43.1 | 1.1 |
Q3 2022 |
Wave 4 | 1,150 | 57.0 | 42.0 | 1.0 |
Q4 2022 |
Wave 1 | 1,234 | 57.1 | 40.5 | 2.4 |
Q4 2022 |
Waves 2 & 3 | 2,258 | 55.4 | 42.9 | 1.7 |
Q4 2022 |
Wave 4 | 1,125 | 59.0 | 40.0 | 1.0 |
Q1 2023 |
Wave 1 | 1,288 | 60.8 | 37.6 | 1.6 |
Q1 2023 |
Waves 2 & 3 | 2,400 | 59.8 | 39.4 | 0.8 |
Q1 2023 |
Wave 4 | 1,119 | 61.7 | 37.6 | 0.7 |
Q2 2023 |
Wave 1 | 1,263 | 56.5 | 42.2 | 1.3 |
Q2 2023 |
Waves 2 & 3 | 2,369 | 57.9 | 41.7 | 0.5 |
Q2 2023 |
Wave 4 | 1,119 | 61.4 | 38.0 | 0.6 |
Q3 2023 |
Wave 1 | 1,246 | 57.7 | 40.9 | 1.4 |
Q3 2023 |
Waves 2 & 3 | 2,314 | 57.6 | 41.8 | 0.6 |
Q3 2023 |
Wave 4 | 1,210 | 56.1 | 43.4 | 0.5 |
Q4 2023 |
Wave 1 | 1,197 | 60.2 | 38.8 | 1.0 |
Q4 2023 |
Waves 2 & 3 | 2,343 | 58.0 | 41.7 | 0.3 |
Q4 2023 |
Wave 4 | 1,122 | 61.2 | 38.3 | 0.4 |
Q1 2024 |
Wave 1 | 1,201 | 62.6 | 36.3 | 1.1 |
Q1 2024 |
Waves 2 & 3 | 2,337 | 60.5 | 39.2 | 0.4 |
Q1 2024 |
Wave 4 | 1,150 | 63.1 | 36.5 | 0.3 |
The Information Booklet is a recall aid that the Census FR provides to respondents, which covers both the Interview and Diary surveys. The Information Booklet provides response options for demographic questions and bracket response options for income questions. Additionally, Survey respondents can use the Information Booklet to view clarifying examples for specific expenditures that each section/item code is intended to collect.
This metric identifies the prevalence of Information Booklet use among respondents during their interviews, according to Census FRs. Typically, for interviews conducted over the phone, the Information Booklet is not readily available to the respondent (although a PDF version is available on the BLS website). Thus, this metric should be interpreted in conjunction with the rise in telephone interviews during the COVID-19 pandemic. Higher rates of Information Booklet usage are encouraged, as use can improve reporting quality by clarifying concepts and providing examples. More information on the Information Booklet use metric can be found in the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024).
Diary Survey Summary
Information Booklet use among Diary Survey respondents increased 14.7 percentage points from 12.7 percent in the first quarter of 2021 to 27.4 percent in the fourth quarter of 2023. Information Booklet use rates steadily increased in 2021, but decelerated and stagnated after the first quarter of 2022 (See Chart 3.1).
Quarter | Number of respondents | Used | Did not use[10] | Missing response |
---|---|---|---|---|
Q1 2016 |
2,951 | 42.5 | 51.8 | 5.8 |
Q2 2016 |
2,942 | 41.8 | 51.0 | 7.2 |
Q3 2016 |
2,939 | 44.3 | 49.7 | 6.0 |
Q4 2016 |
2,720 | 44.6 | 48.3 | 7.1 |
Q1 2017 |
2,841 | 45.1 | 50.8 | 4.1 |
Q2 2017 |
3,003 | 43.9 | 52.7 | 3.4 |
Q3 2017 |
2,904 | 43.6 | 53.1 | 3.2 |
Q4 2017 |
2,910 | 39.7 | 57.3 | 3.0 |
Q1 2018 |
2,791 | 42.0 | 54.3 | 3.8 |
Q2 2018 |
2,781 | 37.7 | 59.2 | 3.1 |
Q3 2018 |
2,896 | 39.5 | 56.5 | 4.0 |
Q4 2018 |
2,611 | 38.3 | 58.6 | 3.1 |
Q1 2019 |
2,671 | 42.0 | 54.9 | 3.1 |
Q2 2019 |
2,713 | 40.6 | 56.3 | 3.1 |
Q3 2019 |
2,745 | 39.2 | 58.1 | 2.7 |
Q4 2019 |
2,553 | 37.1 | 59.6 | 3.3 |
Q1 2020 |
3,285 | 33.1 | 64.0 | 3.0 |
Q2 2020 |
1,936 | 4.1 | 94.0 | 1.9 |
Q3 2020 |
2,559 | 7.3 | 90.8 | 1.9 |
Q4 2020 |
2,835 | 10.5 | 86.4 | 3.1 |
Q1 2021 |
2,952 | 12.7 | 84.2 | 3.1 |
Q2 2021 |
3,224 | 16.7 | 79.6 | 3.7 |
Q3 2021 |
3,027 | 20.0 | 77.5 | 2.5 |
Q4 2021 |
2,864 | 22.2 | 71.3 | 6.4 |
Q1 2022 |
3,357 | 25.9 | 69.8 | 4.3 |
Q2 2022 |
3,239 | 26.8 | 67.7 | 5.5 |
Q3 2022 |
3,248 | 27.9 | 68.1 | 4.0 |
Q4 2022 |
2,865 | 27.8 | 68.1 | 4.1 |
Q1 2023 |
3,162 | 27.9 | 67.9 | 4.2 |
Q2 2023 |
3,095 | 26.5 | 69.7 | 3.8 |
Q3 2023 |
3,064 | 26.2 | 70.3 | 3.5 |
Q4 2023 |
3,068 | 27.4 | 69.2 | 3.4 |
Interview Survey Summary
Information Booklet use among Wave 1 respondents increased by 22.0 percentage points since the second quarter of 2021, increasing until the fourth quarter of 2022 where there was a drop, this decrease reversed in the first quarter of 2023 and increased until reaching 36.9 percent in the first quarter of 2024 (See Chart 3.2).
Similarly to Wave 1, Information Booklet use among Waves 2 and 3, and Wave 4 respondents is higher than what was observed in the second quarter of 2021, but started levelling off after the first quarter of 2023.
Quarter | Wave | Number of respondents | Used | Did not use | No infobook | Missing response |
---|---|---|---|---|---|---|
Q1 2016 |
Wave 1 | 1,631 | 48.9 | 18.9 | 31.1 | 1.1 |
Q1 2016 |
Waves 2 & 3 | 3,172 | 35.0 | 17.3 | 47.2 | 0.5 |
Q1 2016 |
Wave 4 | 1,623 | 33.5 | 16.8 | 48.9 | 0.9 |
Q2 2016 |
Wave 1 | 1,633 | 47.6 | 19.7 | 31.2 | 1.6 |
Q2 2016 |
Waves 2 & 3 | 3,102 | 34.9 | 18.2 | 46.4 | 0.5 |
Q2 2016 |
Wave 4 | 1,607 | 34.8 | 16.9 | 47.6 | 0.7 |
Q3 2016 |
Wave 1 | 1,688 | 58.2 | 15.2 | 26.1 | 0.5 |
Q3 2016 |
Waves 2 & 3 | 3,087 | 39.3 | 16.1 | 44.1 | 0.5 |
Q3 2016 |
Wave 4 | 1,597 | 35.3 | 14.6 | 49.5 | 0.6 |
Q4 2016 |
Wave 1 | 1,660 | 56.1 | 13.1 | 30.1 | 0.7 |
Q4 2016 |
Waves 2 & 3 | 3,108 | 40.1 | 14.8 | 44.7 | 0.5 |
Q4 2016 |
Wave 4 | 1,533 | 35.6 | 16.8 | 46.3 | 1.2 |
Q1 2017 |
Wave 1 | 1,557 | 49.6 | 15.4 | 33.7 | 1.3 |
Q1 2017 |
Waves 2 & 3 | 3,078 | 39.6 | 12.7 | 47.1 | 0.6 |
Q1 2017 |
Wave 4 | 1,573 | 33.8 | 14.8 | 50.7 | 0.7 |
Q2 2017 |
Wave 1 | 1,573 | 53.8 | 17.0 | 28.4 | 0.8 |
Q2 2017 |
Waves 2 & 3 | 3,003 | 38.9 | 15.4 | 45.2 | 0.5 |
Q2 2017 |
Wave 4 | 1,601 | 39.0 | 13.4 | 47.1 | 0.5 |
Q3 2017 |
Wave 1 | 1,581 | 52.6 | 16.6 | 30.0 | 0.8 |
Q3 2017 |
Waves 2 & 3 | 2,933 | 38.3 | 16.2 | 44.9 | 0.6 |
Q3 2017 |
Wave 4 | 1,576 | 38.5 | 13.9 | 46.8 | 0.8 |
Q4 2017 |
Wave 1 | 1,592 | 50.1 | 15.9 | 32.8 | 1.3 |
Q4 2017 |
Waves 2 & 3 | 2,935 | 37.1 | 15.4 | 47.0 | 0.5 |
Q4 2017 |
Wave 4 | 1,477 | 35.2 | 14.8 | 49.3 | 0.7 |
Q1 2018 |
Wave 1 | 1,501 | 50.2 | 16.5 | 32.2 | 1.1 |
Q1 2018 |
Waves 2 & 3 | 2,951 | 37.2 | 14.5 | 47.7 | 0.5 |
Q1 2018 |
Wave 4 | 1,464 | 34.4 | 13.9 | 50.9 | 0.9 |
Q2 2018 |
Wave 1 | 1,529 | 47.5 | 17.7 | 33.6 | 1.1 |
Q2 2018 |
Waves 2 & 3 | 2,884 | 36.4 | 16.3 | 46.7 | 0.6 |
Q2 2018 |
Wave 4 | 1,486 | 34.5 | 16.8 | 48.1 | 0.5 |
Q3 2018 |
Wave 1 | 1,494 | 48.1 | 20.6 | 30.5 | 0.9 |
Q3 2018 |
Waves 2 & 3 | 2,815 | 36.8 | 15.9 | 47.0 | 0.4 |
Q3 2018 |
Wave 4 | 1,464 | 33.9 | 14.9 | 50.3 | 0.9 |
Q4 2018 |
Wave 1 | 1,399 | 49.0 | 17.3 | 32.8 | 0.9 |
Q4 2018 |
Waves 2 & 3 | 2,782 | 35.6 | 15.9 | 48.1 | 0.4 |
Q4 2018 |
Wave 4 | 1,390 | 32.4 | 16.7 | 49.9 | 1.1 |
Q1 2019 |
Wave 1 | 1,465 | 46.3 | 15.8 | 36.9 | 1.0 |
Q1 2019 |
Waves 2 & 3 | 2,730 | 36.2 | 14.0 | 49.3 | 0.5 |
Q1 2019 |
Wave 4 | 1,428 | 32.8 | 14.6 | 52.2 | 0.4 |
Q2 2019 |
Wave 1 | 1,443 | 49.5 | 17.3 | 32.4 | 0.8 |
Q2 2019 |
Waves 2 & 3 | 2,653 | 35.6 | 15.9 | 48.1 | 0.4 |
Q2 2019 |
Wave 4 | 1,397 | 33.9 | 16.7 | 48.5 | 0.9 |
Q3 2019 |
Wave 1 | 1,401 | 47.5 | 18.0 | 33.3 | 1.2 |
Q3 2019 |
Waves 2 & 3 | 2,651 | 35.6 | 15.2 | 48.4 | 0.8 |
Q3 2019 |
Wave 4 | 1,285 | 35.0 | 13.8 | 50.6 | 0.6 |
Q4 2019 |
Wave 1 | 1,318 | 46.7 | 16.5 | 35.9 | 0.8 |
Q4 2019 |
Waves 2 & 3 | 2,637 | 33.7 | 14.9 | 51.2 | 0.2 |
Q4 2019 |
Wave 4 | 1,293 | 32.3 | 15.3 | 51.9 | 0.5 |
Q1 2020 |
Wave 1 | 1,239 | 37.8 | 15.7 | 45.4 | 1.2 |
Q1 2020 |
Waves 2 & 3 | 2,601 | 28.1 | 13.9 | 57.6 | 0.4 |
Q1 2020 |
Wave 4 | 1,362 | 28.8 | 13.7 | 57.0 | 0.4 |
Q2 2020 |
Wave 1 | 965 | 2.6 | 1.8 | 94.8 | 0.8 |
Q2 2020 |
Waves 2 & 3 | 2,559 | 2.9 | 1.8 | 95.0 | 0.3 |
Q2 2020 |
Wave 4 | 1,334 | 3.4 | 0.8 | 95.2 | 0.5 |
Q3 2020 |
Wave 1 | 1,143 | 6.7 | 2.4 | 89.5 | 1.4 |
Q3 2020 |
Waves 2 & 3 | 2,444 | 4.8 | 2.7 | 92.2 | 0.3 |
Q3 2020 |
Wave 4 | 1,393 | 5.2 | 2.1 | 92.4 | 0.4 |
Q4 2020 |
Wave 1 | 1,230 | 12.4 | 6.7 | 80.7 | 0.3 |
Q4 2020 |
Waves 2 & 3 | 2,589 | 9.4 | 3.6 | 86.5 | 0.5 |
Q4 2020 |
Wave 4 | 1,386 | 7.4 | 3.8 | 88.6 | 0.2 |
Q1 2021 |
Wave 1 | 1,250 | 13.3 | 6.2 | 79.9 | 0.6 |
Q1 2021 |
Waves 2 & 3 | 2,515 | 9.3 | 3.3 | 87.1 | 0.4 |
Q1 2021 |
Wave 4 | 1,350 | 8.5 | 4.2 | 86.6 | 0.7 |
Q2 2021 |
Wave 1 | 1,325 | 14.9 | 7.8 | 76.7 | 0.6 |
Q2 2021 |
Waves 2 & 3 | 2,534 | 11.1 | 7.0 | 81.1 | 0.7 |
Q2 2021 |
Wave 4 | 1,337 | 9.6 | 5.2 | 84.6 | 0.6 |
Q3 2021 |
Wave 1 | 1,352 | 19.3 | 11.7 | 68.0 | 1.0 |
Q3 2021 |
Waves 2 & 3 | 2,488 | 12.7 | 7.4 | 79.1 | 0.8 |
Q3 2021 |
Wave 4 | 1,281 | 10.8 | 7.2 | 81.3 | 0.8 |
Q4 2021 |
Wave 1 | 1,229 | 25.1 | 9.3 | 64.8 | 0.8 |
Q4 2021 |
Waves 2 & 3 | 2,450 | 17.3 | 7.6 | 74.8 | 0.4 |
Q4 2021 |
Wave 4 | 1,223 | 15.3 | 6.1 | 77.9 | 0.7 |
Q1 2022 |
Wave 1 | 1,347 | 26.9 | 9.8 | 62.7 | 0.5 |
Q1 2022 |
Waves 2 & 3 | 2,551 | 18.8 | 8.2 | 72.6 | 0.4 |
Q1 2022 |
Wave 4 | 1,289 | 19.1 | 7.1 | 73.2 | 0.5 |
Q2 2022 |
Wave 1 | 1,325 | 31.2 | 10.5 | 57.2 | 1.1 |
Q2 2022 |
Waves 2 & 3 | 2,532 | 22.0 | 8.7 | 68.6 | 0.8 |
Q2 2022 |
Wave 4 | 1,320 | 20.5 | 8.6 | 70.5 | 0.5 |
Q3 2022 |
Wave 1 | 1,277 | 34.3 | 7.0 | 56.5 | 2.1 |
Q3 2022 |
Waves 2 & 3 | 2,153 | 24.1 | 6.9 | 68.0 | 1.1 |
Q3 2022 |
Wave 4 | 1,150 | 22.8 | 6.3 | 70.0 | 1.0 |
Q4 2022 |
Wave 1 | 1,234 | 32.3 | 8.5 | 56.8 | 2.4 |
Q4 2022 |
Waves 2 & 3 | 2,258 | 25.4 | 8.3 | 64.6 | 1.7 |
Q4 2022 |
Wave 4 | 1,125 | 23.7 | 6.7 | 68.6 | 1.0 |
Q1 2023 |
Wave 1 | 1,288 | 35.9 | 8.9 | 53.5 | 1.6 |
Q1 2023 |
Waves 2 & 3 | 2,400 | 28.5 | 7.7 | 63.0 | 0.8 |
Q1 2023 |
Wave 4 | 1,119 | 26.5 | 8.2 | 64.5 | 0.7 |
Q2 2023 |
Wave 1 | 1,263 | 35.2 | 8.7 | 54.8 | 1.3 |
Q2 2023 |
Waves 2 & 3 | 2,369 | 27.9 | 8.4 | 63.2 | 0.5 |
Q2 2023 |
Wave 4 | 1,119 | 26.7 | 9.3 | 63.4 | 0.6 |
Q3 2023 |
Wave 1 | 1,246 | 36.2 | 8.3 | 54.0 | 1.4 |
Q3 2023 |
Waves 2 & 3 | 2,314 | 28.3 | 8.6 | 62.5 | 0.6 |
Q3 2023 |
Wave 4 | 1,210 | 26.5 | 8.3 | 64.7 | 0.5 |
Q4 2023 |
Wave 1 | 1,197 | 32.7 | 10.5 | 55.8 | 1.0 |
Q4 2023 |
Waves 2 & 3 | 2,343 | 27.9 | 9.5 | 62.3 | 0.3 |
Q4 2023 |
Wave 4 | 1,122 | 26.1 | 9.0 | 64.5 | 0.4 |
Q1 2024 |
Wave 1 | 1,201 | 36.9 | 9.8 | 52.2 | 1.1 |
Q1 2024 |
Waves 2 & 3 | 2,337 | 28.2 | 7.9 | 63.5 | 0.4 |
Q1 2024 |
Wave 4 | 1,150 | 26.4 | 7.9 | 65.4 | 0.3 |
The Expenditure edit rates metric measures the proportion of reported expenditure data that are edited. These edits are changes made to the reported expenditure data during CE data processing, excluding changes due to time period conversion calculations and top-coding or suppression of reported values. Top-coding and suppression are done to protect respondent confidentiality in the public use microdata (PUMD). Additional information on top-coding and suppression is available on the CE Website.
Expenditure edit rates for the Interview Survey are broken down into three categories: imputation, allocation, and manual edits:
Imputation replaces missing or invalid responses with a valid value.
Allocation edits are applied when respondents provide insufficient detail to meet tabulation requirements. For example, if a respondent provides a non-itemized total expenditure report for the category of fuels and utilities, that total amount will be allocated to the target items mentioned by the respondent (such as natural gas and electricity).
Manual edits occur whenever responses are directly edited by BLS economists based on their analysis and expert judgment.
Expenditure edit rates for the Diary Survey are only broken down into two categories: Allocations and Other Edits. Most edits in the Diary Survey are allocations. Table 4.1 below shows the "Other edits" category, which covers all other expenditure edits including imputation and manual edits. According to the data in Table 4.1, these data edits are relatively rare.
Beginning in 2022 the BLS changed the way expenditure edit rates are calculated for Diary Survey data. Changes to the alcohol cost flag are now considered an expenditure edit under the "Other edits" category. This change was retroactively applied to the full metric series and has led to comparatively higher estimates for "Other Edits" and lower estimates for "Unedited" compared to previous reports.
Imputation of CE data results from item nonresponse. Allocation is a consequence of responses lacking the required details for items asked by the survey. Lower edit rates are preferred, as it lowers the risk of processing error. However, edits based on sound methodology can improve the completeness of the data, and thereby reduce the risk of measurement error and nonresponse bias in survey estimates. Additional information on expenditure edits is available in the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024).
The total rate of unedited expenditures rose from 89.0 percent in the first quarter of 2021 to 92.2 percent in the fourth quarter of 2023 (See Chart 4.1).
Diary Allocation edit rates fell from 10.9 percentage points in the first quarter of 2021 to 6.2 percent in the fourth quarter of 2023, which is most likely attributable to the consolidation of UCCs in that period (See Chart 4.1).
The rate of Other Edits has increased 1.4 percentage points from 0.2 in the first quarter of 2021 to 1.6 percent in the fourth quarter of 2023, hitting a series high of 2.2 percent in the fourth quarter of 2022 (See Chart 4.1).
Quarter | Number of expenditures | Allocated | Other edits | Unedited |
---|---|---|---|---|
Q1 2016 |
87,411 | 11.0 | 0.1 | 88.9 |
Q2 2016 |
84,232 | 11.4 | 0.1 | 88.5 |
Q3 2016 |
82,285 | 11.1 | 0.2 | 88.7 |
Q4 2016 |
80,515 | 10.9 | 0.3 | 88.8 |
Q1 2017 |
88,654 | 10.6 | 0.3 | 89.2 |
Q2 2017 |
92,985 | 10.9 | 0.2 | 88.9 |
Q3 2017 |
89,370 | 11.0 | 0.1 | 88.8 |
Q4 2017 |
92,031 | 10.3 | 0.1 | 89.6 |
Q1 2018 |
86,798 | 9.8 | 0.3 | 89.9 |
Q2 2018 |
87,649 | 10.0 | 0.3 | 89.8 |
Q3 2018 |
88,342 | 10.0 | 0.4 | 89.6 |
Q4 2018 |
80,129 | 10.3 | 0.3 | 89.5 |
Q1 2019 |
79,626 | 10.2 | 0.2 | 89.6 |
Q2 2019 |
85,329 | 9.1 | 0.1 | 90.8 |
Q3 2019 |
83,639 | 10.5 | 0.1 | 89.4 |
Q4 2019 |
80,510 | 9.5 | 0.2 | 90.3 |
Q1 2020 |
102,693 | 9.2 | 0.2 | 90.5 |
Q2 2020 |
41,257 | 10.2 | 0.2 | 89.5 |
Q3 2020 |
56,071 | 11.6 | 0.1 | 88.3 |
Q4 2020 |
69,959 | 10.7 | 0.2 | 89.2 |
Q1 2021 |
72,138 | 10.9 | 0.2 | 89.0 |
Q2 2021 |
80,646 | 11.1 | 0.3 | 88.5 |
Q3 2021 |
75,663 | 11.3 | 0.5 | 88.2 |
Q4 2021 |
71,144 | 10.1 | 1.0 | 88.9 |
Q1 2022 |
82,352 | 10.1 | 0.6 | 89.4 |
Q2 2022 |
79,454 | 10.5 | 0.4 | 89.1 |
Q3 2022 |
83,957 | 10.9 | 1.2 | 87.9 |
Q4 2022 |
74,215 | 10.3 | 2.2 | 87.5 |
Q1 2023 |
81,434 | 7.1 | 1.4 | 91.5 |
Q2 2023 |
79,016 | 7.3 | 1.8 | 91.0 |
Q3 2023 |
78,763 | 6.9 | 1.6 | 91.5 |
Q4 2023 |
78,890 | 6.2 | 1.6 | 92.2 |
Interview Survey Summary
The total rate of unedited expenditures increased by 2.7 percentage points from 85.0 percent in the second quarter of 2021 to 87.7 in the first quarter of 2024 (See Chart 4.2).
The increase of unedited expenditures was primarily driven by allocation rates declining 1.8 percentage points from 10.1 in the second quarter of 2021 to 8.3 percent in the first quarter of 2024 (See Chart 4.2).
Manual edits rates moved between the 0.2 percent and 0.6 percent range between the second quarter of 2021 and the first quarter of 2024, resulting in a net increase of 0.3 percentage points from 0.2 percent in the second quarter of 2021 to 0.5 percent in the first quarter of 2024. Between the second quarter of 2021 and the first quarter of 2024, expenditure imputation rates fell 1.1 percentage points from 4.5 to 3.4 (See Chart 4.2).
Quarter | Number of expenditures | Allocated | Imputed | Imputed & allocated | Manual edits | Unedited |
---|---|---|---|---|---|---|
Q1 2016 |
273,729 | 5.5 | 11.6 | 0.1 | 0.1 | 82.7 |
Q2 2016 |
268,405 | 5.4 | 12.0 | 0.1 | 0.1 | 82.4 |
Q3 2016 |
279,542 | 5.7 | 10.8 | 0.1 | 0.1 | 83.2 |
Q4 2016 |
276,290 | 5.7 | 10.5 | 0.1 | 0.1 | 83.6 |
Q1 2017 |
272,929 | 5.7 | 11.0 | 0.1 | 0.1 | 83.1 |
Q2 2017 |
276,568 | 12.1 | 4.3 | 0.2 | 0.1 | 83.4 |
Q3 2017 |
281,533 | 12.5 | 4.3 | 0.2 | 0.1 | 82.9 |
Q4 2017 |
277,032 | 12.4 | 4.3 | 0.2 | 0.1 | 83.0 |
Q1 2018 |
275,949 | 11.7 | 4.3 | 0.2 | 0.1 | 83.7 |
Q2 2018 |
270,726 | 12.0 | 3.9 | 0.2 | 0.1 | 83.9 |
Q3 2018 |
269,909 | 12.1 | 3.8 | 0.2 | 0.1 | 83.8 |
Q4 2018 |
259,508 | 12.0 | 3.8 | 0.2 | 0.1 | 84.0 |
Q1 2019 |
264,424 | 11.8 | 3.6 | 0.2 | 0.1 | 84.3 |
Q2 2019 |
255,037 | 11.7 | 3.7 | 0.2 | 0.1 | 84.2 |
Q3 2019 |
251,370 | 11.6 | 3.7 | 0.2 | 0.2 | 84.3 |
Q4 2019 |
244,834 | 11.6 | 3.8 | 0.2 | 0.2 | 84.2 |
Q1 2020 |
246,488 | 11.6 | 3.9 | 0.2 | 0.2 | 84.1 |
Q2 2020 |
217,785 | 11.9 | 4.1 | 0.2 | 0.1 | 83.6 |
Q3 2020 |
224,639 | 11.6 | 4.3 | 0.2 | 0.3 | 83.6 |
Q4 2020 |
232,195 | 11.6 | 4.3 | 0.2 | 0.3 | 83.6 |
Q1 2021 |
231,850 | 11.2 | 3.9 | 0.2 | 0.6 | 84.0 |
Q2 2021 |
232,282 | 10.1 | 4.5 | 0.2 | 0.2 | 85.0 |
Q3 2021 |
231,351 | 10.1 | 4.0 | 0.2 | 0.5 | 85.2 |
Q4 2021 |
222,027 | 9.8 | 3.7 | 0.2 | 0.6 | 85.7 |
Q1 2022 |
231,495 | 9.4 | 3.6 | 0.2 | 0.5 | 86.4 |
Q2 2022 |
229,608 | 9.3 | 3.8 | 0.2 | 0.5 | 86.3 |
Q3 2022 |
215,674 | 9.2 | 3.7 | 0.1 | 0.5 | 86.5 |
Q4 2022 |
213,369 | 9.1 | 3.7 | 0.2 | 0.4 | 86.6 |
Q1 2023 |
226,199 | 8.6 | 3.5 | 0.1 | 0.4 | 87.3 |
Q2 2023 |
211,813 | 8.7 | 3.6 | 0.1 | 0.5 | 87.2 |
Q3 2023 |
215,398 | 8.6 | 3.8 | 0.2 | 0.2 | 87.2 |
Q4 2023 |
208,737 | 8.6 | 3.3 | 0.2 | 0.4 | 87.5 |
Q1 2024 |
211,517 | 8.3 | 3.4 | 0.2 | 0.5 | 87.7 |
The Income imputation rates metric describes edits performed on a CU's nonresponse to at least one source of income. This edit is based on three imputation methods, applicable to both CE Surveys:
After imputation, income from each component source is summed to compute total income before taxes for the CU as a whole. In the following text, income before taxes is defined as “unimputed income” if no source of total income required imputation for one of the three reasons identified above. As stated, this applies to both the Diary and Interview Surveys.
The need for imputation arises from either item nonresponse or from response with insufficient detail was provided (e.g., providing a range of income like “between $40,000 and $50,000,”). Higher response rates for actual values are associated with less measurement error in the data for imputation to address. However, imputation based on sound methodology produces a complete dataset, and reduces the risk of nonresponse bias since incomplete cases are no longer dropped from the dataset. Further details on the income imputation methodology can be found in the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024) and the User's Guide to Income Imputation in the CE (Paulin, Reyes-Morales, and Fisher, 2018).
Diary Survey Summary
Bracket imputation rates fluctuated between a low of 16.8 percent in the first quarter of 2023 and a three-year high of 19.7 percent in the first quarter of 2024 (See Chart 5.1).
Increases in bracket imputation rates coincided with decreases in model-based rates to a three-year low of 17.6 percent (See Chart 5.1).
AVB imputation rates decreased to 1.9 percent in the fourth quarter of 2023 after reaching a series high of 3.9 percent in the fourth quarter of 2022 (See Chart 5.1).
Quarter | Number of respondents | Valid blanks converted (AVB) | Bracket imputation | Model imputation | Model & bracket imputation | Unedited |
---|---|---|---|---|---|---|
Q1 2016 |
2,951 | 3.2 | 18.0 | 21.5 | 6.0 | 51.3 |
Q2 2016 |
2,942 | 3.4 | 19.2 | 26.6 | 4.1 | 46.7 |
Q3 2016 |
2,939 | 3.2 | 19.4 | 22.4 | 5.5 | 49.4 |
Q4 2016 |
2,720 | 3.6 | 18.2 | 23.5 | 5.8 | 48.9 |
Q1 2017 |
2,841 | 1.8 | 19.4 | 19.7 | 5.9 | 53.2 |
Q2 2017 |
3,003 | 2.5 | 20.2 | 18.2 | 5.8 | 53.3 |
Q3 2017 |
2,904 | 1.8 | 19.2 | 18.8 | 4.8 | 55.4 |
Q4 2017 |
2,910 | 1.8 | 19.7 | 19.4 | 4.7 | 54.5 |
Q1 2018 |
2,791 | 1.9 | 18.9 | 18.7 | 4.1 | 56.5 |
Q2 2018 |
2,781 | 1.9 | 17.4 | 19.6 | 4.5 | 56.7 |
Q3 2018 |
2,896 | 1.5 | 18.4 | 21.3 | 5.1 | 53.8 |
Q4 2018 |
2,611 | 2.4 | 19.1 | 18.3 | 6.0 | 54.3 |
Q1 2019 |
2,671 | 1.8 | 18.7 | 17.8 | 4.9 | 56.8 |
Q2 2019 |
2,713 | 2.9 | 20.2 | 17.6 | 5.0 | 54.3 |
Q3 2019 |
2,745 | 2.1 | 22.1 | 18.5 | 4.9 | 52.4 |
Q4 2019 |
2,553 | 2.6 | 19.2 | 15.2 | 6.5 | 56.4 |
Q1 2020 |
3,285 | 1.9 | 20.0 | 17.5 | 5.1 | 55.5 |
Q2 2020 |
1,936 | 1.5 | 20.8 | 16.5 | 6.2 | 55.0 |
Q3 2020 |
2,559 | 2.6 | 18.1 | 19.5 | 6.7 | 53.1 |
Q4 2020 |
2,835 | 1.9 | 18.9 | 19.9 | 6.0 | 53.3 |
Q1 2021 |
2,952 | 2.0 | 18.7 | 18.4 | 5.6 | 55.2 |
Q2 2021 |
3,224 | 2.1 | 17.5 | 19.9 | 5.6 | 54.9 |
Q3 2021 |
3,027 | 2.5 | 19.3 | 18.4 | 5.3 | 54.5 |
Q4 2021 |
2,864 | 2.4 | 17.8 | 22.4 | 4.6 | 52.8 |
Q1 2022 |
3,357 | 2.3 | 19.0 | 19.5 | 4.5 | 54.7 |
Q2 2022 |
3,239 | 2.3 | 18.7 | 18.9 | 4.4 | 55.8 |
Q3 2022 |
3,248 | 1.8 | 17.6 | 19.4 | 6.1 | 55.1 |
Q4 2022 |
2,865 | 3.9 | 17.6 | 18.1 | 3.7 | 56.6 |
Q1 2023 |
3,162 | 2.4 | 16.8 | 18.8 | 4.6 | 57.4 |
Q2 2023 |
3,095 | 2.1 | 17.0 | 18.7 | 5.2 | 57.1 |
Q3 2023 |
3,064 | 2.4 | 18.0 | 18.5 | 4.8 | 56.1 |
Q4 2023 |
3,068 | 1.9 | 19.7 | 17.6 | 4.9 | 55.9 |
Interview Survey Summary
Model-based imputation rates declined from a series high of 20.5 percent in the second quarter of 2021 to 17.4 percent in the first quarter of 2024 (See Chart 5.2).
The rate of model & bracket imputations has declined slightly from 5.8 percent in the second quarter of 2021 to 4.8 percent in the first quarter of 2024 (See Chart 5.2).
Quarter | Number of respondents | Valid blanks converted (AVB) | Bracket imputation | Model imputation | Model & bracket imputation | Unedited |
---|---|---|---|---|---|---|
Q1 2016 |
6,426 | 1.6 | 19.4 | 18.6 | 4.6 | 55.8 |
Q2 2016 |
6,342 | 1.5 | 18.3 | 19.2 | 4.5 | 56.4 |
Q3 2016 |
6,372 | 1.6 | 19.2 | 17.6 | 4.6 | 57.1 |
Q4 2016 |
6,301 | 1.7 | 18.4 | 17.1 | 4.6 | 58.2 |
Q1 2017 |
6,208 | 1.9 | 19.6 | 17.2 | 4.3 | 57.0 |
Q2 2017 |
6,177 | 1.1 | 18.4 | 17.7 | 4.0 | 58.8 |
Q3 2017 |
6,090 | 1.3 | 17.4 | 18.6 | 4.3 | 58.4 |
Q4 2017 |
6,004 | 1.7 | 17.6 | 18.8 | 4.6 | 57.4 |
Q1 2018 |
5,916 | 1.5 | 17.5 | 18.0 | 4.6 | 58.4 |
Q2 2018 |
5,899 | 1.2 | 16.8 | 17.1 | 5.2 | 59.8 |
Q3 2018 |
5,773 | 1.4 | 17.9 | 16.6 | 4.7 | 59.4 |
Q4 2018 |
5,571 | 1.4 | 18.2 | 17.3 | 4.5 | 58.5 |
Q1 2019 |
5,623 | 1.9 | 18.0 | 17.0 | 4.3 | 58.8 |
Q2 2019 |
5,493 | 1.4 | 18.3 | 17.5 | 4.4 | 58.4 |
Q3 2019 |
5,337 | 1.2 | 17.8 | 17.7 | 4.6 | 58.7 |
Q4 2019 |
5,248 | 1.4 | 18.9 | 17.2 | 5.0 | 57.5 |
Q1 2020 |
5,202 | 1.3 | 18.6 | 17.6 | 4.5 | 58.1 |
Q2 2020 |
4,858 | 1.2 | 18.1 | 18.7 | 4.9 | 57.1 |
Q3 2020 |
4,980 | 1.1 | 18.2 | 19.0 | 5.1 | 56.6 |
Q4 2020 |
5,205 | 1.3 | 18.2 | 20.3 | 5.5 | 54.7 |
Q1 2021 |
5,115 | 1.4 | 17.8 | 19.9 | 5.5 | 55.5 |
Q2 2021 |
5,196 | 1.3 | 17.4 | 20.5 | 5.8 | 55.0 |
Q3 2021 |
5,121 | 1.2 | 18.1 | 19.7 | 5.4 | 55.5 |
Q4 2021 |
4,902 | 1.4 | 17.1 | 18.6 | 5.3 | 57.5 |
Q1 2022 |
5,187 | 1.3 | 17.8 | 17.9 | 5.2 | 57.8 |
Q2 2022 |
5,177 | 1.4 | 17.0 | 18.3 | 5.4 | 58.0 |
Q3 2022 |
4,580 | 1.1 | 17.9 | 17.4 | 5.3 | 58.3 |
Q4 2022 |
4,617 | 1.0 | 18.3 | 17.7 | 4.9 | 58.1 |
Q1 2023 |
4,807 | 1.1 | 18.5 | 16.4 | 4.4 | 59.5 |
Q2 2023 |
4,751 | 1.2 | 17.6 | 17.2 | 4.7 | 59.3 |
Q3 2023 |
4,770 | 1.1 | 17.7 | 17.5 | 4.7 | 59.0 |
Q4 2023 |
4,662 | 1.0 | 18.4 | 16.9 | 4.5 | 59.2 |
Q1 2024 |
4,688 | 0.9 | 18.6 | 17.4 | 4.8 | 58.3 |
Respondent burden in the Interview survey relates to the perceived level of effort exerted by respondents in answering the survey question. Survey designers are concerned about respondent burden as it has the potential to negatively impact response rates and overall response quality. Beginning in April 2017, the Interview Survey introduced a respondent burden question with response options describing five different levels of burden at the end of the Wave 4 interview. The respondent burden metric is derived from this question and maps five burden categories to three metric values: not burdensome, some burden, and very burdensome. Please see the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024) for more details on the question wording and the burden categories.
A caveat to the interpretation of this metric is that since the burden question is only asked at the end of Wave 4, the metric may underestimate survey burden due to self-selection bias. That is, respondents who have agreed to participate in the final wave of the survey presumably find the survey less burdensome than sample units who had dropped out at any point prior to completing the final survey wave.
However, it is also possible that the respondent answering this question did not participate in prior interview waves. For example, the respondent who participated in the first three survey waves might move out of the sampled address prior to the final interview. This is not a common occurrence, but if someone else moves into the sampled address in time for the final wave, then they would be asked these questions.
Interview Survey Summary
After reaching a series low of 24.2 percent in the fourth quarter of 2021, the percent of respondents that reported perceiving no burden fluctuated between 26.3 and 29.3 percent and reaching 29.0 percent in the first quarter of 2024 (See Chart 6.1).
The percent of respondents who report perceiving some burden fell to a three-year low of 53.2 percent in the first quarter of 2024 (See Chart 6.1).
The percentage of respondents who report that the survey was very burdensome rose slightly, tying the series high of 16.3 percent in the first quarter of 2024 (See Chart 6.1).
There has been little variation in missing burden response in recent quarters with the rate of missing response hitting a series low of 0.9 percent in the fourth quarter of 2023 (See Chart 6.1).
Quarter | Number of respondents | Not burdensome | Some burden | Very burdensome | Missing response |
---|---|---|---|---|---|
Q2 2017 |
1,601 | 34.2 | 52.5 | 10.0 | 3.2 |
Q3 2017 |
1,576 | 32.7 | 51.8 | 12.1 | 3.5 |
Q4 2017 |
1,477 | 33.6 | 52.7 | 11.0 | 2.6 |
Q1 2018 |
1,464 | 31.7 | 52.7 | 12.4 | 3.2 |
Q2 2018 |
1,486 | 32.4 | 52.8 | 12.2 | 2.6 |
Q3 2018 |
1,464 | 33.7 | 51.4 | 13.0 | 1.9 |
Q4 2018 |
1,390 | 34.2 | 50.8 | 12.1 | 2.9 |
Q1 2019 |
1,428 | 30.5 | 55.1 | 12.7 | 1.6 |
Q2 2019 |
1,397 | 30.9 | 52.4 | 13.7 | 2.9 |
Q3 2019 |
1,285 | 29.4 | 54.3 | 13.4 | 2.9 |
Q4 2019 |
1,293 | 32.9 | 53.8 | 11.3 | 2.0 |
Q1 2020 |
1,362 | 30.8 | 54.0 | 12.0 | 3.2 |
Q2 2020 |
1,334 | 30.7 | 54.3 | 12.5 | 2.5 |
Q3 2020 |
1,393 | 30.5 | 54.1 | 12.8 | 2.7 |
Q4 2020 |
1,386 | 29.7 | 53.5 | 14.9 | 1.9 |
Q1 2021 |
1,350 | 26.0 | 55.0 | 15.6 | 3.4 |
Q2 2021 |
1,337 | 29.0 | 55.8 | 12.3 | 2.9 |
Q3 2021 |
1,281 | 27.9 | 53.9 | 15.4 | 2.7 |
Q4 2021 |
1,223 | 24.2 | 57.9 | 15.3 | 2.6 |
Q1 2022 |
1,289 | 26.3 | 55.2 | 16.3 | 2.2 |
Q2 2022 |
1,320 | 28.4 | 54.7 | 14.6 | 2.3 |
Q3 2022 |
1,150 | 27.1 | 57.1 | 13.4 | 2.3 |
Q4 2022 |
1,125 | 28.3 | 54.8 | 15.0 | 1.9 |
Q1 2023 |
1,119 | 28.7 | 55.5 | 13.1 | 2.7 |
Q2 2023 |
1,119 | 28.2 | 55.9 | 13.6 | 2.4 |
Q3 2023 |
1,210 | 29.3 | 54.0 | 14.5 | 2.1 |
Q4 2023 |
1,122 | 27.0 | 57.0 | 15.1 | 0.9 |
Q1 2024 |
1,150 | 29.0 | 53.2 | 16.3 | 1.5 |
These metrics measure the mode of data collection for the Diary and the Interview Surveys.
In the Diary Survey, the mode of data collection is two dimensional. The first is how data about the CU (e.g., CU size, demographics characteristics, income and assets, etc.) were collected by the Census FR (i.e., mostly in-person or mostly over the phone). The second is the diary type used by respondents when entering expenses during the diary keeping period (i.e., online or paper). Until recently, the Diary Survey was administered strictly in paper form. As part of the redesign effort, the CE program introduced a new online diary mode.[11] This new mode prompted the inclusion of a quality metric that tracks the mode of diary the respondent at the time of placement. It should be noted that while the online diary became available in July 2020 as a supplemental data collection tool during the onset of the COVID-19 pandemic, it was not officially implemented into CE production until July 2022.
The Interview Survey was designed to be conducted in-person. However, the interviewer can also collect data over the phone, or by a combination of the two modes. Higher rates of in-person data collection are preferred since the interviewer can actively prompt the respondent, as well as encourage the use of recall aids, thereby reducing the risk of measurement error. Conducting first wave interviews in-person is especially important as this is typically the respondent’s first exposure to the survey. This serves as an opportunity for the Census FR to build rapport with the household. As a data quality measure, the BLS has inter-agency agreements with the Census Bureau stipulating that the average CE telephone interview rate, defined as interviews in which 50 percent or more of the survey sections are completed by telephone, should be limited to 25 percent for Wave 1 interviews, and 50 percent for all subsequent interview waves, or as feasible, to be determined by factors that may restrict or limit in-person interviewing in selected geographies. More information on how we calculate the mode metrics is available in the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024).
Diary Survey Mode Summary
The rate of in-person collection for diary household data rose in the two most recent quarters, increasing from 70.8 percent in the second quarter of 2023 to 71.7 percent in the third quarter of 2023, and then to 72.4 percent in the fourth quarter of 2023 (See Chart 7.1).
Over the past four quarters of available data, in-person data collection increased from 69.4 to 72.4 percent (See Chart 7.1).
Quarter | Number of diary cases | In-person | Telephone | Missing |
---|---|---|---|---|
Q1 2016 |
2,951 | 89.0 | 5.4 | 5.6 |
Q2 2016 |
2,942 | 85.9 | 6.9 | 7.2 |
Q3 2016 |
2,939 | 88.2 | 5.9 | 6.0 |
Q4 2016 |
2,720 | 88.9 | 4.0 | 7.1 |
Q1 2017 |
2,841 | 91.6 | 4.4 | 4.0 |
Q2 2017 |
3,003 | 91.4 | 5.2 | 3.4 |
Q3 2017 |
2,904 | 92.5 | 4.2 | 3.2 |
Q4 2017 |
2,910 | 91.7 | 5.4 | 3.0 |
Q1 2018 |
2,791 | 91.4 | 4.9 | 3.7 |
Q2 2018 |
2,781 | 92.3 | 4.7 | 3.0 |
Q3 2018 |
2,896 | 91.5 | 4.5 | 4.0 |
Q4 2018 |
2,611 | 91.1 | 5.9 | 3.1 |
Q1 2019 |
2,671 | 92.0 | 4.9 | 3.1 |
Q2 2019 |
2,713 | 92.3 | 4.6 | 3.1 |
Q3 2019 |
2,745 | 92.3 | 5.1 | 2.6 |
Q4 2019 |
2,553 | 91.4 | 5.3 | 3.3 |
Q1 2020 |
3,285 | 76.3 | 20.8 | 3.0 |
Q2 2020 |
1,936 | 0.9 | 97.2 | 1.9 |
Q3 2020 |
2,559 | 24.5 | 73.6 | 1.9 |
Q4 2020 |
2,835 | 43.8 | 53.1 | 3.1 |
Q1 2021 |
2,952 | 46.5 | 50.3 | 3.1 |
Q2 2021 |
3,224 | 59.6 | 36.7 | 3.7 |
Q3 2021 |
3,027 | 64.6 | 32.9 | 2.5 |
Q4 2021 |
2,864 | 60.8 | 32.8 | 6.4 |
Q1 2022 |
3,357 | 63.1 | 32.7 | 4.3 |
Q2 2022 |
3,239 | 69.6 | 25.0 | 5.4 |
Q3 2022 |
3,248 | 69.5 | 26.5 | 4.0 |
Q4 2022 |
2,865 | 69.9 | 26.0 | 4.1 |
Q1 2023 |
3,162 | 69.4 | 26.4 | 4.1 |
Q2 2023 |
3,095 | 70.8 | 25.4 | 3.8 |
Q3 2023 |
3,064 | 71.7 | 25.0 | 3.3 |
Q4 2023 |
3,068 | 72.4 | 24.2 | 3.4 |
Expenditure Diary Survey Mode Summary
In the two most recent quarters of available data, the proportion of paper diaries fell to 68.8 percent in the third quarter of 2023 from 71.1 percent in the second quarter of 2023, before rising slightly to 68.9 percent in the fourth quarter of 2023 (See Chart 7.2).
The proportion of online diaries also experienced some variance, rising from 26.3 percent in the second quarter of 2023 to 29.1 percent in the third quarter of 2023, and where it remained for the fourth quarter of 2023 (See Chart 7.2).
Quarter | Number of diary cases | Paper | Online | Missing |
---|---|---|---|---|
Q3 2020 |
2,559 | 66.3 | 33.1 | 0.6 |
Q4 2020 |
2,835 | 71.3 | 26.8 | 1.9 |
Q1 2021 |
2,952 | 71.2 | 27.1 | 1.6 |
Q2 2021 |
3,224 | 70.8 | 27.1 | 2.1 |
Q3 2021 |
3,027 | 70.5 | 27.9 | 1.6 |
Q4 2021 |
2,864 | 69.6 | 26.0 | 4.3 |
Q1 2022 |
3,357 | 69.1 | 27.8 | 3.2 |
Q2 2022 |
3,239 | 68.4 | 28.7 | 2.9 |
Q3 2022 |
3,248 | 71.4 | 25.5 | 3.1 |
Q4 2022 |
2,865 | 71.4 | 25.4 | 3.2 |
Q1 2023 |
3,162 | 69.9 | 27.8 | 2.3 |
Q2 2023 |
3,095 | 71.1 | 26.3 | 2.6 |
Q3 2023 |
3,064 | 68.8 | 29.1 | 2.1 |
Q4 2023 |
3,068 | 68.9 | 29.1 | 2.0 |
Interview Survey Summary
The rate of in-person interviews, across all waves, fell in the two most recent quarters from 40.4 percent in the third quarter of 2023 to 39.5 percent in the fourth quarter of 2023, and then again to 38.0 percent in the first quarter of 2024 (See Chart 7.3).
This fluctuation continues the trend of intermittent increases in the proportion of in-person interviews followed by small drop offs (See Chart 7.3).
The rate of Wave 1 in-person interviews exceeded 50 percent in the second quarter of 2022 (50.3 percent) and has since hovered between 52.5 and 46.8 percent. In the two most recent quarters, the rate of Wave 1 in-person interviews varied slightly, rising from 49.8 percent in the third quarter of 2023 to 51.0 percent in the fourth quarter of 2023, before falling to 49.5 percent in the first quarter of 2024 (See Chart 7.4).
Rates of in-person interviews in Waves 2 & 3 experienced decreases in the two most recent quarters of data, falling from 38.7 percent in the third quarter of 2023 to 36.3 percent in the fourth quarter of 2023, and again to 34.2 percent in the first quarter of 2024 (See Chart 7.4).
Wave 4 in-person interview rates also saw decreases in the two most recent quarters, falling from 34.1 percent in the third quarter of 2023 to 34.0 percent in the fourth quarter of 2023, and again to 33.8 percent in the first quarter of 2024 (See Chart 7.4).
Quarter | Number of respondents | In-person | Telephone | Missing |
---|---|---|---|---|
Q1 2016 |
6,426 | 63.8 | 35.7 | 0.5 |
Q2 2016 |
6,342 | 64.7 | 34.7 | 0.6 |
Q3 2016 |
6,372 | 66.1 | 33.6 | 0.3 |
Q4 2016 |
6,301 | 64.9 | 34.7 | 0.4 |
Q1 2017 |
6,208 | 62.7 | 36.8 | 0.6 |
Q2 2017 |
6,177 | 65.9 | 33.7 | 0.5 |
Q3 2017 |
6,090 | 65.6 | 33.9 | 0.6 |
Q4 2017 |
6,004 | 64.4 | 35.0 | 0.6 |
Q1 2018 |
5,916 | 63.0 | 36.4 | 0.7 |
Q2 2018 |
5,899 | 63.7 | 35.8 | 0.5 |
Q3 2018 |
5,773 | 64.8 | 34.7 | 0.5 |
Q4 2018 |
5,571 | 64.2 | 35.4 | 0.4 |
Q1 2019 |
5,623 | 62.5 | 37.0 | 0.5 |
Q2 2019 |
5,493 | 64.4 | 35.3 | 0.3 |
Q3 2019 |
5,337 | 64.4 | 35.2 | 0.4 |
Q4 2019 |
5,248 | 61.9 | 37.8 | 0.3 |
Q1 2020 |
5,202 | 53.1 | 46.5 | 0.4 |
Q2 2020 |
4,858 | 1.7 | 98.0 | 0.3 |
Q3 2020 |
4,980 | 9.3 | 90.5 | 0.3 |
Q4 2020 |
5,205 | 19.5 | 80.3 | 0.2 |
Q1 2021 |
5,115 | 18.1 | 81.6 | 0.3 |
Q2 2021 |
5,196 | 26.3 | 73.4 | 0.3 |
Q3 2021 |
5,121 | 31.8 | 67.8 | 0.4 |
Q4 2021 |
4,902 | 30.7 | 69.0 | 0.3 |
Q1 2022 |
5,187 | 31.0 | 68.8 | 0.2 |
Q2 2022 |
5,177 | 36.4 | 63.0 | 0.5 |
Q3 2022 |
4,580 | 35.9 | 62.9 | 1.1 |
Q4 2022 |
4,617 | 35.3 | 63.3 | 1.5 |
Q1 2023 |
4,807 | 37.5 | 62.0 | 0.6 |
Q2 2023 |
4,751 | 39.7 | 59.8 | 0.5 |
Q3 2023 |
4,770 | 40.4 | 59.1 | 0.5 |
Q4 2023 |
4,662 | 39.5 | 60.1 | 0.4 |
Q1 2024 |
4,688 | 38.0 | 61.6 | 0.3 |
Quarter | Number of respondents | Wave 1 | Waves 2 & 3 | Wave 4 |
---|---|---|---|---|
Q1 2016 |
6,426 | 77.4 | 59.9 | 57.9 |
Q2 2016 |
6,342 | 78.6 | 60.6 | 58.5 |
Q3 2016 |
6,372 | 82.5 | 62.0 | 56.7 |
Q4 2016 |
6,301 | 76.7 | 61.9 | 58.3 |
Q1 2017 |
6,208 | 76.0 | 59.5 | 55.6 |
Q2 2017 |
6,177 | 80.6 | 61.7 | 59.3 |
Q3 2017 |
6,090 | 79.3 | 62.2 | 58.1 |
Q4 2017 |
6,004 | 76.1 | 60.7 | 59.1 |
Q1 2018 |
5,916 | 76.4 | 59.3 | 56.6 |
Q2 2018 |
5,899 | 77.0 | 59.7 | 57.8 |
Q3 2018 |
5,773 | 79.2 | 61.1 | 57.1 |
Q4 2018 |
5,571 | 77.3 | 60.8 | 57.7 |
Q1 2019 |
5,623 | 73.7 | 59.3 | 57.1 |
Q2 2019 |
5,493 | 76.9 | 60.5 | 58.9 |
Q3 2019 |
5,337 | 78.3 | 60.2 | 58.0 |
Q4 2019 |
5,248 | 75.0 | 58.4 | 55.8 |
Q1 2020 |
5,202 | 64.2 | 50.1 | 48.8 |
Q2 2020 |
4,858 | 1.5 | 1.8 | 1.9 |
Q3 2020 |
4,980 | 13.0 | 8.6 | 7.4 |
Q4 2020 |
5,205 | 28.9 | 17.6 | 14.6 |
Q1 2021 |
5,115 | 28.7 | 15.9 | 12.2 |
Q2 2021 |
5,196 | 36.7 | 24.0 | 20.5 |
Q3 2021 |
5,121 | 46.1 | 28.1 | 24.0 |
Q4 2021 |
4,902 | 42.6 | 27.6 | 25.0 |
Q1 2022 |
5,187 | 42.1 | 28.5 | 24.2 |
Q2 2022 |
5,177 | 50.3 | 32.1 | 30.8 |
Q3 2022 |
4,580 | 49.3 | 32.1 | 28.3 |
Q4 2022 |
4,617 | 46.8 | 32.5 | 28.2 |
Q1 2023 |
4,807 | 49.1 | 34.3 | 31.0 |
Q2 2023 |
4,751 | 52.5 | 35.8 | 33.4 |
Q3 2023 |
4,770 | 49.8 | 38.7 | 34.1 |
Q4 2023 |
4,662 | 51.0 | 36.3 | 34.0 |
Q1 2024 |
4,688 | 49.5 | 34.2 | 33.8 |
In both the Interview and Diary Surveys, survey response time is defined as the number of minutes needed to complete an interview. For the Diary Survey, the survey response time metric is the median number of minutes to complete the personal interview component that collects household information on income and demographics. For the Interview Survey, the survey response time metric is the median number of minutes to complete the interview. In the Interview Survey, Wave 1 and 4 interviews are typically longer because they collect additional information, mainly household demographics (Wave 1) and assets and liabilities (Wave 4). Survey response time in CE is considered an indicator for objective respondent burden. Presumably, the longer the time needed to complete the survey, the more burdensome the survey. Past internal CE research has found that higher respondent burden negatively affects both response rates and data quality. However, survey response time could also reflect the respondent’s degree of engagement. Engaged and conscientious respondents might take longer to complete the survey because they report more thoroughly or use records more extensively. Regardless, tracking the median survey response time can be useful for assessing the effect of changes in the survey design. More information on the Survey Response time metric can be found in the DQP Reference Guide (Armstrong, Jones, Miller, and Petit, 2024).
Diary Survey Summary
Median Diary Survey response time rose by 2.2 minutes in the past three years, from 32.7 in the first quarter of 2021 to 34.9 in the fourth quarter of 2023 and experienced some additional variation throughout the period (See Chart 8.1).
Median response time fluctuated between 32.7 and 35.1 minutes from the first quarter of 2021 to the second quarter of 2022, before jumping to 38.0 minutes in the third quarter of 2022, and then falling back to 34.4 in the fourth quarter of 2022.
In the most recent year of available data, median response times varied little, falling slightly from 35.3 minutes in the first quarter of 2023 to 34.9 in the fourth quarter of 2023.
Quarter | Number of diary cases | Minutes |
---|---|---|
Q1 2016 |
2,951 | 34.0 |
Q2 2016 |
2,942 | 32.2 |
Q3 2016 |
2,939 | 33.1 |
Q4 2016 |
2,720 | 32.4 |
Q1 2017 |
2,841 | 32.5 |
Q2 2017 |
3,003 | 32.7 |
Q3 2017 |
2,904 | 32.0 |
Q4 2017 |
2,910 | 32.0 |
Q1 2018 |
2,791 | 31.2 |
Q2 2018 |
2,781 | 32.2 |
Q3 2018 |
2,896 | 34.2 |
Q4 2018 |
2,611 | 33.2 |
Q1 2019 |
2,671 | 35.0 |
Q2 2019 |
2,713 | 33.8 |
Q3 2019 |
2,745 | 34.3 |
Q4 2019 |
2,553 | 34.4 |
Q1 2020 |
3,281 | 33.3 |
Q2 2020 |
1,936 | 34.9 |
Q3 2020 |
2,559 | 34.9 |
Q4 2020 |
2,835 | 32.7 |
Q1 2021 |
2,952 | 32.7 |
Q2 2021 |
3,224 | 32.9 |
Q3 2021 |
3,027 | 32.4 |
Q4 2021 |
2,864 | 34.9 |
Q1 2022 |
3,357 | 34.4 |
Q2 2022 |
3,239 | 35.1 |
Q3 2022 |
3,248 | 38.0 |
Q4 2022 |
2,865 | 34.4 |
Q1 2023 |
3,162 | 35.3 |
Q2 2023 |
3,093 | 34.7 |
Q3 2023 |
3,064 | 35.2 |
Q4 2023 |
3,068 | 34.9 |
Interview Survey Summary
Median interview time has increased across all waves over the past three years of data (See Chart 8.2).
In the third quarter of 2022, median interview times rose above the normal range for all waves, following the implementation of Computer Assisted Recorded Interviewing (CARI). This was expected as a similar jump in median time occurred during the pretest of CARI for Wave 4 interview participants in the fourth quarter of 2021.
Median time for Wave 1 interviews fluctuated over the past three years between a low of 76.7 and a high of 88.5 minutes. In the two most recent quarters of data, Wave 1 median interview times fell from 84.8 minutes in the third quarter of 2023 to 81.2 in the fourth quarer of 2023, before rising slightly to 81.8 in the first quarter of 2024.
In the last three years, median time to complete Waves 2 & 3 interviews ranged between 54.6 and 62.5 minutes. Median Waves 2 & 3 interview times expereinced very little varaince in the two most recent quarters of data.
Median time for Wave 4 interviews ranged between 58.8 and 69.5 over the past three years. In the two most recent quarters of data, Wave 4 median interview times decreased, falling from 67.1 minutes in the third quarter of 2023 to 65.5 in the fourth quarter of 2023, and then again to 64.6 in the first quarter of 2024.
Quarter | Number of respondents | Wave 1 | Waves 2 & 3 | Wave 4 |
---|---|---|---|---|
Q1 2016 |
6,421 | 69.9 | 47.8 | 51.9 |
Q2 2016 |
6,336 | 71.4 | 46.9 | 52.6 |
Q3 2016 |
6,367 | 76.9 | 49.0 | 53.9 |
Q4 2016 |
6,297 | 77.0 | 49.6 | 52.8 |
Q1 2017 |
6,202 | 71.3 | 50.2 | 52.9 |
Q2 2017 |
6,163 | 71.5 | 50.5 | 57.2 |
Q3 2017 |
6,081 | 71.5 | 50.4 | 57.1 |
Q4 2017 |
6,003 | 70.5 | 50.0 | 56.4 |
Q1 2018 |
5,910 | 73.4 | 51.5 | 56.2 |
Q2 2018 |
5,894 | 70.5 | 49.6 | 56.4 |
Q3 2018 |
5,771 | 77.0 | 53.8 | 60.3 |
Q4 2018 |
5,570 | 76.7 | 52.0 | 58.6 |
Q1 2019 |
5,618 | 75.8 | 52.8 | 58.8 |
Q2 2019 |
5,486 | 75.9 | 56.4 | 60.3 |
Q3 2019 |
5,332 | 74.1 | 54.1 | 62.8 |
Q4 2019 |
5,239 | 77.4 | 53.3 | 60.9 |
Q1 2020 |
5,199 | 78.8 | 56.0 | 59.9 |
Q2 2020 |
4,855 | 76.4 | 54.6 | 62.2 |
Q3 2020 |
4,980 | 76.9 | 56.7 | 62.2 |
Q4 2020 |
5,205 | 75.0 | 56.3 | 60.4 |
Q1 2021 |
5,115 | 74.4 | 54.6 | 61.7 |
Q2 2021 |
5,196 | 76.7 | 54.6 | 58.8 |
Q3 2021 |
5,121 | 78.0 | 54.6 | 60.0 |
Q4 2021 |
4,902 | 80.3 | 57.8 | 69.5 |
Q1 2022 |
5,187 | 79.6 | 57.7 | 62.8 |
Q2 2022 |
5,177 | 79.2 | 57.7 | 63.1 |
Q3 2022 |
4,580 | 88.5 | 61.8 | 69.2 |
Q4 2022 |
4,617 | 84.1 | 62.0 | 68.2 |
Q1 2023 |
4,807 | 83.9 | 62.5 | 67.7 |
Q2 2023 |
4,751 | 81.0 | 60.0 | 65.6 |
Q3 2023 |
4,770 | 84.9 | 59.7 | 67.1 |
Q4 2023 |
4,662 | 81.2 | 59.6 | 65.5 |
Q1 2024 |
4,688 | 81.8 | 59.7 | 64.6 |
BLS is committed to producing data that are consistently of high statistical quality. As part of that commitment, BLS publishes the DQP and its accompanying Reference Guide (Armstrong, Jones, Miller, and Petit, 2024) to assist data users as they evaluate CE data quality metrics and judge whether CE data fit their needs. DQP metrics therefore cover both the Interview and Diary Surveys, multiple dimensions of data quality, and several stages of the survey lifecycle. Additionally, BLS uses these metrics internally to identify areas for potential survey improvement, evaluate the effects of survey changes, and to monitor the health of the surveys.
Diary Survey response rates have continued a slight downward trend, evident over the available time series, while rates of refusals have generally moved upward. Response rates in the Interview Survey have experienced less fluctuation than the Diary Survey in recent years but have also experienced a general downward trend.
Despite the trends in survey response rates, some of the CE quality metric trends relating to the administration and processing of the CE Surveys have yielded more encouraging results over the past few years of available data. In particular, the rates of records use in the Interview Survey and CE Information Booklet use in both CE Surveys, have trended upward in recent quarters.
Regarding survey processing, the percentage of allocations in the Interview Survey and the Diary Survey expenditure edits have continued to lower. The rate of income imputations experienced little variation for both CE Surveys over the period covered.
With respect to the respondent’s survey experience, median Interview Survey times have begun to decrease across waves, after a jump that followed the implementation of CARI. Theoretically, this should lead to a decrease in survey burden, but respondents’ self-reported levels of burden have seen little variation.
BLS will continue to monitor these trends, and the next issue of the CE Data Quality Profile will be released in May of 2025 as a part of BLS’s midyear release of 2024 CE data. This report will feature CE Diary Survey data through the second quarter of 2024 and CE Interview Survey data through the third quarter of 2024. The upcoming midyear CE Data Quality Profile will also include comparisons to external data sources that collect similar household expenditure data to CE.
Abdirizak, S., L. Erhard, Y. Lee, and B. McBride (2017). Enhancing Data Quality Using Expenditure Records. Paper Presented at the Annual Conference of the American Association for Public Opinion Research, New Orleans, LA.
Armstrong, G., G. Jones, T. Miller, and L. Petit (2024). CE Data Quality Profile Reference Guide. Program Report Series, the Consumer Expenditure Surveys. Bureau of Labor Statistics.
Ash, S., B. Nix, and B. Steinberg (2022). Report on Nonresponse Bias during the COVID-19 Period for the Consumer Expenditures Interview Survey. Published as part of the Consumer Expenditure Surveys Program Report Series. Bureau of Labor Statistics.
Elkin, I., B. McBride, and B. Steinberg (2018). Results from the Incentives Field Test for the Consumer Expenditure Survey Interview Survey. Published as part of the Consumer Expenditure Surveys Program Report Series. Bureau of Labor Statistics.
Fricker, S., J. Gonzalez, and L. Tan. (2011). Are you burdened? Let's find out. Paper Presented at the Annual Conference of the American Association for Public Opinion Research, Phoenix, AZ.
Krishnamurty, P., G. Jones, and B. McBride (2021). Large Scale Feasibility Test Final Report. Published as part of the Consumer Expenditure Surveys Program Report Series. Bureau of Labor Statistics.
Paulin, G., S. Reyes-Morales, and J. Fisher (2018). User's Guide to Income Imputation in the CE. U.S. Bureau of Labor Statistics.
Wilson, T. J. (2017). The Impact of Record Use in the CE Interview Survey. CE Survey Methods Symposium. Bureau of Labor Statistics.
[1] The Office of Management and Budget has oversight over all Federal surveys and provides the rules under which they operate. See the Federal Register notice for more details.
[2] Standard errors are also available in the CE LABSTAT database, as of 2022.
[3] Instructions on using the CE PUMD to create variables and flags for quality analysis can be found in the CE PUMD Getting Started Guide.
[4] More information may be found on the CE Frequently Asked Questions (FAQ) page.
[5] More information on cost containment measures that impacted CE data collection can be found in the ‘Summary of cost containment measures’ section of the 2023 DQP Reference Guide.
[6] A “Type-A” case outcome refers to eligible households that resulted in non-interviews. Detailed definitions of CE final disposition codes can be found in the “Final disposition rates of eligible units” section of the 2023 DQP Reference Guide.
[7] More information on cost containment measures that impacted CE data collection can be found in the ‘Summary of cost containment measures’ section of the 2023 DQP Reference Guide.
[8] See the ‘Summary of cost containment measures’ section of the 2023 DQP Reference Guide for specifics on how these measure impacted CE data collection.
[9] The In the Interview Survey, each family in the sample is interviewed every 3 months over four calendar quarters. These interviews are commonly referred to as waves. For more information on survey administration please see the CE handbook of methods.
[10] The “Did not use” category does not include records where there was no Information Booklet available.
[11] The CE Redesign Project was launched to research and develop a redesign of the Consumer Expenditure (CE) surveys, addressing issues of measurement error and respondent burden.