New Framework Helps Statisticians Blend Social Media Data with Traditional Surveys
Researchers have created a unified system for measuring data quality when organizations combine information from social networks, business systems, and sensor networks with traditional surveys. The framework addresses a pressing challenge: as survey response rates drop and costs rise, agencies need reliable ways to verify accuracy when mixing these diverse data sources.
Originaltitel: A Total Error Framework with a Special Focus on Digital Data
Abstract A changing survey landscape with increasing nonresponse rates and survey costs has caused organizations to explore new data sources for statistics production. There is great potential to use new types of data for statistics production, especially when blending them with existing data. We present a total error framework that covers all types of data sources, but our examples focus on digital data. We define digital data to include data from social networks, traditional business systems and Internet of Things. We review and build on existing frameworks for surveys, administrative‐, found‐ and digital trace data. The framework describes steps, concepts and error sources when single‐source or multiple‐source statistics are produced based on digital or survey data. Blending data sources is a vital step in the framework. Furthermore, the unified framework offers terminology to describe and document errors in digital data, aligned with terminology used in the classical Total Survey Error framework. We also provide indicators for evaluating the quality of statistics produced based on single or multiple data sources.