Building a stronger evidence/policy feedback loop through regular and frequent social data time series, Statistics Canada, Canada
Building a stronger evidence/policy feedback loop through regular and frequent social data time series
Kari Wolanski
Acting Director, Centre for Social Data Insights and Innovation, Statistics Canada
The pace of change is accelerating
• Era of “poly crisis”: climate risks materializing, geo-political instability, low productivity, high inflation; lingering effects of the pandemic on society such as polarization, less confidence in institutions, increased crime, growing mental health issues
• Society is at a post-pandemic turning point: thirst for timely and granular data, but also information overload; there is a strong need to make meaning, distill critical insights about what is changing, social statistics need to put emerging issues into historical and relative context
• Demonstrating societal progress is key to confidence in government; departments are calling for better impact assessment tools
Social statistics should
help us to see the big picture; put things into
historical and relative perspective
Pandemic sparked innovation
• “Building back better”: Canada’s Quality of Life framework developed during early pandemic unity and optimism (though policy commitment made prior to pandemic)
• Canadian Social Survey (CSS): pandemic provided a strong impetus for timely data; quarterly omnibus survey introduced
• Window of opportunity to understand rapid social change; CSS leveraged to develop a quarterly time series for some Quality of Life indicators
Canada’s Quality of Life framework
• Multi-dimensional well-being: Five thematic outcome domains supported by 84 indicators
• Inclusion: Cross-cutting lens and concurrent investments in disaggregated data to understand distributional differences in well-being
• Sustainability: Cross-cutting lens to bring a long-term perspective, prevention focus
• Budget 2021 funding to: • Fill quality of life data gaps
• Develop a hub to bring together quality of life statistics
6
FOUR TIMES A YEAR…
… a group of civil servants go into the “lock up” procedure in a secure room… When all analysis has been done, the document is approved by a group of top management officials. The report is transmitted to the
adviser of the President of the United States… This procedure is followed every quarter…. The following morning the report is made public… The media report the results almost instantly, politicians
comment,…investment decisions are considered….”
-- Hoekstra, Rutger; Replacing GDP by 2030: Towards a Common Language for the Well-being and Sustainability Community
Some key indicators have a built-in lag time
Social statistics weren’t really built for monitoring real-time progress
Window of opportunity for quarterly time series
Socio-demographic characteristics
• Age • Gender • Immigration status • Visible minority group • Educational attainment • LGBTQ2+ • Urban / rural
Quality of life indicators • Life satisfaction • Sense of meaning and purpose • Future outlook • Loneliness • Someone to count on • Sense of belonging to local
community • Difficulty meeting financial needs • Perceived mental health • Confidence in institutions
Quarterly time series
Fairness and inclusion lens
Q2 2021 Q1 2024
More Canadians are finding it difficult to meet their financial needs
Source(s): Statistics Canada, Canadian Social Survey, Waves 1-11.
More than one third (37.4%) of Canadians found it difficult or very difficult to meet their financial needs by the end of 2023.
(Difficulty meeting financial needs in terms of transportation, housing, food, clothing, and other necessary expenses.)
0%
20%
40%
60%
Q3 2021 Q4 2021 Q1 2022 Q2 2022 Q3 2022 Q4 2022 Q2 2023 Q3 2023 Q4 2023 Q1 2024
Percent reporting financial difficulty, Canadians aged 15 or older, selected sociodemographic or geographic groups, 2021 to 2024
percentagepercentage
Those who experience financial hardship report lower life satisfaction
13
0%
20%
40%
60%
80%
Q3 2021 Q4 2021 Q1 2022 Q2 2022 Q3 2022 Q4 2022 Q2 2023 Q3 2023 Q4 2023 Q1 2024
Percent reporting high life satisfaction, Canadians aged 15 or older, by experiences of self-reported financial difficulty, 2021 to 2024
Did not experience financial difficulty
percentage
Experienced financial difficulty
14
Young adults reporting lower levels of life satisfaction, racialized people a greater decline
Author: H. Foran Source: CSS, multiple waves
0%
20%
40%
60%
80%
Q3 2021 Q4 2021 Q1 2022 Q2 2022 Q3 2022 Q4 2022 Q2 2023 Q3 2023 Q4 2023 Q1 2024
Percent reporting high life satisfaction, Canadians aged 15 or older, 2021 to 2024 - Racialized group
percentage
Racialized
percentage
Not racialized
Source: Canadian Social Survey, Q3 2021 - Q1 2024
0%
20%
40%
60%
80%
Q3 2021Q4 2021Q1 2022Q2 2022Q3 2022Q4 2022 Q2 2023Q3 2023Q4 2023Q1 2024
Percent reporting high life satisfaction, 2021 to 2024 – Selected age groups
percentage
Ages 65+
Age 25 to 34
15
Early signal re: improving future outlook?
Author: H. Foran Source: CSS, multiple waves
40.0%
50.0%
60.0%
70.0%
80.0%
Q3 2021 Q4 2021 Q1 2022 Q2 2022 Q3 2022 Q4 2022 Q2 2023 Q1 2024
Percent reporting a hopeful future outlook, Canadians aged 15 to 24, 45 to 54, 2SLGBTQ+, and racialized, 2021 to 2024
Selected age groups
Ages 45-54
Ages 15-24
40%
60%
80%
Q3 2021 Q4 2021 Q1 2022 Q2 2022 Q3 2022 Q4 2022 Q2 2023 Q1 2024
Racialized group
Not racialized
Racialized
percentage
Eastern Canada and rural communities generally report higher levels of life satisfaction
16
Source(s): Statistics Canada, Canadian Social Survey, Waves 1-9.
Life satisfaction National average:
51%
Demand for Quality of Life Hub
Concluding thoughts
• It’s fun to design frameworks and pick indicators… but shifting the outcome focus reduces incentives for progress
• Consistent reporting of the same indicators teaches people what to expect and what type of change in the data is meaningful; choreography ensures that data dissemination is linked to decision-making processes and can lead to policy action
• Repeated observations are foundational for impact assessment; decisions about course correction/scale
• When selecting your indicators, it’s equally important to plan your cadence and fund your long-term time series
Friends of the Chair of Social and Demographic Statistics
• Lack of an overarching conceptual framework • Difficulty of modeling social phenomena • Growing demand for data disaggregation and timeliness • Declining response rates and rising survey costs • Tight fiscal environments • Decentralized statistical responsibilities • Low public acceptability for administrative data linkages
Main challenges
57th
session UNSC
Strategic recommendations for strengthened
social and demographic
statistics
55th
session UNSC
Mar ’23- Feb ‘24
Year 2Year 1 Year 3
Mar ’24- Feb ‘25 Mar ’25- Feb ‘26
Building blocks for a conceptual framework for social and demographic statistics
OUTCOMES
TIMEPEOPLE
The fabric, object, and unit of measurement for social
and demographic statistics.
✓ Population stock population flows
✓ Characteristics of individuals (data disaggregation
and other intersectional considerations)
Interactions between individuals which
collectively build up a society.
✓ Family structures ✓ Social connections,
✓ confidence in institutions
Qualitative or compound measures to be assessed
both objectively and subjectively.
✓ Objective: education, health, time use (such as unpaid work, work-
life balance and leisure), employment, income, wealth and
housing, among others
✓ Subjective: well-being, including physical and mental health, learning,
sense of purpose, meaningful work
Geography as an element for analyzing social and demographic statistics
and as a link across themes and domains.
✓ Geographic disaggregation
✓ Geospatial analysis ✓ Small-area estimation
Time as an aid in understanding and
anticipating changes in population, distribution
outcomes and relationships.
✓ Time series to monitor progress
✓ Life perspectives ✓ Age-specific lenses
✓ Cohort-based analyses
RELATIONSHIPS PLACES
21
Thank you! Please stay connected.
%Statistics Canada Website The Daily (released at 8:30 am every weekday) StatsCAN Plus StatsCAN App
Surveys and Statistical Programs Data Service Centres My StatCan
Questions? Contact us: [email protected]
22
%
Statistics Canada – Your National Statistical Agency
Delivering insight through data for a better Canada
- Slide 1: Building a stronger evidence/policy feedback loop through regular and frequent social data time series
- Slide 2: The pace of change is accelerating
- Slide 3
- Slide 4: Pandemic sparked innovation
- Slide 5: Canada’s Quality of Life framework
- Slide 6
- Slide 7
- Slide 8
- Slide 9
- Slide 10
- Slide 11: Window of opportunity for quarterly time series
- Slide 12: More Canadians are finding it difficult to meet their financial needs
- Slide 13: Those who experience financial hardship report lower life satisfaction
- Slide 14: Young adults reporting lower levels of life satisfaction, racialized people a greater decline
- Slide 15: Early signal re: improving future outlook?
- Slide 16: Eastern Canada and rural communities generally report higher levels of life satisfaction
- Slide 17
- Slide 18: Concluding thoughts
- Slide 19: Friends of the Chair of Social and Demographic Statistics
- Slide 20: Building blocks for a conceptual framework for social and demographic statistics
- Slide 21
- Slide 22