The research-policy nexus in social reporting Adding meaning to numbers in social reporting Rob Bijl www.scp.nl Social reporting in Europe Villa Vigoni - March 23 24, 2009
Social reporting Aim = Producing, arranging and ordening of comprehensive knowledge on the life situation of the population Different positions and approaches: how neutral? Statistical neutrality vs. analysis, interpretation and evaluation. Does neutrality or objectivity exist? Statistics Netherlands vs. SCP, universities
Examples: 1. measuring poverty: 4 definitions; range and relativity of poverty concept; outcome is politically sensitive and relevant: increase or decrease of poverty? 2. labour market participation: 3 definitions with different outcomes; are the targets achieved? 3. discrimination: many operationalisations; increase or decrease of discrimination?
Relevance of social reporting Evidence based on empirical data Magnitude, scale of a phenomenon or problem Trends in time Patterns in time: linear or otherwise Differences between population groups Enlighten risk factors and groups at risk Enlighten and recognise social understream Link with policy goals and contexts
What type of knowledge is needed Policymakers usually prefer simple information: one percentage / one number / one outcome, not a range, band width or other subtle distinctions. Seldom thirst for knowledge, aversion to theory Usually wish for control and avoiding political damage Because: policy making = incremental proces (muddling on), not goal orientated Policy making needs simplifying the world Policy making is highly psychological processes >>However, researcher s responsibility is indicating how definite and robust findings are
Aims and motives of gathering knowledge The researcher: looking for the truth Description of reality, explaining changes in phenomena, explaining trends in time, finding risk factors and population groups at risk, historical patterns, testing theory,.. The policy maker, politician: looking for the feasible Justification of own actions, show his moral right, pleasing interest groups, showing society is getting better, Evidence based policy is exceptional
Types of knowledge Description versus explaining reality (forecasting, models, scenarios) What is the influence of policy making on actual situation Positive news: thanks to our policy (self overestimation) Negative news: blame the circumstances (underestimation of own mistakes or lack of vision) Reporting and monitoring is (usually) no policy evaluation! Is in essence descriptive
Reporting usually is no policy evaluation Examples: The Netherlands Emancipation Monitor 2008: 1. Economic independence for women 2. More men fulfil task in caring for children Policy aims will not be achieved in 2012 Not necessarily due to failing policy Other possible causes: economy!
How to bridge the gap? Be humble: policy making is not totally rational process Scientific knowledge is just one piece of information for policy makers Knowledge has to compete with interests, opportunism, strong convictions and believes, fear, pragmatism: scientists are sometimes naive to believe that knowledge is fundamental Knowledge often has a very long incubation period
Dissemination: adding meaning to numbers Writing a report is not sufficient. Be visible, directly and indirectly, be less modest Presentation to high-level officials or minister; press conferences; diner pensant with opinion makers Make yourself invited at the ministry to present outcome and meaning of the report Usual dissemination: conferences, workshops.. Popular (simplified) editions: factsheets Bombarding the media, writing letters to the editor