Assuring Data Quality at the UNESCO Institute for Statistics CCSA Conference on Data Quality for International Organisations

Transcription

1 Assuring Data Quality at the UNESCO Institute for Statistics CCSA Conference on Data Quality for International Organisations Helsinki, Finland, 6 7 May 2010

2 UIS Quality Framework

3 0. Prerequisites of Quality 1990s UNESCO data quality is compromised Evaluation recommends: 1. Autonomous Institute, guaranteed by its own Board 1999: UNESCO Institute for Statistic 2. Relocation from UNESCO Headquarters 2001: move to Montreal Consequences: UIS can do its own resource mobilization UIS can do its own recruitment

4 0. Prerequisites (cont d) Data quality is the first priority in the UIS Medium Term Strategy Internal restructuring: Centralized services for common processes Regional teams (all 6 UN languages) Resource mobilization very successful Domain specialists in main fields of competence: teachers, funding for education, TVET, higher education, data sources, quality of learning

5 1. Assurances of Integrity Developing staff competencies by investing in institutional training: technical competences management Recruitment through competitive process

6 2. Methodological Soundness International standards: International Standard Classification of Education (ISCED) revision in 2011 Statistical Data and Metadata Exchange (SDMX) Framework for Cultural Statistics (FCS) Development of international indicators for monitoring: EFA Global Monitoring Report Indicators on teachers ICTs in education indicators

7 3. Accuracy and Reliability 4. Serviceability Assistance to countries: Workshops (regional, national) Site visits (20+) DQAF diagnostic studies Implementation of Data Plans UIS presence in the field: Cluster and Regional Advisors

8 Objectives: Data Plans describe metadata and specific instructions on how to complete the UIS questionnaires Ensure the comparability and quality of education data Provide essential metadata about national data Provide a clear mapping between national data sources and international data requirements Pre requisite: High level of commitment from countries

9 Data Plans (cont d) Content: Description of national education structure Mapping to international standards and definitions (ISCED) Specific instructions for completing UIS questionnaires Recommendations for improvement from the international reporting perspective

10 Data Plans: Outcomes For countries Collaborative relationships between different reporting authorities Clear instructions for use by current and future ministry staff For everyone Better quality data Essential reference metadata Detailed documentation regarding data sources and definitions (trained teacher in country x) For UIS Improved communication Essential guidelines to insure data quality

11 Objectives: UIS Presence in the Field Assist UIS National Counterparts by becoming a resource person Supporting and facilitating the implementation of the UIS initiatives and programmes Providing technical expertise to the UNESCO offices; Responding to the requests from other partners in the field (UN family, development banks, donors etc.)

12 UIS presence in the field

13 5. Accessibility Renovation of the UIS website (2010): easier access to publication, data and metadata improved lay out of texts, tables and charts Restructuring UIS Data Centre to improve presentation (2011) ISCED mappings published on website

14 UIS Quality Monitoring Performance indicators to assess the timeliness and completeness of: Survey processes (collect and process) Education Database For reporting to stakeholders and donors

15 Completeness C2. Response rate Response rate Countries Gain Loss TOTAL Arab States Central and Eastern East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa

16 Completeness C4. Coverage of key indicators Change between 2007 and 2008 TOTAL Change Arab States Central and Eastern Arab States Central and Eastern East Asia and the Pacific LAC North America and Western South and West Asia Sub-Saharan Africa East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa

17 Completeness C1. Update rate 2008 in relation to target 85% Target TOTAL Arab States Central and Eastern Arab States Central and Eastern East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa

18 T2. Timeliness of data submission Change Absolute change between 2007 and 2008 TOTAL Arab States Central and Eastern East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa Arab States Central and Eastern East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa

19 T4. Timeliness of internal processing Change between 2007 and 2008 TOTAL Change Arab States Central and Eastern Eur ope East Asia and the Pacific Latin America and the Caribbean North Am erica and Western Eur ope South and West Asia Sub-Saharan Africa Arab States Central and Eastern East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa

20 T6. Data freshness Change Change between 2007 and 2008 TOTAL Arab States Latin America and the Caribbean South and West Asia Arab States Central and Eastern Central and Eastern East Asia and the Pacific North America and Western Sub-Saharan Africa East Asia and the Pacific Latin America and the Caribbean North America and Western South and West Asia Sub-Saharan Africa

21 Thank you! For more information: Hendrik van der Pol h.van der Anuja Singh