Data-driven Education: How an international school in Colombia is making a measurable difference!! Olga Polyakov Data Analyst Colegio Nueva Granada

Transcription

1 Data-driven Education: How an international school in Colombia is making a measurable difference!! Olga Polyakov Data Analyst Colegio Nueva Granada

2 Agenda / Outline ØIntroduction ØAnalytics Platform - Goals and Implementation ØUse Cases and Value Propositions ØProgress Made (3 Years Later) ØLooking Ahead

3 Colegio Nueva Granada (CNG)

4 Benefits of Data-Driven Approach to Education CNG commitment to an improvement process based in data and information dates back many years. Data Analysis enables educational institutions to: Ø Improve results of individual students Ø Differentiate the learning experience for students Ø Identify Areas for Improvement quickly and create action plans to address them

5 Benefits of Data Driven Approach ØRobust data Ø Multiple parameters Ø Ability to define success in a variety of different approaches Ø Allows for a preponderance of evidence Ønot dependent on a single metric Øallows for a bad year in some metric without impacting overall school perception on quality

6 Benefits of Data Driven Approach ØAbility to demonstrate quality / value-added education using multiple data points ØApplicant volume unaffected by increases in tuition ØIncreased confidence in objective quality ØAs other industries become more data-driven, the community (parents, board of directors) comes to expect it of the school

7 Why seek an Analytical Tool? Ø How can we truly use data to support each student on their journey to excellence? Ø Given the variety of data we gather, how we make the information easily accessible by teachers to answer the questions they pose every day?

8 Goals for Acquiring Analytics Platform

9 Facilitate Continuous School Improvement Ø Monitor achievement levels of student Ø Disaggregate data into a variety of groups (demographics, subjects, teachers, course sections) Ø Merge data from various data sources to allow for more sophisticated analysis Ø Have a more complete and varied data set to inform decisions

10 Accreditation Requirements ØAdvancED standards are very data oriented Ø Monitor curriculum, instruction and assessment and adjust it in response to data from multiple assessments of student learning (Standard 3.2) Ø School leaders monitor and support the improvement of instructional practices of teachers to ensure student success (Standard 3.4) Ø Teachers participate in collaborative learning communities to improve instruction and student learning (Standard 3.5) Ø Engage families in a meaningful way in their children s education and keep them informed of their children s learning progress (Standard 3.8) Ø Grading and reporting are based on clearly defined criteria and represent the attainment of content knowledge and skills and are consistent across grade levels (Stand 3.10)

11 Example of Rigor to Achieve Highest Score on Standard 3.2 Ø Monitor curriculum, instruction and assessment and adjust it in response to data from multiple assessments of student learning (Standard 3.2) ØEvaluation Set Level 4 Criteria: ØUsing data from multiple assessments of student learning and an examination of professional practice, school personnel systematically monitor and adjust curriculum, instruction and assessment to ensure vertical and horizontal alignment and alignment with the school s goals for achievement and instruction and statement of purpose.

12 Analytics Platform Enables Ø Shift Ø Monitoringfor compliance to minimum standards of achievement Ø Informing continuous improvement and student learning

13 Stages of Implementation

14 Implementing Analytics Platform Ø Evaluation (4 months) Ø Compared with Qlikview and Tableau Ø Installation (2 days) Ø Development of Dashboards (ongoing)

15 Implementing Analytics Platform Ø Easier Aspects Ø Installation of software Ø Publishing to Server Ø Connecting to Data Sources Ø Creating the dashboards at different levels of aggregation Ø Our Learning Curve Ø Creating the correct data structurefor Spotfire (since our data is not ALL housed in a database) Ø Training of Staff to use Dashboards ØEarly Adopters ØEverybody Else

16 Applications of Analytics Platform at CNG

17 From the Data Analyst Perspective Ø Ability to easily merge information from different data sources into a single data table ØExamine multiple data points for each student ØLook at trends over time per student ØAllows for easy disaggregation of data by different subpopulations Different data sources merged into one table

18 From the Data Analyst Perspective ØAbility to analyze date in more sophisticated ways. ØEasily explore graphics to find the most compelling one.

19 From the SIS Manager s Perspective ØAbility to design quality control procedures for data in the Student Information System (SIS) ØGoal is to have no Benchmark fields empty in the gradebook. ØDashboard helps us to strategically search for data entry failures in the gradebook.

20 From Staff Perspective ØAbility to quickly find information about groups or individual students in a centralized place ØAbility to visualize information from the electronic gradebook in various ways ØAllows for all staff (teachers and administrators) to pose more sophisticated questions Does grade inflation exist? What are the gender disparities at CNG in a variety of metrics? How have students receiving various interventions improved? How can we identify the students for interventions before they fall too far behind?

21 CNG Staff Reflect on Analytics Benefits

22 CNG Staff Reflect on Impact of Spotfire ØJuan Barragan Skyward (Student Information System) Manager ØNick Kolentse Middle School Social Sciences Department Coordinator ØLina Lopez Middle School Counselor ØShow video here -

23 Three Years Later, What is the Value- Added?

24 As Seen in the Video ØProactively Quality Control our Student Information System ØAllow for all staff to have unprecedented access to a variety of merged data sets for the support of student learning in their job role

25 Examples of Dashboards Available ØGradebook Dashboard ØCommunity Service ØDiscipline Infractions ØStandardized Testing ØAnnual Survey Analysis ØInfirmary Use

26 Opportunities for Expansion

27 Opportunities for Expansion Ø Develop Spotfire Dashboards for more areas of CNG operations Ø Increase comfort of staff with use of webplayer Ø Create dashboards that utilize more of the statistical features of Spotfire Ø Measure the impact of interventions in adjusting the curricular program and improving instructional strategies

28 Conclusions

29 Analytics in Education is Different Ø Concrete Return on Investment not possible to calculate Ø Our investment pays off every time we can ØAnswer an interesting question that was not possible prior to acquiring Spotfire ØWitness teacher teams reflecting on the success of their teaching using data that would previously been difficult to compile.

30 Many Thanks!!! Ø Ø CNG Publications Department TIBCO Now Support Team Questions à please ask now Or later à

31 Example of Initiative to Improve Student Learning Based on Spotfire Dashboard

32 Goal Standardize Benchmarks Across Courses Analytics platform provides robust data to allow increased consistency in the coverage of benchmarks for courses taught by different teachers. Each color represents a teacher

33 Action Standardize Benchmarks Across Courses ØDepartment chairs have been instructed to work with teaching teams to ensure standardized benchmarks in all courses. Awaiting results at the end of S2. The Goal: Each color represents a teacher All Courses Look Like This

34 Colegio Nueva Granada (CNG) ØBi-lingual K4 12 School located in Bogota, Colombia ØProvides dual diploma program (U.S. Stateside and Colombian) ØIn 2012, CNG hired its first data analyst with the goals of increasing the use of data at all levels of the school.