WSF Wirtschafts- und Sozialforschung Lörsfelder Busch 1 50171 Kerpen Tel: 02237 55742 Fax: 02237 55641 e-mail info@wsf-kerpen.de Analysis of the Effects of LEONARDO DA VINCI Mobility Measures on Young Trainees, Employees and the Influence of Socio-economic Factors Research on behalf of the European Commission Education and Culture Directorate-General Final report from: WSF Economic and Social Research Kerpen, 15 May 2007 Leonardo da Vinci
Brief summary IV Table of contents 0. Preamble 1 I. The LEONARDO DA VINCI II programme development since 2000 3 II. Core survey questions and methods 8 2.1 Survey questions 8 2.2 Method 9 III. Findings of the European survey 14 3.1 Structural data 14 3.1.1 Participant structures 14 3.1.2 The mobility participants motives and preparation 22 3.1.3 Participating countries 23 3.1.4 Mobility projects 26 3.1.4.1 Selection of participants and implementation of the mobility measure 26 3.1.4.2 Preparation of mobility measures 27 3.1.4.3 Implementation of measures 30 3.1.4.4 Subsequent assessment of the stay abroad 33 3.1.4.5 Certification and benefits of the certificate 34 3.1.5 Assessment of participants: Criticism and praise for stays abroad 37 3.2 Effects of mobility on participants 42 3.2.1 Overall effects of Leonardo da Vinci programme 42 3.2.2 Effects on personal, social and professional skills 47 3.2.2.1 Effect on personal development 47 3.2.2.2 Effect on professional skills 48 3.2.2.3 Effect on social development 49 3.2.3 Effects in terms of other dimensions 50 3.2.3.1 Effects by gender 50 3.2.3.2 Effects by age 53 3.2.3.3 Effects by country 54 3.2.3.4 Effects by length of stay 55 3.2.4 Importance of socio-economic background 57 3.2.4.1 Significance of migration background 57 3.2.4.2 Participants origin: town/country 59 3.2.4.3 Parents educational background 59 3.2.4.4 Financial standing and unemployment 61 3.2.4.5 The disadvantaged 63 3.2.5 Sustainability 65 3.3 Analysis of effects results of multivariate evaluations 65 3.3.1 Results of regression analyses summary 67 3.3.2 Influence of participants socio-demographic attributes 68 3.3.3 Influence of preparation for and follow-up of projects and of project implementation and certification 70 IV. Summary and conclusions 75 4.1 Summary of survey findings 75 4.2 General value of mobility experiences and of the LdV programme 80 4.3 Outlook and conclusions 83 WSF study: Impact of the Leonardo da Vinci programme on participants I
Annexes Annexe 1: Method 89 Annexe 2: Model questionnaire 96 Annexe 3: Tables part I 97 Annexe 4: Tables part II 100 List of figures Figure 1-1: Participants in LdV 2000-2006 4 Figure 1-2: Composition of LdV participants 2000-2005 according to target groups in % 5 Figure 1-3: LdV mobility participants 2000-2005 by countries *) 6 Figure 3-1: Participants with a background of migration 15 Figure 3-2: Origin of LdV participants by sector 17 Figure 3-3: Motives for participating in mobility measure 23 Figure 3-4: Countries receiving LdV participants 24 Figure 3-5: Distribution of LdV participants by country of origin and receiving country 25 Figure 3-6: Access conditions to LdV mobility measures 27 Figure 3-7: Quality of implementation of the measure balance of the positive and negative nominations 31 Figure 3-8: Acquisition of practical skills during the placement 32 Figure 3-9: Type of certificates issued (basis: instances with certificate) 35 Figure 3-10: Assessment of the stay abroad 37 Figure 3-11: What participants enjoyed about a stay abroad 38 Figure 3-12: What participants did not enjoy about a stay abroad 39 Figure 3-13: Differences in assessing the placement by men and women What did they like? 40 Figure 3-14 Influence of stay abroad 44 Figure 3-15: Willingness to stay abroad again and improve foreign language skills 46 Figure 3-16: Personal benefits to participants 48 Figure 3-17: Benefits in terms of professional skills 49 Figure 3-18: Benefits in terms of social and cultural skills 50 Figure 3-19: Individual effects of Leonardo da Vinci mobility projects by sex 52 Figure 3-20: Success of Leonardo da Vinci programme projects by country (composite indicator, mean value = 100) 55 Figure 3-21: Correlation between duration of stay abroad and effects 56 Figure 3-22: Effects of mobility projects on previously unemployed persons 63 Figure 3-23: Success rates of seriously disadvantaged persons and all Leonardo da Vinci programme participants 64 WSF study: Impact of the Leonardo da Vinci programme on participants II
List of tables Table 1-1: Development of LdV since the year 2000 3 Table 2-1: Scope of survey and response rates 10 Table 3-1: Participants by age and sex 14 Table 3-2: Financial situation of participants according to sex 16 Table 3-3: Parents educational qualifications 18 Table 3-4: Function of the stay abroad 22 Table 3-5: Training year before the stay abroad 27 Table 3-6: Preparatory measures according to status before the stay abroad 28 Table 3-7: Quality of preparatory measures 29 Table 3-8: Relationship between preparation and assessment of measure 30 Table 3-9: Scope of subsequent assessment measures 33 Table 3-10: Formal benefits of the foreign placement certificate 36 Table 3-11: Acceptance of the certificate by training company or employer 36 Table 3-12: Would participate in a similar measure again? 41 Table 3-13: Current application of skills acquired 45 Table 3-14: Evaluation of overall benefit of mobility projects by sex 51 Table 3-15: Effects on willingness to go abroad and improve language skills 53 Table 3-16: Effects of mobility project on employers of persons with migration background 58 Table 3-17: Evaluation of overall benefit of placement and financial circumstances 62 Table 3-18: Frequency of application of skills acquired by year in which stay abroad commenced 65 Table 3-19: Influence of measures on result variables (grouped) 74 WSF study: Impact of the Leonardo da Vinci programme on participants III
Brief Summary LEONARDO DA VINCI (LdV) is one of the most important European programmes of vocational training. It aims to improve the transnational mobility of young people and to generate innovation in vocational and further training. On behalf of the European Commission, WSF Economic and Social Research has carried out an Impact Analysis of LEONARDO DA VINCI Mobility Measures on Young Trainees and Employees, and the Influence of Socio-economic Factors. From January until March 2007, participants in mobility measures were surveyed. Replies were received from 8,397 people, which is a response rate of 35.2%. This high rate of return, and the huge number of duly completed questionnaires can be considered as generating representative suggestions. During the period 2000-2006, approximately 371,000 mainly young people from all participating countries were able to receive support from the LdV programme in transnational mobility measures. Since the year 2000, the programme has involved mainly trainees and young employees, two groups with account for approximately 65% of all participants in mobility measures. All 27 European Union Member States are joining in the LdV, as well as Turkey, Norway, Liechtenstein and Iceland. Participants in the LdV programme (excluding students) comprise: Young employees 25% Trainees 75% Men 46% Women 54% Almost 18% of all participants have a migrant background. When assessing the effects of migrant status on the impact of the LdV programme, it is important to remember that such participants are not representative of migrants in general. Their parents economic situation is better than that of non-migrant participants, and the parents level of education is higher than average. That means that those participants in LdV coming from a migrant background are privileged and therefore more successful. This type of selectivity should be reduced in future. According to their self-assessment, the participants economic situation was mainly good (26%) or at least acceptable (47%). But a quarter of all participants in mobility WSF study: Impact of the Leonardo da Vinci programme on participants IV
measures report of their unsatisfying economic situation. The economic circumstances of the parents are often worse than those of the participants. Consequently, LdV also involves young people coming from economically disadvantaged parental homes. The percentage of these is 18%, of whom 5% are severely disadvantaged. There is no consistent coherence as regards the socio-economic background of the participants in LdV, and the impact of the measures on them. Attendees with an unfavourable background in economic terms are almost as successful as other participants. Therefore, these groups should also be promoted in future, although they require intensive preparation, and mentoring during their placement. Participants in employment, or in-training prior to their mobility measure, worked mainly in the service sector 12% came from a trades enterprise. Attendees from industry were under-represented, compared to an over-proportional share from tourism and education. Trainees from SMEs were very well represented at 80% of all participants. The under-representation of trade and industry enterprises should be abolished, indicating that greater co-operation on behalf of national agencies and chambers of commerce is essential. For most of the young people (75%), participating in LdV is a notable part of their training and education. Improvements in social and inter-cultural skills, in particular, are being seen as motivation by the participants, as well as better opportunities in the labour market. Our survey indicates that LdV notably appeals to young people who are eager to improve themselves, are courageous and are ambitious as regards learning about their own limits. Presumably, they have more self confidence than average. The overall preparation by participants reached quite a high level: 77% had been trained for their stay abroad. However, in some countries, such as Spain (41%), Italy (32%), and Portugal (43%), preparation was often neglected. The quality of preparation has to be improved, as only 55% of all respondents rated the quality as good or very good. Preparation of the measures has a significant positive effect on their impact and on the vocational development of a participant. So the participating countries have been challenged to improve the extent and quality of preparation. WSF study: Impact of the Leonardo da Vinci programme on participants V
Linguistic, cultural, practical and pedagogical preparations are essential. It is approved to enforce certain parts of the preparation not by the sending facility, but by external carriers. A selection of the best is often the basis for the LdV measure, according to 43% of the respondents. However, it is not possible to determine which criteria were relevant for the home facility, or the sending country when choosing the best, e.g. excellent school grades or special talents. These questions should be examined in a survey among those facilities conducting mobility measures, to ensure that the most eligible people are being promoted and that measures will not be given as a reward. The implementation of mobility measures shows both strengths and weaknesses. Weak points are identified in the organisation (balance of positive and negative impressions in all: 35%), the adequacy of the host facility is rated as moderate (34%), as is the accommodation (33%). In addition, support during the stay abroad, by both the home and the host facility, is seen as critical by the participants (32%). Often, the technical equipment within the training facilities did not match participants expectations (19%). The attendees also wanted greater influence on issues concerning their placement (21%). Therefore, the conclusions are: a more thorough preparation of the placements to include the participation of the attendees a meticulous selection of the receiving facilities, and more and improved mentoring during the mobility measure, both by the home facility and especially by the receiving institution. Nevertheless, the participants rated their stay abroad extremely positively: 53% said they liked it very much, while an additional 34% appreciated it, i.e. 87% were satisfied. There is no difference according to gender or migration status. As a positive experience, participants refer, in particular, to improving their language skills (75%), the chance of going abroad (64%), gaining new impressions (72%), knowledge of other lifestyles (68%), and inter-cultural exchange (65%). Issues to be improved include activities during the measure that lead to more exchange between the participants and the population of the host country. This could also foster the impact of the measures concerning tolerance towards foreigners. The participants personal, social and vocational competences have been significantly improved by the measures. Adaptability has been enhanced (73%), as has the ability to interact with other people (72%), knowledge of the host country (71%), and the WSF study: Impact of the Leonardo da Vinci programme on participants VI
ability to manage new challenges (70%). The placement was also able to help participants gain more self confidence (70%). Inter-cultural competences and the understanding of other cultures also improved (66%). Less dominant but certainly noteworthy are the impacts on the vocational competences themselves: use of modern information and communication tools (41%), or acquisition of vocational techniques (52%). The benefits for employers are considered to be slightly less than those for the individuals. Nevertheless, the impact on vocational competences and the benefits for the employer improve with the length of stay, i.e. if the stay exceeds six months. Short-term stays (under six months) contribute more to the individual and social competences, and longer stays also increase the benefits for the employer significantly. Therefore, a two-phase model seems to be ideal, with a first period of approximately three months improving personal and social skills, followed by a second period (six to 12 months) focusing on vocational techniques in detail. Further impacts of mobility on the participants included: Unemployed who found jobs, or are self-employed after the measure 58% Among people who were employed prior to the measure: Found better work placement 27% Professional advancement 24% Attained a higher income 21% Achieved greater responsibility in the workplace 34% People in initial vocational training: Found work placement after training 36% Found work/training placement in another country 32% Better success in training 37% More intense participation in training 41% In general, the mobility measures of the LEONARDO programme are of a high quality. This is also supported by the fact that 77% of the participants would definitely take part in another measure of a similar kind. There is no difference according to gender or migration status on this question. WSF study: Impact of the Leonardo da Vinci programme on participants VII
LEONARDO measures in particular strengthen so-called soft qualifications, such as individual initiatives, team play, and cultural and individual openness towards new developments and changes. Part of the survey also covered the sustainability of the LdV measures, which is rated as very high: 86% of all former participants are interested in another stay abroad, or a professional life in another country, while 83% are willing to improve their language skills, and are steadily making use of their acquired competencies and techniques. Vocational skills gained during the mobility measure pay off during the vocational career. There is a positive coherence between training and education, and the vocational career, higher income, and gaining individual and socio-cultural qualifications. LdV measures cannot compensate for differences that existed between the participants prior to the actions, but they further also persons with lower qualifications and disadvantages converging privileged groups. In order to foster the European context and a better understanding of the population, and to get rid of resentment towards foreigners, certain structures within the receiving countries should be revealed. An over-proportional quota of participants head for English-speaking countries, which is simply attributable to the universal role of the English language. Therefore, measures should be implemented to improve the ability of participants to communicate in other countries, too. This is another argument in favour of the Member States furthering the learning of a second foreign language in academic and vocational schools. The acceptance of training certificates by (potential) employers has to be improved. There should be a certificate for all participants that is generally accepted as valuable in vocational and further training, which at least provides the employer with detailed information as to which competencies and techniques were acquired by the mobility measure. The impact analysis of the programme should be enhanced as well. To date there is only a limited means of ascribing certain impacts to definite measures. A long-term survey on that issue is missing. In addition, there should be a comparison group analysis to obtain scientific data on the real impact on the participants, as well as the effectiveness and efficiency of the programme. WSF study: Impact of the Leonardo da Vinci programme on participants VIII
For the period 2007-2013, within the framework of the European Social Fund (ESF) there will be considerable funding available for transnational measures that potentially substantially exceed the LEONARDO budget. Therefore, national agencies should seek advanced co-operation and adjustment with ESF fund coordinators, on the one hand to implement synergies approaching joint target groups, and on the other hand to avoid useless competition, e.g. because the ESF is offering better financial conditions. These coordinated activities could also be used to implement the two-phase model described above. The basic principles and essential mechanisms of the programme do not demand change, and should not be changed. Improvements should be implemented to further the accessibility for disadvantaged participants, the preparation of measures, certification and, to a degree, the organisation of placements in the receiving facilities. WSF study: Impact of the Leonardo da Vinci programme on participants IX
0. Preamble The LEONARDO DA VINCI (LdV) programme is one of the most important European programmes for increasing collaboration in the field of vocational training. It aims to improve the transnational mobility of young people in education and to generate innovation in vocational and further training. It is intended to help further the aims of the Lisbon Strategy and Copenhagen Process and to raise European awareness among its citizens. In November 2006, the WSF Economic and Social Research was appointed by the European Commission to investigate the topic Analysis of the Effects of LEONARDO DA VINCI Mobility Measures on Young Trainees, Employees and the Influence of Socioeconomic Factors. The subject of the investigation was a survey of those in initial vocational training and young employees on the LdV programme. Between January and March 2007, an on-line survey was carried out among participants in mobility measures in 2004 and 2005. The survey was conducted in all 31 participating countries of the LdV II programme with the exception of Austria, Malta and Ireland it covered 28 of the 31 participating countries. Replies were received from 8,397 people, equivalent to a response rate of 35.2%. This rate is high for e-mail and/or postal surveys. It confirms that the survey met with a good response from former mobility participants, while there are considerable differences between the participating countries cf. Section 2.2 for details. The highest response rate came from Latvia at 60.4%, the lowest from Greece at 15.5%. Overall, response rates might have been even higher as it can be presumed that for some of the participants an e-mail address was set up by the sponsoring organisation for the specific mobility measure, but that this mailbox was no longer in use after the measure. The high response rate, as well as the large number of completed questionnaires and the additional weighting (cf. Section 2.2), ensure that representative statements, i.e. generalisations, can be generated from the survey. The report is composed as follows: In Chapter I a brief summary is given of developments in the LdV II programme since it began in 2000. Then Chapter II explains the central survey questions and the methodology used in the study. WSF study: Impact of the Leonardo da Vinci programme on participants 1
In Chapter III the results are described and analysed. Chapter IV contains a summarised assessment of the effects of the LdV II programme mobility experiences on the participants against the background of their socio-economic and socio-structural backgrounds, and the conclusions drawn from the findings. WSF study: Impact of the Leonardo da Vinci programme on participants 2
I. The LEONARDO DA VINCI II programme development since 2000 The LEONARDO DA VINCI (LdV) programme is the European Community s central action programme for promoting and improving European collaboration in the field of vocational training and increasing transnational mobility. It promotes mobility projects and innovative pilot projects. The target groups of these mobility projects are, primarily, those in initial vocational training, young employees, unemployed people, people in further education, students and trainers. The LdV programme contributes to both the Lisbon Agenda (modernisation of training systems in Europe) and the Copenhagen Process (development of an efficient European labour market). In addition, like other transnational EU programmes such as, for example, the Youth Action Programme, the EQUAL Community Initiative or the European Social Fund (ESF) it is intended to promote the European unification process, reduce xenophobic trends and increase inter-cultural skills. The first phase of LdV ran from 1995 to 1999; the second phase began in 2000 and ended in 2006. Since 2007, LdV has been integrated into the Lifelong Learning programme. Between 2000 and 2006, around 371,000 mainly young people were supported by the programme in transnational mobility measures in all of the participating countries. Furthermore, approximately 2,000 projects were conducted to improve structures and methods in vocational training. The total programme funding between 2000-2006 was approximately 1.32 billion. Table 1-1: Development of LdV since the year 2000 Year 2000 2001 2002 2003 2004 2005 2006 Total Mobility (million ) 69.1 71.8 76.9 83.6 107.9 127.8 155.6 * 692.7 * No. of mobility participants 36,600 37,500 41,500 45,700 58,380 67,000 84,500 * 371,180 * Innovative projects (mill. ) 80.9 82.3 89.7 91.7 109.2 86.3 87.1 * 627.2 * No. of innovative projects 235 255 279 278 345 297 300 * 2.020* * Forecasts Source: European Commission - Education and Culture Directorate-General: LEONARDO DA VINCI programme: Review and Findings, 2006 Above all, with regard to its mobility element, LdV has improved in performance in recent years. While there were around 36,600 mobility participants in 2000, in 2006 WSF study: Impact of the Leonardo da Vinci programme on participants 3
there were more than twice as many with 84,500. Likewise, the number of innovative projects increased from 235 in 2000 to approximately 300 in 2006 (cf. Table 1-1). Figure 1-1: Participants in LdV 2000-2006 84,500 67,000 58,400 36,600 37,500 41,500 45,700 2000 2001 2002 2003 2004 2005 2006 Source: European Commission - Education and Culture Directorate-General: LEONARDO DA VINCI programme: Review and Findings, 2006 * Estimated values for 2006 Table 1-1 also shows that over the years there has been an increase in the funds provided for mobility projects, in particular. The budget here has more than doubled from 69.1 million in the year 2000 to about 155.6 million in 2006. This means that the LdV programme has made a significant contribution to the promotion of transnational mobility in Europe. It should be pointed out that LdV provides substantial support for national programmes to promote transnationality and in part represents the only relevant programme for improving the mobility of young employees and trainees in the participating countries. Since the year 2000, the LdV programme has primarily reached those in initial vocational training and young employees (including unemployed people and those in further training). These two groups together make up just under two-thirds (65%) of all mobility participants, the student group comprises approximately 21%, and trainers, etc. 15% (cf. Figure 1-2). WSF study: Impact of the Leonardo da Vinci programme on participants 4
This composition allows for the fact that although there are many EU and national programmes to promote transnational mobility for students, there are fewer equivalent opportunities for those in initial vocational training and young employees. Figure 1-2: Composition of LdV participants in 2000-2005 according to target groups, in % 47.0 17.8 20.5 14.7 Trainees Young employees Students Trainers, managers Source: European Commission - Education and Culture Directorate-General: LEONARDO DA VINCI programme: Review and Findings, 2006 All 27 EU Member States as well as Turkey, Norway, Liechtenstein and Iceland are taking part in LdV. The participants from 2000 to 2005 are distributed between these countries as shown in Figure 1-3. The division of participants into countries of origin is largely in line with the population ratios in those respective countries. Just under half (48.7%) come from four EU Member States: Germany, France, Italy and Spain. It is also striking that Poland is already in fifth place as regards frequency of participation. In relation to the target groups which form the focus of the survey in other words, those in initial vocational training and young employees (including unemployed people and those in further training) the additional structural data of participant statistics kept by the European Commission is as follows (Basis: 2004) 1 : Young employees 25% 1 Evaluation of statistics from EU Commission which were made available to the WSF. This data is partially unavailable for all countries. As the details for the individual years are not always comprehensive, the year 2004 was used as a base year. The most complete information should be available for this year (2004). The fact that the proportion of women in the mobility measures is over 50% cannot be attributed to a possibly distorted survey WSF study: Impact of the Leonardo da Vinci programme on participants 5
Those in initial vocational training 75% Men 46% Women 54% Under 18 years 16% 18 to 21 years 48% 21 to 25 years 20% 26 years and over 16% Figure 1-3: LdV mobility participants 2000-2005 by countries * Germany 18.3% 52,689 France 10.8% 31,145 Italy 10.0% 28,879 Spain 9.6% 27,734 Poland 6.3% 18,097 Great Britain 5.6% 16,179 Netherlands 5.1% 14,736 Austria 3.2% 9,152 Czech Rep. 2.8% 8,117 Greece 2.8% 7,995 Sweden Hungary 2.2% 2.2% 6,422 6,361 Participants in 1000s Romania 2.0% 5,726 Portugal 2.0% 5,712 Finland 1.9% 5,5 Belgium 1.9% 5,359 Turkey 1.8% 5,134 Bulgaria 1.7% 4,813 Denmark 1.4% 4,169 Slovakia 1.4% 4,079 Norway 1.2% 3,555 Lithuania 1.2% 3,407 Ireland 0.9% 2,669 Latvia 0.9% 2,604 Slovenia 0.8% 2,375 Estonia 0.6% 1,694 Malta 0.4% 1,235 Iceland 0.4% 1,018 Cyprus 0.3% 0,778 Luxembourg 0.2% 0,528 Liechtenstein 0.1% 0,227 Source: European Commission - Education and Culture Directorate-General: LEONARDO DA VINCI programme: Review and Findings, 2006 * Country-specific data for 2006 are not yet available response. According to the statistics from the European Commission, this proportion is actually 54%, i.e. women are over-represented, and this was taken into account in the weighting cf. Chapter 2.2. WSF study: Impact of the Leonardo da Vinci programme on participants 6
It is noticeable that young women are over-represented among LdV mobility participants. Furthermore, approximately two-thirds of all participants are under 21 years old. Namely, in the first instance the LdV programme reaches comparatively young people in initial vocational training or work, as well as young women, too. WSF study: Impact of the Leonardo da Vinci programme on participants 7
II. Core survey questions and methods 2.1 Survey questions The survey at the beginning of 2007 of young employees and trainees who signed up for mobility projects under the LdV programme in 2004 and 2005 focused on the following core questions 2 : Personal development in terms of: a) key skills acquired b) professional development at work and access to employment c) social development (socio-cultural skills in general such as lifelong learning, networking, active involvement) Against a background of: d) different fields of work and employment/training sectors e) the level of education (e.g. early school leavers, secondary education or higher) f) type of training (e.g. vocational, full-time academic training, training in sandwich courses, etc., and the ratio of theoretical to practical training) g) status/position h) type of enterprise (e.g. small enterprise, large enterprise, etc.) The survey was also designed to: i) give an overview of the socio-economic situation of the young people in question j) determine other external factors, in addition to background, that influence participants mobility k) establish the correlation between success factors and participants socio-economic background l) create a statistical basis for indicators on socio-economic background, sex, type, level and year of training and field of employment, and influence on personal, vocational and social development. 2 Aim of survey in accordance with European Commission s Terms of Reference WSF study: Impact of the Leonardo da Vinci programme on participants 8
As achieving lasting effects is one of the main objectives of the LdV programme, the survey was carried out among participants whose stay abroad had been completed some time previously (generally between 12 and 24 months), so as to be able to establish if and to what extent behavioural changes occurred following their stay abroad (e.g. acquisition of or improvement in foreign language skills, repeat stays abroad, etc.). The complete version of the questionnaire used can be found in the annexe to this report. 2.2 Method 3 The survey was designed to map the effects of the LdV programme and the socioeconomic background of participants from all participating countries as fully as possible. The survey was conducted electronically (i.e. by e-mail). Addresses were available for a total of 29 participating countries (excluding Austria and Malta and with only 11 for Ireland); as a result, 28 countries were included in the survey. E-mails were sent out in January and February 2007 to all participants whose e-mail addresses were available, advising them about the survey in their own language and asking them to reply to the questionnaires (also translated into their own language) on-line 4. Participants who had not completed all or some of the questionnaire by March 2007 were sent a follow-up e-mail. The response rate to the survey was highly satisfactory overall, with approximately 36% of correspondents completing the questionnaire. Table 2-1 shows the response rate by participating country and number of e-mail addresses available: 3 4 A differentiated description of the methods used is included in the annexe. The survey was conducted by post in Germany. WSF study: Impact of the Leonardo da Vinci programme on participants 9
Table 2-1: Scope of survey and response rates e-mails sent valid e-mail addresses number of replies response rate (%) Belgium 197 153 58 37.9 Bulgaria 726 563 158 28.1 Cyprus 175 136 30 22.1 Czech Republic 1,314 1,018 443 43.5 Denmark 456 353 102 28.9 Germany by post 3,850 1,150 29.9 Greece 676 524 81 15.5 Spain 3,811 2,954 1,281 43.4 Estonia 160 124 53 42.7 Finland 180 140 50 35.7 France 155 120 49 40.8 Hungary 988 766 283 36.9 Ireland 14 11 0 0.0 Iceland 68 53 19 35.8 Italy 3,387 2,625 1,304 49.7 Liechtenstein 23 18 7 38.9 Lithuania 683 529 234 44.2 Latvia 342 265 160 60.4 Luxembourg 46 36 16 44.4 The Netherlands 264 205 72 35.1 Norway 956 741 210 28.3 Poland 3,785 2,933 882 30.1 Portugal 318 246 134 54.5 Romania 692 536 226 42.2 Slovakia 280 217 42 19.4 Slovenia 198 153 44 28.8 Sweden 822 637 120 18.8 Turkey 3,431 2,659 878 33.0 UK 1,645 1,275 311 24.4 Total 25,792 23,840 8,397 35.2 Total excl. Germany 25,792 19,990 7,247 36.3 Source: WSF Survey of Leonardo da Vinci participants conducted in 2007 on behalf of the European Commission There is no clear trend in response rates. It was neither higher nor lower among participants from new and old Member States while, on a north/south basis, the response rate was above average among participants from southern Europe (Portugal, Italy and Spain), with the exception of Greece which had the lowest response rate other than Ireland, for which only 11 valid addresses were available. Some of the lists of participants' addresses provided by the national agencies were incomplete - i.e. there were no e-mail addresses for some of them. Therefore, the responses had to be weighted. The results of the survey were weighted on the basis of the base data on participants for 2004 and 2005 provided by the European WSF study: Impact of the Leonardo da Vinci programme on participants 10
Commission 5, by comparing the expected distribution between the participating population with the actual distribution of responses. This exercise was repeated for each individual participating country, using the following weighting factors: sex status (those in initial vocational training and/or young employees) age (under 18, 18 to under 21, 21 to under 25, and 25 years and older). Finally, the replies were projected on the basis of the distribution of the number of participants between the individual participating countries in 2004 and 2005. The following points are important in relation to the method applied: The addresses available for participants from the Netherlands, the UK and France are clearly only based on information from a few individual promoters and were therefore only partially representative; The addresses provided by the national agencies included accompanying persons who were not supposed to be surveyed. As their status was not obvious from the addresses, they were included in the e-mail survey (approximately 500 replies) 6 ; As a result, the annexe to this report contains two sets of tables of weighted results 7. The first set does not include accompanying persons. In addition, in the first set, all countries from which there were fewer than 100 responses (Belgium, Cyprus, Greece, Estonia, Finland, Iceland, Liechtenstein, Luxembourg, Slovakia, Slovenia) plus the three aforementioned countries (the Netherlands, the UK and France) for which there was a below-average number of addresses, were grouped under one category in the table headings. The second set of tables includes accompanying persons, and all the countries are covered in the table headings. For this reason, only the data from the first set of tables in the annexe were used to evaluate the programme and make comparisons between the various countries. As the data are weighted, both the percentages and the absolute numbers of cases are reported in the tables as unweighted values, the former being based on weighted cases. In other words, it is possible from the absolute number of cases reported to estimate the number of cases 5 6 Complete data on participants by status, age and sex were only available from European Commission statistics for 2004 and were used as reference weights for the purposes of projection. Values for 2004 and 2005 were used for the distribution between participating countries. It was agreed with DG Education and Culture that people who were in work before and after the project and whose stay lasted a maximum of nine weeks would qualify as accompanying persons. WSF study: Impact of the Leonardo da Vinci programme on participants 11
on which the conclusions are based and therefore the degree to which these values are representative. The information in the tables in the annexe has been reported on the basis of the following criteria (heading variables): status before the mobility project (in initial vocational training, in work, unemployed, in continuing training) age sex country of origin year of participation migration history overall benefit of stay abroad willingness to move in future plans to acquire further foreign language skills willingness to participate in another stay abroad participants financial situation length of stay abroad As the only information available on participants was their e-mail addresses (i.e. there was no information available on their age, sex, status, etc.), it was impossible to carry out a failure analysis of response behaviour (i.e. to establish if the response quota was higher among women or older participants) or to check if the addresses supplied to us by the national agencies were truly representative. Only in Germany can it be assumed with any degree of certainty that the response rate was representative, as all mobility programme participants were surveyed. Nonetheless, the results established are highly plausible and coincide in many cases with the findings for German Länder. In other words, we can assume that the (weighted) results established reliably reflect the actual situation. In our experience, a larger number of individual questions are left unanswered (missing values) in e-mail surveys than in face-to-face or postal surveys, especially if (as with our questionnaire) there is a very large number of questions. As a result of this, some respondents stopped answering the questions towards the end of the questionnaire (approximately one-quarter, cf. detailed description of methods in 7 As the tables are approx. 500 pages long, they have only been provided in electronic format on CD-ROM. WSF study: Impact of the Leonardo da Vinci programme on participants 12
the annexe). We therefore decided to apply an imputation procedure in order to estimate the missing values. This procedure is current practice and is described in detail in the annexe. The advantages of this are that, first, imputation does not alter the overall results and, secondly, the total number of cases can be used for multivariate analyses. In simple terms, imputation means that when certain questions have been left blank in one case, another case is sought in which the questions answered are similar and the information from that case is then transferred to the fields with blank values in the incomplete questionnaire 8. The core aim of the study was to establish the effects of mobility projects on participants. In theory, this type of effect assessment can be carried out either using a panel model (with a before/after comparison) or as part of a control group analysis 9 (whereby the identified effects on participants, such as their willingness to move in future, is compared to the value applicable to non-participants, i.e. by investigating the counter-factual question of what would have happened had the person not participated in the mobility project). As a panel approach was impractical (the people surveyed had already taken part, so no information was available on their situation prior to their participation in the project), a control group analysis would have been the only feasible way forward. However, such a procedure is extremely time-consuming (and consequently expensive) and was therefore not an option within the context of this study. This means that the survey data available must be interpreted cautiously when speaking of effects. For example, there is no unequivocal answer to the question of whether the marked degree of willingness on the part of former participants to acquire further foreign language skills is a result of the mobility project or if it is because large numbers of participants with an above-average affinity for foreign languages join the LdV programme. These limitations must be borne in mind when evaluating the results. 8 9 Schafer, J (1999): Multiple imputation: A primer, in: Statistical Research in medical research, S. 3-15, Arnold, 1999. For method, cf. for example Fertig Michael; Friedrich Werner et al.: Evaluation of the recommendations of the Hartz Commission on labour market policy, Cologne/Essen 2003. WSF study: Impact of the Leonardo da Vinci programme on participants 13
III. Findings of the European survey 10 3.1 Structural data 3.1.1 Participant structures As already mentioned in Chapter II, participants in mobility measures for those in initial vocational training and (young) employees in the Leonardo da Vinci programme are disproportionately frequently female. The evaluation of the (weighted) details of those surveyed 11 regarding essential socio-economic structural data revealed the following: 54% of participants are female, and 46% male. An above-average number of women participate in the following countries: Denmark (61%), Lithuania (60%), Sweden (71%), Latvia (61%). On the other hand, men are only over-represented in Turkey (74%) and Bulgaria (54%). Notably, the high proportion of men in Turkey is striking. The majority of participants are between 18 and 25 years old (61%), only 13% of participants were under 18 years of age, and around 27% were 25 years of age or older. Particularly high proportions of older participants are observed in Italy (33%), Romania (37%) and Bulgaria (39%). In particular, under-18s from the Czech Republic (20%), Hungary (23%), Denmark (22%), Italy (22%), Romania (39%), Turkey (38%) and Bulgaria (46%) participate frequently. Table 3-1: Participants by age and sex Age (in years) In total under 18 18-21 21-25 over 25 Women 50% 57% 51% 55% 54% Men 50% 43% 49% 45% 46% In total 100% 100% 100% 100% 100% Source: WSF LdV Survey 2007 Before the stay abroad, 74% of participants were in initial vocational training, 13% were gainfully employed and 12% were either in further training (6%) or unemployed (6%); (1% had another status). Only Italy has high proportions of unemployed people, at 10%. The following countries focus particularly strongly on young people in initial training: Germany (84%), Czech Republic (85%), Denmark (95%), Lithuania (84%) and Poland (85%). 10 11 The central findings of the survey are described in this chapter. Annotation of all the detailed findings, e.g. by country of origin, would fall outside the scope of this report as the table material alone comprises approximately 400 pages. These details can be found in the tables in the annexe. Without accompanying persons; in the selected text section findings are also shown in table form and in figures; the complete tables with all details are in the annexe. WSF study: Impact of the Leonardo da Vinci programme on participants 14
Of the participants who were in (initial) vocational training, only 8% completed business training, while only 48% had received school education and 44% had taken part in training both in a company and at school. In these cases, 48% of the training took place at school and 52% in the company. In the first instance, dual training takes place in Germany (68%), Denmark (46%), Lithuania (41%) Romania (48%) and Sweden (47%). Just under 18% of all participants had a migrant background. This proportion is particularly small in Germany (13%). A disproportionately large number of people with a migrant background come from the Netherlands (32%), the UK (30%), Denmark (25%), Sweden (25%) and France (32%). Comparatively high proportions are also found in the new Member States. Figure 3-1: Participants with a migrant background Poland Portugal Turkey Czech Republic Spain Germany Norway Latvia Italy Bulgaria Belgium Estonia Lithuania Finland Sweden Romania Greece Hungary Denmark Great Britain Netherlands France 7% 9% 10% 12% 13% 13% 13% 13% 14% 14% 15% 15% 17% 18% 18% 19% 20% 22% 25% 30% 32% 32% Source: WSF LdV Survey 2007 Further information which might explain the somewhat surprisingly high proportions of participants with a migrant background from the new eastern European Member States for example, 22% in Hungary is not available 12. 12 This may be partially explained by the fact that the parents of some of these young people emigrated during the Communist era and returned after the changeover. Consequently, the participants may have been to school abroad, for example, or were born there. WSF study: Impact of the Leonardo da Vinci programme on participants 15
The duration of the mobility stay was less than two months in 49% of the cases; 43% of participants stayed abroad for between two and six months, while only 7% were away for longer. The level of participants education at the time of the survey, i.e. after their stay abroad is comparatively high. Only 15% had not (yet) completed any vocational training, 8% had a vocational diploma from a training enterprise, 25% had a school vocational training qualification, 16% had a diploma from a technical college, 16% had a polytechnic degree, and 10% a university degree (4% gave no details). The financial situation of the participants was predominantly good (26%) or at least satisfactory (47%). Nevertheless, more than a quarter (27%) of mobility participants reported a poor personal financial situation. In particular, participants from Spain (38%), Hungary (44%) and Italy (39%) frequently assessed their personal financial situation as poor. For a large proportion of participants, their parents financial situation is less favourable than their own. Nonetheless, 31% of those surveyed assessed this as poor, and only slightly more as good (33%), i.e. LdV also reaches young people from financially less privileged homes to a considerable extent. Approximately two-thirds (65%) of young mobility participants receive additional financial support from their parents. Table 3-2: Financial situation of participants according to sex Women Men In total Very good 4% 4% 4% Good 20% 25% 22% Satisfactory 47% 47% 47% Poor 24% 19% 21% Very poor 6% 5% 6% In total 100% 100% 100% Source: WSF LdV Survey 2007 The participants who were gainfully employed or had completed training in a company (as well) prior to the mobility measure came predominantly from the services sector; 12% of these were employed in a trade or were trained by a trade company. The sectoral distribution of mobility participants is presented in the following Figure 3-2. Participants from the manufacturing industries are under-represented, but the hotel and catering trade are over-represented, as is the educational sector. The structure of the industrial sector, with its low weighting of manufacturing industries or industry, also results in a very strong representation from SMEs. WSF study: Impact of the Leonardo da Vinci programme on participants 16
Employed people and business trainees are distributed across the categories of company size as follows: Up to five employees 21% Six to 19 employees 21% 20 to 49 employees 12% 50 to 99 employees 15% 100 to 199 employees 8% 200 to 499 employees 8% 500 employees or more 15% Figure 3-2: Origin of LdV participants by sector Forestry, agriculture, fishing, mining 6% Manufacturing industries/industry 16% Construction Trade Credit and insurance industries Civil service 6% 6% 4% 6% Hotel and catering industry 15% Health sector 6% Training and education 14% Other services 24% Source: WSF LdV Survey 2007 Companies which are larger than SMEs i.e. those with more than 250 employees (according to the EU definition) only provide around 20% of all participants in mobility measures in the LdV programme, which means that approximately 80% of all participants come from SMEs. A substantial proportion of LdV participants come from family backgrounds where the parents have a knowledge of foreign languages: 46% of fathers and 47% of mothers. These values are considerably higher than the average for the general population. From this it can be concluded that young LdV participants are also encouraged to learn foreign languages by their parents which, in turn, is a prerequisite for participation in the mobility programme. WSF study: Impact of the Leonardo da Vinci programme on participants 17
Furthermore, it has been observed that LdV participants come from family backgrounds where the parents have a comparatively high professional status: 22% of fathers and 18% of mothers have a university or polytechnic degree; 17% of fathers and 23% of mothers have university entrance qualifications; and only 10% of fathers and 9% of mothers do not have a school leaving certificate. This means that although in principle young people s access to LdV measures is not subject to any restrictions in particular, the disadvantaged or those with a migrant background should also be encouraged in some countries restrictions can be observed. This is also seen in the frequently practised "Selection of the best" (cf. Chapter 3.1.4.1 for details on this). Table 3-3: Parents educational qualifications Women Men In total Father No school leaving certificate 10% 10% 10% University entrance qualifications 22% 24% 23% O levels 31% 28% 30% A levels 16% 19% 17% Post-secondary course 21% 19% 20% In total 100% 100% 100% Mother No school leaving certificate 10% 8% 9% University entrance qualifications 22% 21% 22% O levels 31% 34% 32% A levels 20% 19% 19% Post-secondary course 17% 19% 18% In total 100% 100% 100% Source: WSF LdV Survey 2007 The mobility measures mainly take place during training, school or working hours (58%). For 20% of participants, some took place during these hours while others were carried out during the holidays; in fact, 23% had to perform all mobility measures during their holidays. With particular frequency, young people from Hungary (42%), Romania (29%), Sweden (30%), Turkey (42%) and Bulgaria (41%) only travelled during the holiday period. However, there is no significant correlation between the assessment of the stay abroad and the question as to whether the trip was during work, a training period, or the holidays. The trend indicates that participants who did not enjoy the mobility measures were away with even greater frequency, but only during the training or work period. LdV reaches participants from both large and small cities as well as from rural areas equally. On average, in all participating countries 22% come from very large cities (more than 500,000 inhabitants), 23% from large cities (100,000-500,000), 22% from medium-sized cities (20,000-100,000), 18% from small towns (5,000-20,000) and WSF study: Impact of the Leonardo da Vinci programme on participants 18