• The development of the PISA 2009 reading tasks was co-ordinated by an international consortium of educational research institutions contracted by the OECD, under the guidance of a group of reading experts from participating countries. Participating countries contributed stimulus material and questions, which were reviewed, tried out and refined iteratively over the three years leading up to the administration of the assessment in 2009. The development process involved provisions for several rounds of commentary from participating countries, as well as small-scale piloting and a formal field trial in which samples of 15-year-olds from all participating countries took part. The reading expert group recommended the final selection of tasks, which included material submitted by 21 of the participating countries. The selection was made with regard to both their technical quality, assessed on the basis of their performance in the field trial, and their cultural appropriateness and interest level for 15-year-olds, as judged by the participating countries. Another essential criterion for selecting the set of material as a whole was its fit to the framework described in Volume I, What Students Know and Can Do, to maintain the balance across various categories of text, aspect and situation. Finally, it was carefully ensured that the set of questions covered a range of difficulty, allowing good measurement and description of the reading literacy of all 15-year-old students, from the least proficient to the highly able.

  • PISA is a collaborative effort, bringing together scientific expertise from the participating countries, steered jointly by their governments on the basis of shared, policy-driven interests. A PISA Governing Board on which each country is represented determines, in the context of OECD objectives, the policy priorities for PISA and oversees adherence to these priorities during the implementation of the programme. This includes the setting of priorities for the development of indicators, for the establishment of the assessment instruments and for the reporting of the results. Experts from participating countries also serve on working groups that are charged with linking policy objectives with the best internationally available technical expertise. By participating in these expert groups, countries ensure that the instruments are internationally valid and take into account the cultural and educational contexts in OECD Member countries, the assessment materials have strong measurement properties, and the instruments place an emphasis on authenticity and educational validity. Through National Project Managers, participating countries implement PISA at the national level subject to the agreed administration procedures. National Project Managers play a vital role in ensuring that the implementation of the survey is of high quality, and verify and evaluate the survey results, analyses, reports and publications. The design and implementation of the surveys, within the framework established by the PISA Governing Board, is the responsibility of external contractors. For PISA 2009, the questionnaire development was carried out by a consortium led by Cito International in partnership with the University of Twente. The development and implementation of the cognitive assessment and of the international options was carried out by a consortium led by the Australian Council for Educational Research (ACER). Other partners in this consortium include cApStAn Linguistic Quality Control in Belgium, the Deutsches Institut für Internationale Pädagogische Forschung (DIPF) in Germany, the National Institute for Educational Policy Research in Japan (NIER), the Unité d’analyse des systèmes et des pratiques d’enseignement (aSPe) in Belgium and WESTAT in the United States. The OECD Secretariat has overall managerial responsibility for the programme, monitors its implementation on a day-to-day basis, acts as the secretariat for the PISA Governing Board, builds consensus among countries and serves as the interlocutor between the PISA Governing Board and the international consortium charged with the implementation of the activities. The OECD Secretariat also produces the indicators and analyses and prepares the international reports and publications in co-operation with the PISA consortium and in close consultation with Member countries both at the policy level (PISA Governing Board) and at the level of implementation (National Project Managers). The following lists the members of the various PISA bodies and the individual experts and consultants who have contributed to PISA.