Publications - Page 2

Five questions to ask if you think teaching problem-solving works. By John Sweller

Every few decades there is a campaign to include general problem-solving and thinking skills in school curricula. The motivation is understandable. Everyone would like our schools to enhance students’ critical thinking and problem-solving skills. Because it is so obviously important for students to have such skills, these campaigns are frequently successful in including thinking and

Read More

Lessons Learned from PISA 2018 Statistics and Other International Student Assessments

2021, Crato, N. (Ed.) Improving a Country’s Education: PISA Results in 10 Countries PISA 2018 was the largest large-scale international assessment to date. Its results confirm the improvements of some countries, the challenges other countries face, and the decline observed in a few others. This chapter reflects on the detailed analyses of ten countries policies,

Assessment Background: What PISA Measures and How

This chapter provides a short description of what the Programme for International Student Assessment (PISA) measures and how it measures it. First, it details the concepts associated with the measurement of student performance and the concepts associated with capturing student and school characteristics and explains how they compare with some other International Large-Scale Assessments(ILSA). Second,

Assessment Background: What PISA Measures and How

This chapter provides a short description of what the Programme for International Student Assessment (PISA) measures and how it measures it. First, it details the concepts associated with the measurement of student performance and the concepts associated with capturing student and school characteristics and explains how they compare with some other International Large-Scale Assessments(ILSA). Second, it provides information on the assessment of reading, the main domain in PISA 2018. Third, it provides information on the technical aspects of the measurements in PISA. Lastly, it offers specific examples of PISA 2018 cognitive items, corresponding domains (mathematics, science, and reading), and related performance levels.

Download the article here.

Five questions to ask if you think teaching problem-solving works. By John Sweller

/

Every few decades there is a campaign to include general problem-solving and thinking skills in school curricula. The motivation is understandable. Everyone would like our schools to enhance students’ critical thinking and problem-solving skills. Because it is so obviously important for students to have such skills, these campaigns are frequently successful in including thinking and problem-solving skill modules in the curriculum. Unfortunately, success in introducing thinking and problem-solving into curricula has not been matched by successful educational outcomes. Across the world, there is a consistent failure to actually improve problem-solving performance. We now know enough about human cognition to know why attempts to teach general cognitive skills such as problem-solving will always fail. Here are a few questions that those advocating for the curriculum to include problem solving in areas such as mathematics might want to consider.

  1. What sophisticated, learnable and teachable problem-solving strategies do you personally use when solving a novel problem? If you cannot describe the strategies you use, what hope do you have of teaching them? At least consider the possibility that there are no learnable and teachable general problem-solving strategies.
  2. Ignoring the problem that no novel, general problem-solving strategies have ever been devised, what evidence is there from randomised, controlled trials that teaching general problem-solving strategies improves problem-solving performance? If, after dozens of years attempting to find a body of evidence for the efficacy of teaching general problem-solving strategies, no such bodies of evidence exist, we must at least consider the possibility that they will never exist.
  3. The relevant randomised controlled trials have been run. Within a cognitive load theory context (Lovell, 2020; Garnett, 2020; Sweller, Ayres and Kalyuga, 2011) dozens of experiments from around the globe have compared learners solving classroom problems as opposed to studying a worked example demonstrating the solution. For novice learners in an area, the results overwhelmingly indicate improved performance by the worked-example group over the problem-solving group. Why? Humans are amongst the very few species that have evolved to obtain information from other members of the species. We are very good at it. We can obtain information by problem solving but it is a slow, inefficient technique. If available, novel, complex information always should be obtained from others during instruction rather than attempting to generate it ourselves.
  4. There is evidence that problem solving can be superior to studying solutions but it only occurs when students are already knowledgeable in the area. They need to practice problem solving. There is no evidence that knowledgeable students are better at solving novel problems outside of their areas of knowledge. Why does practice at solving problems only become effective once we become reasonably knowledgeable in the relevant curriculum area? Cognitive load theory provides an answer that is beyond the scope of this statement (see also Martin and Evans, 2018 ).
  5. Ignoring the lack of evidence from randomised, controlled trials, why do correlational studies on data from international tests consistently demonstrate that the less guidance learners are given when learning, the less they learn? (Note, problem solving is associated with minimal guidance.) (Oliver, McConney and Woods-McConney, 2019; Jerrim, Oliver and Sims, 2019)

As indicated above, cognitive load theory provides one answer to this set of questions. The theory uses our knowledge of human cognition and evolutionary psychology to devise novel instructional procedures. It explains why (a) when dealing with novel, complex problems, studying worked examples is superior to solving the equivalent problems, (b) why solving problems is superior to studying worked examples when levels of expertise have increased in a particular domain, and (c) why attempting to teach non-existent problem-solving strategies, by taking time away from teaching subject matter, reduces students’ performance on international tests.

So, how can we increase problem-solving skill? By increasing domain-specific knowledge. Expecting anyone to engage in sophisticated problem solving and critical thinking in areas where they have minimal knowledge is futile. Lots of domain knowledge allows critical thinking and effective problem solving to occur naturally and automatically. Attempting to teach general problem-solving skills rather than knowledge, does not.

John Sweller is the emeritus professor of educational psychology in the School of Education at UNSW.

 

This article was originally published on EduResearch Matters. Read the original article.AARE