Friday, September 1, 2017

Southeast Polk Instructional Playbook: Effect Sizes

The school year is off to a great start!  Many of you have been working collaboratively, looking at student data, and using the Southeast Polk Instructional Playbook to select instructional strategies that will impact student learning. I have received some questions on the meaning of the effect sizes, so below is some information on how to interpret that information.
John Hattie continually updates his work, and I have also included some information on 'collective teacher efficacy'.  This factor represents our work with PLC's and collaborative teams, and has a tremendous impact on student learning. 
"Collective teacher efficacy refers to a staff’s shared belief that through their collective action, they can positively influence student outcomes, including those who are disengaged and/or disadvantaged."
John Hattie: Effect Sizes
John Hattie developed a way of ranking various influences related to learning and achievement according to their effect sizes. Hattie proposed ‘effect sizes' as the best way of answering the question ‘what has the greatest influence on student learning?' An effect size emphasizes the difference in impact of given approaches for purposes of comparison. An effect size of 0 reveals that the influence had no effect on student achievement. The larger the effect size, the more powerful the influence. Hattie (2009) suggested an effect size of 0.2 is relatively small, an effect size of 0.4 is medium, and an effect size of 0.6 is large.

Hattie found that the average effect size of all the interventions he studied was 0.40. Therefore he decided to judge the success of influences relative to this ‘hinge point’, in order to find an answer to the question “What works best in education?”
Updates to Hattie's Work
John Hattie constantly updates his list. He has first published 138 effects in Hattie (2009) “Visible Learning”, then 150 effects in Hattie (2011) “Visible Learning for Teachers”, and most recently a list of 195 effects in Hattie (2015) “The Applicability of Visible Learning to Higher Education”. His research is now based on nearly 1200 meta-analyses – up from the 800 in Visible Learning (2009). In his latest work, collective teacher efficacy emerged as a highly influential factor with an effect size of 1.57.
"According to the Visible Learning Research, collective teacher efficacy is beyond three times more powerful and predictive of student achievement than socio-economic status. It is more than double the effect of prior achievement and more than triple the effect of home environment and parental involvement. It is also greater than three times more likely to influence student achievement than student motivation and concentration, persistence, and engagement."
Collective Teacher Efficacy
Collective teacher efficacy refers to a staff’s shared belief that through their collective action, they can positively influence student outcomes, including those who are disengaged and/or disadvantaged. Educators with high efficacy show greater effort and persistence, a willingness to try new teaching approaches, set more challenging goals, and attend more closely to the needs of students who require extra assistance.
Collective teacher efficacy, as an influence on student achievement, is a contribution that comes from the school – not the home nor the students themselves. According to the Visible Learning Research (see diagram below), collective teacher efficacy is beyond three times more powerful and predictive of student achievement than socio-economic status. It is more than double the effect of prior achievement and more than triple the effect of home environment and parental involvement. It is also greater than three times more likely to influence student achievement than student motivation and concentration, persistence, and engagement.
SOURCE: HATTIE, J. (2012). VISIBLE LEARNING FOR TEACHERS: MAXIMIZING IMPACT ON LEARNING. NEW YORK, NY: ROUTLEDGE; AND HATTIE, J. (2016, JULY). MINDFRAMES AND MAXIMIZERS. 3RD ANNUAL VISIBLE LEARNING CONFERENCE HELD IN WASHINGTON, DC.

For information on all of the studied effect sizes, you may click on the link below:

We have copies of Visible Learning and Visible Learning for teachers in the curriculum office if you would like to check them out and learn more.  Please let us know how we can continue to support your great collaborative work to advance student learning.


No comments:

Post a Comment