During the 24th February seminar, we responded to the question: “What do we need to know in order to teach well?” The answers relate to the Core Knowledge section (K1-K6) of the UKPSF 2011.

In comparison to K5: “Methods for evaluating the effectiveness of teaching”, we mentioned, “making success criteria visible to ourselves and each other” but didn’t explore further. 

In a blog post, I compared educational evaluation to marketing effectiveness, which interestingly present similar challenges.

Hummelbrunner and Reynolds (2013) overlaid systems thinking with learning loops. Their framework for rigour in evaluation demonstrates that progression towards triple loop learning is determined by “applying progressively wider measures of value”. However, “Often only one specific level might be feasible or can be appropriately attained.”

Interestingly, the former marking criteria at UAL for Subject Knowledge denotes the following as ‘A’ grade, “Contributes to the subject debate by assimilating knowledge into a personal hypothesis (or elements of/ the beginning of one)” which suggests reaching a level of criticality akin to triple loop learning (Hummelbrunner and Reynolds, 2013). However, the current Assessment Criteria does not include this, “Excellent evidence of: Critical analysis of a range of practical, theoretical and/or technical knowledge (s).” (UAL, 2019)

How we evaluate learning loops and values must be considered given the Assessment Criteria no longer indicates this. Perhaps, the Learning Outcomes should fill this gap. With the current preference for succinct Assessment Briefs rather than extensive Unit Handbooks, we are required to produce additional explanatory documents to clarify grade levels to students – and tutors.(I previously wrote a blog post about the need to streamline the Assessment Brief). I don’t have a specific solution, but this exploration encourages me to work towards a more rigorous method of evaluating effectiveness of teaching.  

References

Hummelbrunner, R. and Reynolds, M. (2013) Systems thinking, learning and values in evaluation. Evaluation Connections: The European Evaluation Society Newsletter, June 2013, pp.9-10.

The UK Professional Standards Framework (2011) Available at: https://s3.eu-west-2.amazonaws.com/assets.creode.advancehe-document-manager/documents/hea/private/resources/ukpsf_2011_english_1568036916.pdf Accessed: 17^th March 2023

UAL (2019) New Assessment Criteria. Available at: https://www.arts.ac.uk/students/stories/new-assessment-criteria3 Accessed: 17^th March 2023