Email this article 
Traffic Light Report provides a new technique for Assurance of Learning
Abstract
The Traffic Light Report (TLR) project is an educational intervention designed for pharmacy undergraduates. This paper reports on analysis of TLR data specifically focusing on its potential as an innovative tool which combines Miller’s pyramid, technology and student voice to examine a curriculum for Assurance of Learning (AoL). In 2014, educators mapped each summative assessment to the relevant National Competency Standards Framework for Pharmacists in Australia (NCS) alongside levels of expected performance on Miller’s pyramid of clinical competence (Knows, Knows how, Shows how, Does). Simultaneously, students were invited to self-reflect using the same performance levels. The Miller’s scale enabled a comparison between students’ and their educators’ understanding of the performance level demanded by assessments. Analysis highlighted disconnect between students’ and their educators’ interpretations of the same assessed curriculum. The TLR facilitates quality enhancement by providing educators and their students with a logical meeting point for discussing foundation, scaffolding and integration of assessment across a course for AoL. This has portability to other professional disciplines.
Keywords
Full Text:
PDFReferences
AACSB International. (2013). White paper 3: AACSB assurance of learning standards: an interpretation. AACSB International Accreditation Committees, 2nd ed. Retrieved http://www.aacsb.edu/~/media/AACSB/Publications/white-papers/wp-assurance-of-learning-standards.ashx
Australian Government Department of Education and Training. (2015). Higher Education Standards Framework (Threshold Standards) (Vol. F2015L01639, pp. 4, 7, 8). Australia.
Australian Pharmacy Council. (2012). Accreditation Standards for Pharmacy Programs in Australia and New Zealand Retrieved 26/02/2015, from http://pharmacycouncil.org.au/content/index.php?id=17
Barrie, S. (2004). A research-based approach to generic graduate attributes policy. Higher Education Research & Development, 23(3), 261-275.
Biggs J & Tang C (Ed.). (2007). Teaching for quality learning at university (3rd ed.). Maidenhead, Birkshire, England: The Society for Research into Higher Education and Open University Press.
Boud, D. & Falchikov, N. (2005). Redesigning assessment for learning beyond higher education. Research and development in higher education, 28, 34-41.
Conway, S. Medina, M. Letassy, N. & Britton, M. (2011). Assessment of streams of knowledge, skill, and attitude development across the doctor of pharmacy curriculum. Am J Pharm Educ, 75(5), 83.
Coombes, I. Bates, I. Duggan, C. & Galbraith, K. (2011). Developing and Recognising Advanced Practitioners in Australia: An Opportunity for a Maturing Profession? Journal of Pharmacy Practice and Research, 41(1), 17.
Creswell, J. (2013). Research Design Qualitative, Quantitative and Mixed Methods Approaches 2nd ed. California: Thousand Oaks.
Edstrom, K. (2008). Doing course evaluation as if learning matters most. Higher Education Research & Development, 27(2), 95-106.
Epstein, R. & Hundert, E. (2002). Defining and assessing professional competence. Journal of the American Medical Association, 287(2), 226-235.
General Pharmaceutical Council. (2011). Future pharmacists standards for the initial education and training of pharmacists Retrieved 26/02/2015, from http://www.pharmacyregulation.org/initial-training
Hall, O. & Kro, K. (2006). Learning assurance using business simulations applications to executive management education. Developments in Business Simulation and Experiential Learning, 33, 1-6.
Harden, R. (2001). AMEE Guide No. 21: Curriculum mapping: a tool for transparent and authentic teaching and learning. Medical Teacher, 23(2), 123-137.
Harden, R. & Stamper, N. (1999). What is a spiral curriculum? Medical Teacher, 21(2), 141-143.
Janke, K. Traynor, A. & Sorensen, T. (2011). Refinement of Strengths Instruction in a Pharmacy Curriculum Over Eight Years. American Journal of Pharmaceutical Education, 75(3), 1-45.
Kelley, K. & Demb, A. (2006). Instrumentation for comparing student and faculty perceptions of competency-based assessment. American Journal of Pharmaceutical Education, 70(6).
Kelley, K. McAuley, J. Wallace, L. & Frank, S. (2008). Curricular Mapping: Process and Product. American Journal of Pharmaceutical Education, 72(5), 1-100.
Kleinert, R. Heiermann, N. Plum, P. Wahba, R. Chang, D. Maus, M. . . . Stippel, D. (2015). Web-Based Immersive Virtual Patient Simulators: Positive Effect on Clinical Reasoning in Medical Education. Journal of Medical Internet Research, 17(11), e263.
Lawson, R. (2014). Curriculum design for assuring learning - leading the way National Teaching Fellowship. Sydney: Office for Learning and Teaching.
Lawson, R. (2015a, 6-9th July). The Curriculum Design Workbench-showcasing a whole of degree design tool. Presented at Higher Education Research and Development Society of Australiasia (HERDSA), Melbourne.
Lawson, R. (2015b, 17th July). [University of Tasmania Faculty of Health, Curriculum Design Workbench support materials interview for Q&A].
Lawson, R. Taylor, T. French, E. Fallshaw, E. Hall, C. Kinash, S. & Summers, J. (2015). Hunting and gathering: new imperatives in mapping and collecting student learning data to assure quality outcomes. Higher Education Research & Development, 34(3), 581-595. doi: 10.1080/07294360.2014.911249
Lew, M. Alwis, W. & Schmidt, H. (2010). Accuracy of students' self-assessment and their beliefs about its utility. Assessment & Evaluation in Higher Education, 35(2), 135-156.
Martone, A. & Sireci, S. (2009). Evaluating alignment between curriculum, assessment, and instruction. Review of Educational Research, 79(4), 1332-1361.
Mészáros, K. Barnett, M. McDonald, K. Wehring, H. Evans, D. Sasaki-Hill, D. . . . Knapp, K. (2009). Progress Examination for Assessing Students' Readiness for Advanced Pharmacy Practice Experiences. Am J Pharm Educ, 73(6), 1-109.
Miller, G. (1990). The assessment of clinical skills, competence, performance. Acad Med, 65(9), S63-67.
Nash, R. Chalmers, L. Stupans, I. & Brown, N. (2015a). Knowledge, use and perceived relevance of a profession’s Competency Standards; Implications for Pharmacy Education. [IN REVIEW]. International Journal of Pharmacy Practice.
Nash, R. Chalmers, L. Stupans, I. & Brown, N. (2015b). A reciprocal relationship: informing a profession's competency standards. Paper presented at Higher Education Research and Development Society of Australasia (HERDSA), Melbourne, Australia.
Nash, R. Chalmers, L. Stupans, I. & Brown, N. (2015c). A vision for Competency: Pharmacy Undergraduate's Traffic Light Reports. In F. Padro, K. Trimmer, D. Thorpe & T. Newman (Eds.), Higher Education in the Professions: Case Study Illustrations of Quality Practice (Vol. 1). Toowoomba: University of Southern Queensland. [IN REVIEW] Springer (Feb 2016).
XXXXXXXa
XXXXXXXb
Oliver, B. Ferns, S. Whelan, B. & Lilly, L. (2010). Mapping the curriculum for quality enhancement: Refining a tool and processes for the purpose of curriculum renewal. Paper presented at Australian Universities Quality Forum.
Plaza, C. M. Draugalis, J. Slack, M. Skrepnek, G. & Sauer, K. (2007). Curriculum Mapping in Program Assessment and Evaluation. Am J Pharm Educ, 71(2), 1-20.
Porter, A. Floden, R. & Fuhrman, S. (1998). The effects of upgrading policies on high school mathematics and science. Brookings papers on education policy, 123-172.
Porter, A. & Smithson, J. (2001). Defining, developing, and using curriculum indicators. Philadelphia, PA: University of Pennsylvania, Consortium for Policy Research in Education.
Szilagyi, J. (2008). Curricular progress assessments: The mileMarker. American Journal of Pharmaceutical Education, 72(5).
Van Den Akker, J. Gravemeijer, K. McKenney, S. & Nieveen, N. (2013). Educational Design Research. Draft Book. Council for Educational Research. Amsterdam.
Van Der Vleuten, C. & Schuwirth, L. (2005). Assessing professional competence: from methods to programmes. Medical Education, 39(3), 309-317.
Wass, V. Van der Vleuten, C. Shatzer, J. & Jones, R. (2001). Assessment of clinical competence. The Lancet, 357(9260), 945-949. doi: http://dx.doi.org/10.1016/S0140-6736(00)04221-5
DOI: http://dx.doi.org/10.5204/jld.v9i1.264
Article Metrics
Metrics powered by PLOS ALM
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution 4.0 License.