Lesson 3: Assessing an EL activity
Introduction
One of the more common concerns instructors have about Experiential Learning is “I see how a hands-on activity could be beneficial in my classroom, but I have no idea how to assess it or measure student learning.” And that’s a valid concern. Experiential Learning can be hard to assess. It is unpredictable, students may not be uniform in what they take from the experience and it’s a type of learning where the process is just as important as any artifact a student may produce. How can one rubric even cover all of these criteria?
Authentic assessment and EL
Authentic Assessment is often used in Experiential Learning assessment because the type of assessment required by real world activities is based on the student being able to apply knowledge learned to new tasks.
To assess authentically, is to see how the student has learned in the new situation and to provide more freedom and opportunities for them to exhibit their new learning (Fook & Sidhu, 2010).
Authentic assessment involves “engaging and worthy problems or questions of importance, in which students must use knowledge to fashion performances effectively and creatively. The tasks are either replicas of, or analogous to, the kinds of problems faced by...professionals in the field” (Wiggins, 1993).
The complexity around assessing EL activities is that many higher education institutions focus on:
Experiential Learning assessment is more meaningful if it is done through the lens of authentic assessment. The first section will guide you through how the principles of authentic assessment can anchor EL assessment and following that we will show you how to develop a rubric for an EL activity.
Principles of authentic assessment
The Taylor Institute of Teaching and Learning Guide on Student Assessment explores eight guiding principles that are useful to think about when designing assessment for EL activities. Think about which (two or so) are most important to you, or most aligned with your teaching philosophy.
- Culture shift to focus on evaluation of student learning as support for student learning not student performance in isolation
- Authentic in reflecting the work of the discipline and respecting the integrity of epistemologies
- Is a developmental and sustainable process that fosters self-regulated learning, academic integrity, and life-long learning
- Is a continuous process embedded and holistic across course, program, institution (profession); not final unit of student learning
- Is a process based on discussion between students and instructor to foster and be responsive to student learning and feedback
- Provides a balance of formative and summative opportunities and a separation between feedback and grading
- Provides for transparency, fairness, clarity, and quality of the what, how, and why of the assessment of students' progress and learning status and expectations as a process
- Is aligned with learning outcomes and instructional protocols/strategies
Individual instructors vary in their likelihood to implement authentic assessment across roles, level of experience, organizational culture, and other factors. Implementing authentic assessment principles often requires making adjustments or changes to prior practises. There are some critical questions you can ask yourself as you are designing authentic assessment practices for your experiential learning activity.
Critical questions to orient you to authentic assessment
To help you determine if your activity is suitable for authentic assessment practices, work through these questions. Also available in the workbook and as a PDF below.
Will this activity:
Many EL activities, like work-integrated learning or student research will include all these questions when considering authentic assessment for EL. Other forms of EL activities done in the curricular space like simulations, case studies, field trips, guest speakers, capstone projects, design projects or performances might not require assessment beyond the instructor.
Rubrics
Before one starts to develop a rubric it’s a good idea to determine the type of assessment strategy you will use to measure the learning in the EL activity. Some of the more common forms of assessment strategies used with EL include:
Rubrics are used to clearly signal to students how they will be assessed, and what the criteria for assessment will be. Rubrics are typically illustrated as a table that includes a row or column for values or qualities of demonstrable learning (sometimes called criteria), and rows or columns of descriptors of your expectations. They work well for evaluating and appraising Experiential Learning because they allow for the individual and learning-as-a-process aspects of EL.
In some cases, the design of a rubric employs multiple gradients to indicate to students what combination of values/qualities and descriptions will result in what kinds of grade, indicated by a letter or percent.
To determine what values and qualities are important to you, and that you may like to incorporate into your EL assessment, look at this table by Cottrell (2012). Often our instructional values and qualities are significantly informed by our discipline’s traditions and or professional characteristics or skills.
Aspects of Learning
-
Effective/Meeting Expectations
Draws on personal and specific experience
-
Not Yet Meeting Expectations
Assumes the experience is an end in itself and that everyone's experience is/would be synonymous
-
Effective/Meeting Expectations
Assumes individual responsibility for the learning
-
Not Yet Meeting Expectations
Deflects responsibility; assigns blame
-
Effective/Meeting Expectations
Is selective about defining the context and variables
-
Not Yet Meeting Expectations
Covers too many unspecified variables; is conflated or confusing.
-
Effective/Meeting Expectations
Considers audience, including register, style, ethics, aesthetics, and other conventions background knowledge
-
Not Yet Meeting Expectations
Defies consideration of confidentiality; is illegible, unintelligible, or incoherent.
-
Effective/Meeting Expectations
Adheres to time or word limits
-
Not Yet Meeting Expectations
is too narrow or broad in scope; is too long or short (is repetitive)
-
Effective/Meeting Expectations
Delves below the surface and reaches for meaning and connection to other contexts and possibilities
-
Not Yet Meeting Expectations
Remains superficial or constrained to the most obvious points or renderings
Tackles complex issues, multiple perspectives, or navigates contested or ambiguous terrain
-
Effective/Meeting Expectations
Tackles complex issues, multiple perspectives, or navigates contested or ambiguous terrain
-
Not Yet Meeting Expectations
Tends to mostly safe, singular, traditional, or conservative phenomena and interpretations
-
Effective/Meeting Expectations
Draws on relevant theoretical standpoints; relates to prior scholarship or practice; evokes broader social and political implications
-
Not Yet Meeting Expectations
Mainly describes or catalogs events or theories rather than interprets, analyzes, critiques or images in the intangible theoretical stances according to situations, content, context, or events
-
Effective/Meeting Expectations
Depicts change in perceptions, expectations, understanding, skill acquisition, advancement, application, or personal/professional development. Refers to opportunity and applies possibilities to future prospects
-
Not Yet Meeting Expectations
Contains little or no evidence of personal growth, self-knowledge, awareness of others' experience, nor significant skill development. Does not connect the experience to other contexts or across domains of learning
-
Effective/Meeting Expectations
Synthesizes the experience and understanding; posits future possibilities and improved potential for approaching other contexts and opportunities; summarizes and concludes; provides recommendations or take-aways for self or others
-
Not Yet Meeting Expectations
Contains little or no evidence of personal growth, self-knowledge, awareness of others' experience, nor significant skill development. Does not connect the experience to other contexts or across domains of learning
Reflect On This
Think about the eight authentic assessment principles that could inform your assessment practice. What two or three principles resonate with you and why do you think they resonate? Is there anything about authentic assessment that you find challenging?
Note: If you want to email your reflection to yourself, you may enter your email and hit "Save." Otherwise, you can use this space to write down your thoughts without saving or use the PDF workbook to record your notes.
Collection of personal information
Your personal information is collected under
the authority of section 33(c) of the Freedom of Information and Protection of Privacy Act. If
you have any questions about the collection or use of this information, please visit our
Access to Information page.
Your Turn
Developing your own rubric for an EL Activity
Look at these sample rubrics in the Resources and then answer these questions:
- What do you like about the functionality of the rubrics you viewed?
- What do you dislike about the complexity or simplicity of the rubrics you viewed?
- Which one could best serve as a template or exemplar for what you could use in your context?
- What would you change or adapt about the example you selected?
Note: If you want to email your answers to yourself, you may enter your email and hit "Save." Otherwise, you can use this space to write down your thoughts without saving or use the PDF workbook to record your notes.
Collection of personal information
Your personal information is collected under
the authority of section 33(c) of the Freedom of Information and Protection of Privacy Act. If
you have any questions about the collection or use of this information, please visit our
Access to Information page.
Building a Rubric
This is to show you how to build a rubric to measure learning in an EL activity. If you want to learn how to build a rubric for a critical reflection assignment, please visit the Critical Reflection Online Module.
As you build a rubric for your EL activity you will want to refer back to Cottrell’s table of qualities and values to determine which values and qualities are important for you and to develop some criteria that will measure student achievement. Here are some questions you might want to answer to get started. List specific tasks that will show you that the student has learned the value and quality you want them to learn:
- Do you value your student’s personal experience? If so, you might incorporate this quality into the design of your EL assessment rubric.
- Do you value your student’s ability to refer to or ground their learning in theory presented in your course? If so, you might then consider including theory as a critical element. When you assess students learning, you’ll want them to demonstrate an ability to include relevant theory.
- Do you want your students to consolidate this experience with plans for future learning?
These values and qualities become the ‘criteria’ for assessment in the rubric. Insert values/qualities that students can demonstrate to you about their different levels of learning in the columns to the right. Add in descriptions of what it looks like when students have a mastery, developing or emerging level of your expectations of the activity.
Criteria (Value/Quality) | Mastery | Developing | Emerging |