Designing the Classroom Curriculum Designing the Classroom Curriculum | Page 117

Lynch, Smith, Howarth o o Criterion related evidence - the relationship between an assessment and another measure of the same trait Construct related evidence - the extent to which the assessment is a meaningful measure of an observable trait or characteristic (Brady and Kennedy, 2009, pp. 33-37). Reliability: Reliability is determined by estimating the influence of various sources of error. For example, if several teachers use the same criteria and come up with different outcomes, the criteria are not reliable. If there is little error the reliability is high and vice versa. Like validity reliability is based on using one or more sources of evidence to justify score interpretation: o o o o o Stability - the scores of two assessment administrations to the same group of individuals with a time interval between. Equivalence - two forms of the same assessment given about the same time. Internal consistency - a single administration of assessment Scorer consistency - agreement between two or more scorers (or raters) on the same performances (Brady and Kennedy, 2009, pp. 33-37) Decision consistency - percentage of decisions that are the same. Authenticity: An authentic assessment regime includes a variety of appropriate assessment tasks that together provide an accurate picture of student performance (Marsh, 2009, pp. 83-84). Fairness: There are five key components of fairness in assessment: o o o o o Student knowledge of learning targets and assessments Opportunity to learn Prerequisite knowledge and skills Avoiding teacher stereotypes Avoiding bias in assessment tasks and procedures (Brady and Kennedy, 2009, p. 36, 91 to 93). Positive Consequences: Assessment has a consequence in the classroom context. The focus should be positive. Questions such as: How will assessments affect student motivation? How will the assessment affect how and what students study? How will assessment contribute to the individual student’s learning progress? Focus the teacher in considering the consequences of their assessment strategies (Mehrens, 1998). 3. Efficiencies for assessment to work in the classroom context Time is a limited commodity for teachers. High quality assessments are practical and efficient (Brady and Kennedy, 2009). 4. Moderation In addition to these three key assessment issues is the process of moderation. While more common in secondary schools and tertiary teaching environments, “moderation, is concerned with the consistency, comparability and fairness of professional judgments about the (performance) levels demonstrated by students” (Maxwell 2002). Most moderation processes occur in the context of end of term ‘teacher meetings’ where teachers present work samples, discuss the assessment decisions made and then reappraise their assessment results accordingly. A key reference in moderating student work is the syllabus and examples of 117