News
Webinar Highlights
Inclusivity and Fairness in Assessments: A Proactive Approach
On March 26, we held a webinar on inclusivity and fairness in assessment design, focusing on proactive approaches to making assessments more equitable and inclusive. The discussion highlighted the central role of inclusivity and fairness in ensuring validity. As classrooms become increasingly diverse, assessment design must evolve to reflect the varied backgrounds, experiences, and needs of learners. Inclusivity is no longer an added consideration, it is fundamental to measuring student ability accurately.
At the core of this discussion is a key principle: fairness and validity are deeply interconnected. An assessment cannot be considered valid if it does not measure the intended construct equally for all test takers. When certain groups are unintentionally advantaged or disadvantaged, the issue extends beyond fairness and directly undermines the validity of the assessment. This perspective challenges the traditional view of validity, reliability, and fairness as separate pillars, instead positioning fairness as integral to validity itself.
Diversity in classrooms is often associated with internationalization, but it extends far beyond that. Even within seemingly homogeneous groups, learners differ in language proficiency, cultural background, prior knowledge, learning experiences, and identity. These differences influence how students interpret tasks, process information, and respond under assessment conditions. Recognizing this inherent diversity is the first step toward more equitable assessment design.
Construct-Irrelevant Barriers in Assessment Design
In the webinar, we talked about barriers to success in assessment contexts, and one of the most critical considerations in this area is the presence of construct-irrelevant barriers. These are elements within an assessment that make it more difficult for students to demonstrate their actual abilities, even though they are not related to the construct being measured. In that sense, they introduce an unintended layer of difficulty that can distort performance and, ultimately, weaken the validity of the assessment.
These barriers can take different forms:
- Construct-irrelevant knowledge, skills and ability (KSA) barriers occur when knowledge, skills, or abilities that are not part of the intended construct are required in order to respond to test items. These barriers can emerge when items unintentionally introduce additional cognitive, cultural, or interpretive demands. For instance, reading texts based on locally specific experiences may disadvantage students who are not familiar with that context, even though reading ability is what is being assessed. Similarly, relying solely on color-coded visuals can disadvantage learners with color vision deficiencies or those who process visual information differently. Even unclear or overly complex instructions can introduce unnecessary difficulty, particularly in high-stakes testing situations.
- Construct-irrelevant emotional barriers are another important dimension. Certain topics, prompts, or scenarios can trigger strong emotional responses that interfere with performance. Highly personal questions, sensitive issues, or controversial themes may shift a learner’s focus away from demonstrating their skills toward managing their emotional reaction. In such cases, performance reflects not ability, but the impact of the task itself. Careful topic selection and awareness of potential sensitivities are therefore essential.
Avoiding these barriers is only one part of the process. Equally important is the intentional inclusion of diverse perspectives and representations within assessment materials. This involves moving beyond neutral design to actively reflecting the diversity of learners. Balanced representation in texts and visuals, avoidance of stereotypes, and thoughtful portrayal of different social roles all contribute to a more inclusive assessment environment. Without this awareness, materials may unintentionally reinforce narrow or biased perspectives.
A Proactive Approach to Fair Assessment Design
Rather than identifying issues after an assessment has been administered, inclusivity should be embedded from the outset. This involves selecting appropriate content, deliberately avoiding potentially unfair elements, and implementing systematic review processes before assessments are used. Such an approach is not only more effective but also more efficient, reducing the need for revisions after the fact.
One practical way to operationalize this is through the use of inclusivity and fairness checklists. Unlike traditional proofreading processes, which focus primarily on technical accuracy, these checklists prompt educators to evaluate assessments through a broader lens. They encourage consideration of learner diversity, potential sources of bias, and the overall accessibility of tasks. Importantly, these checklists should be context-specific, reflecting the realities of each institution and learner group.
Designing such tools begins with reflection:
- Who are the learners being assessed?
- What forms of diversity exist within the group?
- Which students might be disadvantaged by current practices, and why? Are there assumptions embedded in assessment tasks about background knowledge or experiences?
- Are some groups unintentionally privileged?
Addressing these questions helps identify gaps and informs more equitable design decisions.
Inclusivity also has a strong social-emotional dimension. When learners feel represented, respected, and included, they are more likely to engage positively and perform to the best of their ability. Conversely, feelings of exclusion or discomfort can hinder performance and affect how learning is internalized. Assessments, particularly high-stakes ones, play a powerful role in shaping these experiences and can influence not only outcomes but also learners’ perceptions of themselves.
Ultimately, inclusive and fair assessment design leads to more accurate measurement. By removing irrelevant barriers and ensuring that all learners have an equal opportunity to demonstrate their abilities, assessments become more valid, more reliable, and more meaningful. In diverse educational contexts, this is not simply good practice, it is essential.
For further reading, click here to access the ETS Guidelines for Developing Fair Tests and Communications