๐ Lecture 14 โ TEACHING OF WRITING SKILLS
๐ Overview: This lecture explores the systematic teaching of writing skills, covering the writing process, various approaches to writing instruction, and practical classroom strategies. It emphasizes both process and product orientations, genre awareness, and creative writing, while also addressing assessment techniques and the integration of writing with other language skills for holistic language development.
๐๏ธ Topics Covered
The lecture covers the sequential writing process (prewriting through publishing), approaches to writing including process/product, genre, and creative writing, teaching mechanics like sound-spelling correspondences, practical classroom strategies and activities for developing writing skills across different task types, assessment methods including responding and feedback strategies, and finally the integration of all four language skills through content-based and task-based instruction.
๐ Lecture Summary
Topic-072: Writing Process
Writing, similar to reading, follows a sequential process that teaches students to internalize steps for producing a finished piece of writing. This helps students produce effective writing for a variety of purposes.
The process includes 7 steps:
- Prewriting: The planning phase where one decides the type of writing, intended audience, and purpose. Children brainstorm to generate ideas. Charts, story webs, and graphic organizers help develop word lists.
- Rough Draft: Children put ideas on paper without major attention to punctuation or grammar. The goal is to focus on ideas without fear of mistakes in word choice, sentence structure, conventions, or presentation.
- Peer Editing: Classmates share rough drafts and make suggestions, asking who, what, when, where, why, and how questions to improve clarity.
- Revising: Students use peer suggestions to make additions or clarify details. The teacher may step in. Skills include idea organization, voice, word choice, and sentence fluency.
- Editing: Children work with teacher/peers to correct errors in grammar, mechanics, and usage. Knowledge of writing conventions is beneficial here.
- Final Draft: Students produce a corrected copy and discuss it with the teacher, who offers last suggestions.
- Publishing: Sharing writing with the intended audience via handwritten/word processed copy, illustrations, multimedia, public performance, or local newspapers. The teacher is a member of the audience.
Topic-073: Approaches to Writing
There are several approaches to writing instruction, requiring choices about focus on process vs. product, genre study, and creative writing.
Process and Product: When focusing on the product, only the end result matters (e.g., genre approach). The process approach pays attention to the various stages writing goes through, including pre-writing, editing, and redrafting. The writing process is complex and recursive in nature. While focusing on process may be time-consuming, the writing process is at least as important as the product.
Genre: Genre represents norms of different kinds of writing. Students must consider topic knowledge, convention, style, context, and audience. It is appropriate for ESP students but can be prescriptive, encouraging reproduction rather than creative act.
Creative Writing: Suggests imaginative tasks like poetry, stories, and plays. It is a journey of self-discovery that promotes effective learning (Gaffield-Vile, 1998:31). Students often strive harder, but may find it difficult depending on encouragement.
Writing as a Cooperative Activity: Students benefit from the presence of others. Cooperative writing works well whether focusing on process or genre, especially with computers. Students and teachers gradually co-construct a final product.
Building the Writing Habit: Especially for students lacking confidence.
Topic-074: Teaching of Writing Skills in the Classroom
Teaching mechanics of writing aims at three goals:
- Enhance letter recognition (especially for learners from different writing systems)
- Practice sound-spelling correspondence via all four language skills
- Help learners move from letters/words to meaningful sentences and larger discourse units
Three major recognition tasks are used: matching tasks, writing tasks, and meaningful sound-spelling correspondence practice. Capitalization and basic punctuation rules are important features of early writing. Learners need plenty of copying opportunities, which can be made cognitively demanding by searching for meaningful words and creating sentences in new contexts.
Sound-Spelling Correspondences: English presents unique orthographic problems, even for learners with Roman alphabet backgrounds. The English writing system is rule-governed, enabling combining phonetic with graphemic units. Students often seek one-to-one correspondence but encounter trouble, especially with vowel letters. English orthography is not a one-to-one system; consistency is embedded in letter combinations with immediate environments, forming sound-spelling patterns.
Topic-075: Strategies and Activities for Developing Writing Skills
Several strategies develop writing skills:
- Practical Writing Tasks: Procedural with predictable format, suitable for spelling and morphology. Includes lists, notes, short messages, and simple instructions to reinforce classroom work.
- Personal Writing Tasks: Letters to friends, personal narratives, journals, and diaries. Emphasis on format, pronunciation, and spelling of appropriate phrases. Past-tense spelling can be practiced.
- School Oriented Tasks: Assignments, summaries, essay answers. The teacher is often the audience. Students must learn to write to unknown readers, with attention to both linguistic accuracy and message transmission.
- Dialogue Journal Writing: Enables one-to-one interaction at any level. Useful in early stages; the journal allows beginners to generate personal input and receive direct teacher feedback, even via email.
The Role of the Teacher:
- Motivator: Creates conditions for idea generation, persuades of usefulness, encourages maximum effort, prompts with own ideas, acts as resource.
- Feedback Provider: Responds positively and encouragingly. Chooses what and how much to correct based on students' needs and stages.
Topic-076: Strategies and Activities for Developing Writing Skills II
These strategies expose students to varied starting techniques and encourage discovering personal best strategies. Begin with the prewriting stage.
Brainstorming: A group exercise where all students share collective knowledge about a subject. Generates more material than any individual, usable for first drafts.
Listing: An individual activity where students produce a lengthy list of main ideas and subcategories. Useful for students constrained by concern for grammatical correctness.
Clustering: Begins with a key word/central idea in the center of the page. Students jot down free-associations using words/phrases, creating a pattern of connections (like spokes on a wheel). Sharing patterns exposes students to varied approaches.
Free Writing: A prewriting technique where a person writes continuously for a set period without regard to spelling, grammar, or topic. Produces raw material, helps overcome blocks of apathy and self-criticism. Works best with an opening clause.
Revising: Involves reformatting longer writings, cutting them up, and moving parts to reorganize. Includes peer-review and color-coding activities (green for understanding, yellow for questions, red for confusion).
Editing: Uses teacher-created checklists.
Role-play Writing: Writing to an imaginary character.
Post Cards: Writing post cards and responses.
Text Lingo: Writing text messages and replies (mobile phones).
Topic-077: Assessment of Writing Skills
Several ways exist for assessing L2 learners' writing.
Writing Assignment: A key component; topics must be carefully designed, sequenced, and structured. Teachers must know the learning goal and what students gain.
Responding: A complex process involving critical decisions: general and specific goals for feedback, stage of writing for feedback, form of feedback, who provides it, and what students do with it.
Goal-Setting: Teachers need methodologies fostering improvement. They must measure/recognize improvements and focus on varied response types, training students to maximize prior feedback on future writing.
Strategic Use of Questioning: Helps identify misunderstandings and gaps. Closed questions ask learners to recall; open questions encourage thinking skills and elicit more information. Use the word "might" to encourage exploration of possible answers.
Comment-Only Feedback: Only write comments, no marks. Helps learners focus on progress rather than reward/punishment.
Peer and Self-Assessment: Model how to give peer feedback. Use a learning wall for posting positive feedback.
Self-Assessment Prompts: Teachers provide prompts to help students become skillful at self-assessment.
Teaching of Integrated Skills
Integrated skills teaching focuses on the four main English skills (reading, writing, speaking, listening) through Communicative Language Teaching methodology. Realistic communication is integral to language learning, contrary to segregated skills teaching. Integration builds new knowledge onto existing skills; e.g., reading a story helps write a story.
A teacher must instill words, idioms, and grammatical structures. "It is impossible to teach reading without the extensive use of writing, speaking, and listening" (Chen, 2002). The four strandsโteacher, learner, setting, and relevant languageโmust weave together. Integration is concerned with realistic communication at the discourse level (a whole unit of communicative text).
Two Types of Integrated-Skill Instruction:
-
Content-Based Instruction: Students practice all language skills while learning content (science, mathematics, social studies). Valuable at all proficiency levels. Three models exist (Scarcella & Oxford, 1992):
- Theme-Based Model: Integrates skills into study of a theme (e.g., urban violence, natural wonders). Most useful and widespread form.
- Adjunct Model: Language and content courses taught separately but carefully coordinated.
- Sheltered Model: Subject matter taught in simplified English tailored to proficiency level.
-
Task-Based Instruction: Students participate in communicative tasks. Basic pair and group work increase interaction. Tasks include writing/editing a class newspaper, developing commercials, or enacting play scenes. Tasks become increasingly complex at higher proficiency.
Advantages of Integrated-Skill Teaching:
- At the level of realistic communication (goal of communicative approach)
- Exposes learners to authentic language and natural interaction
- English becomes a real means of interaction, not just academic interest
- Allows tracking progress in multiple skills simultaneously
- Highly motivating to students of all ages and backgrounds
How to Integrate the Four Skills: Easiest integration is within the same medium (oral/written) from receptive to productive skills. Complex integration involves constructing activities using varied skills, ensuring thematic linkage between activities.
Limitations: Teachers must balance integration and separation. It can be time-consuming, requiring extensive preparation.
๐ก Why this matters: Understanding how to teach writing systematicallyโfrom mechanical drills to creative expressionโand how to integrate it with other skills is fundamental for developing communicative competence in L2 learners.
โญ Key Takeaways
The writing process is recursive and includes seven stages from prewriting to publishing, with each stage serving a distinct purposeโfrom generating ideas (prewriting) to sharing with an audience (publishing). The process approach values editing and redrafting more than the product approach, though both are important for different contexts. Teachers must balance several approachesโgenre, creative writing, and cooperative writingโwhile playing roles as motivator, resource, and feedback provider. Assessment requires careful goal-setting, strategic questioning, and varied feedback methods including comment-only and peer/self-assessment. Finally, integrating all four language skills through content-based or task-based instruction creates realistic communication that is highly motivating and prepares students for authentic language use.
๐ง Quick Revision Questions
- What are the seven stages of the writing process, and what is the main purpose of the "peer editing" stage?
- How does the process approach to writing differ from the product approach, and why is the writing process described as "recursive"?
- What are the three major types of recognition tasks used in teaching the mechanics of writing, and why is English spelling not a one-to-one letter-sound system?
- What is the difference between brainstorming, listing, and clustering as prewriting strategies, and which is most suitable for a student afraid of grammatical errors?
- What are the two types of integrated-skill instruction, and what are two key advantages of integrating the four language skills?
๐ Lecture 15 โ Assessment of Language Skills I
๐ Overview: This lecture introduces the field of language assessment, covering its history, key concepts, and the distinctions between testing, assessment, and teaching. It explores different types of tests, fundamental principles of test design, and practical steps for creating classroom tests, including standardized testing approaches. Understanding these concepts is crucial for educators to effectively evaluate and support language learning.
๐๏ธ Topics Covered
This lecture covers the definition and history of language assessment, the differences between informal and formal assessment, and formative versus summative assessment. It distinguishes between testing, assessment, and teaching, and explores various kinds of testing including placement, diagnostic, progress, proficiency, aptitude, and language dominance tests. Key principles of language assessment such as validity, reliability, and wash back effect are discussed, followed by practical guidelines for designing classroom language tests and an overview of standardized testing including norm-referenced and criterion-referenced tests.
๐ Lecture Summary
Topic- 078: What is Assessment of Language Skills?
It is a field of Applied Linguistics (AL); the assessment of first, second or the other language in the school, college, or university. The assessment of language use in the workplace, immigration, and citizenship. The assessment may include listening, speaking, reading, and writing, an integration of two or more of these skills. Equal weight may be placed on knowledge (understanding how the language works theoretically) and proficiency (ability to use the language practically), or greater weight may be given to one aspect or the other.
History of LA The earliest works in language assessment date back to the 1950s. Pioneering studies and tests were created by Robert Lado and David Harris. The earliest large scale assessments in the US were referred to as TOEFL, developed by ETS, Princeton. Launched in 1961, it was designed to assess the English language ability of students applying for admission to U.S. and Canadian universities. Later on, many other language proficiency tests were started such as CELA, IELTS, GEPT, etc.
Informal and Formal Assessment Informal Assessment can take a number of forms: starting with incidental, unplanned comments and responses, along with coaching and other important feedback to the students. Examples include saying โNice jobโ, โGood work!โ โDid you say can or can't?" etc. Usually embedded in classroom tasks, they are designed to elicit performance without recording results and making fixed judgments. Formal assessments are exercises or procedures specifically designed to know the skills and knowledge. They are systematic, planned sampling techniques and are constructed to give teacher and student an appraisal of student's achievement.
Formative Assessment Evaluating students in the process of โformingโ their competencies and skills with the goal of helping them to continue that growth process. For all practical purposes, virtually all kinds of informal assessment are (or should be) formative. It is done at a micro level every time we indicate that something is wrong and help students get it right. But it can also take place when teachers go through the results of progress and achievement tests.
Summative Assessment It aims to measure, or summarize, what a student has grasped, and typically occurs at the end of a course or a unit of instruction. There are final exams in a course or general proficiency exams. Most of the prevailing tests in an L2 instruction include (quizzes, periodic tests, midterm exams, etc.)
Topic- 079: Testing, Assessment, and Teaching
It shows the important relationship among testing, assessing, and teaching. However, there are some differences between Language Assessment and Testing.
1. Test A test, in simple terms, is a method of measuring a person's ability, knowledge, or performance in a given domain (Brown, 2004). A test is first a method: it is an instrument - a set of techniques, procedures, or items. To qualify as a test, the method must be explicit and structured: multiple-choice questions with prescribed correct answers; a writing prompt with a scoring rubric; an oral interview based on a question script. It is a checklist of expected responses to be filled in by the administrator. Secondly, a test must measure and base on a question script. Some tests measure general ability while others focus on very specific competencies or objectives. A test measures performance, but the results imply the test taker's competence. Finally, a test measures a given domain. Tests are prepared administrative procedures and occur at identifiable times in a curriculum, when learners muster all their faculties to offer peak performance knowing that their responses are being measured and evaluated.
2. Assessment and Teaching On the other hand, assessment is an ongoing process that encompasses a much wider domain. Whenever a student responds to a question, offers a comment, or tries out a new word or structure, the teacher subconsciously makes an assessment of the student's performance. Tests are a subset of assessment - only one among many procedures and tasks that teachers can ultimately use to assess students. Teaching is an overall process in which first comes assessment and then testing. Teaching sets up the practice games of language learning: the opportunities for learners to listen, think, take risks, set goals, and process feedback. The text poses the question: Are teachers constantly assessing students with no interaction that is assessment-free?
Topic- 080: Kinds of Testing
There are various reasons for testing which give rise to various categories of tests.
Placement Tests These are used to place students in classes/programs which are appropriate to their level of proficiency. Usually based on syllabus and material, they define characteristics of each level of proficiency, test grammar and vocabulary knowledge, and assess students' productive and receptive skills.
Diagnostic Achievement Tests These are used to explore learners' difficulties, gaps in their knowledge and skill deficiencies during a course. They identify students' strengths and weaknesses. Although difficult to construct, they benefit future instruction.
Progress or Achievement Tests They are designed to measure learners' language and skills progress in relation to the syllabus they have been following, i.e. how successful students are in achieving the objectives of a lesson. Closely related to the content of a particular lesson/course/curriculum, they are often written by the teachers and given to students every few weeks to see how well they are doing. They can form part of a formative assessment. These tests only work if they contain item types which the students are familiar with.
Proficiency Tests These tests give a general picture of a student's knowledge and ability in a language. They are frequently used as stages people have to reach if they want to be admitted to a foreign university, get a job or obtain some kind of certificate.
Aptitude Tests These are used to predict a person's future success in learning a foreign language. They are usually taken before actual learning.
Language Dominance Tests These are used to assess bilingual learners' relative strength in two or more languages. Portfolio Assessment: It has many benefits - provides evidence of students' efforts; helps students become more autonomous and self-monitor their own learning. It has clear validity since students have a chance to edit before submitting their work and has an extremely positive wash back effect.
Topic- 081: Principles of Language Assessment
In order to judge effectiveness of any test, it is sensible to lay down criteria against which a test can be measured.
1. Validity A test is valid if it tests what it is supposed to test; if it produces similar results to some other measures โ that is if we can show that Test A gives us the same kind of results as Test B. A test is only valid if there is validity in the way it is marked - if we score short written answers to a listening test for spelling and grammar, then it is not necessarily a valid test of listening. It is not valid to test writing ability with an essay question that requires specialist knowledge of History or Biology unless all students share the same knowledge.
๐ Definition โ Validity: A test is valid if it tests what it is supposed to test and produces similar results to some other measure.
2. Reliability A good test should give consistent results, e.g., if the same group of students took the same test twice within two days - without reflecting on the first test, they should get the same results on each occasion. If they took another similar test, the marking range would be the same. Reliability may be enhanced by making the test instruction absolutely clear, restricting the scope for variety in the answers and making sure that test conditions remain constant.
๐ Definition โ Reliability: A good test should give consistent results, meaning the same group of students would get the same results if they took the same test twice within a short period.
3. Wash Back Effect Teaching may become dominated by the needs of future tests and their components as teachers want their students to pass the tests and exams. Where non-exam teachers might use a range of different activities, exam teachers suffering from the wash back effect, might stick rigidly to exam format activities.
Things to consider about wash back effect: In the first place, modern tests, especially the direct items included in them, are grounded far more in classroom activities and methodologies. Secondly, even if preparing students for a particular test format is a necessity, it is equally important to build variety and fun into an exam in order to drive students towards learning. For good exam preparation, teachers need to familiarize themselves with the tests and they need to be able to answer their students' concerns and worries. However, they need to be able to walk a fine line between good exam preparations on one hand, and not being swept away by the wash back effect on the other.
What can we do? Train for Test Type: Show students various test types and ask them what each item is testing; help them get inside the heads of the designers; help them approach test items. For example, if the test is likely to contain MCQs, we can help students to appreciate the advantages of finding the obvious detractor first.
Discuss General Exam Skills: Ensure that they do not spend a disproportionate amount of time on only a part of an exam.
Do Practice Tests and Have Fun: Encourage students to write their own test items, based on their previous language learning.
Topic- 082: Designing Classroom Language Tests
An innovative testing format takes a lot of effort to be designed and a long time to be refined through trial and error. Some practical steps/questions in constructing classroom tests are the following:
Knowing the Purpose of the Test: i.e. why am I creating this test or why was it created by someone else? Was it created for an evaluation of overall proficiency? Or to place students into a course? Once you have established the major purpose of a test, you can determine its objectives.
Assessing Clear, Unambiguous Objectives: Carefully examine the objectives of the test. This involves a number of issues, ranging from relatively simple ones about forms and functions covered in a course unit to much more complex ones. Every curriculum should have clearly framed assessable objectives stated in terms of overt performance by students. For example, an objective โstudent will learn tag questionsโ is not specific. โStudents will recognize and produce tag questions, with the correct grammatical form and final intonation pattern, in simple social conversationsโ is the correct manner.
Drawing Up Test Specifications: Test specification should consist of: a broad outline of the test; what skills will be tested; what the items will look like.
Devising Test Tasks: The tasks that the test-takers must perform need to be practical. They should be reliable and easily evaluative by the teacher. The tasks themselves should strive for authenticity, and the progression of tasks ought to be biased for best performance. Start with some warm up questions and comments, then put objective questions that are level check questions, then probe (opinion based question). In the end, wind down (comments or reassurance). Designing multiple choice items and design each item to measure a specific objective. State both stem and options as simply as possible and make certain that the intended answer is clear and the only correct one. Use item indices to accept, discard, or revise items.
Scoring, Grading and/or Feedback: Tests vary in the form and function of feedback, depending on their purpose.
Topic- 083: Standardized Testing
A standardized test requires: (1) All test takers to answer the same questions or a selection of questions from common bank of questions in the same way. (2) Is scored in a โstandardโ or consistent manner which makes it possible to compare the relative performance of individual students or groups of students.
The term is primarily associated with large-scale tests administered to large populations of students, such as a multiple-choice test given to all the eighth-grade public-school students in a particular state. Standardized tests can also include true-false questions, short-answer questions, essay questions, or a mix of question types. These are increasingly being administered on computers connected to online programs. College entrance tests, such as SAT, GMAT, GRE are the standardized types of tests. Similarly, English language proficiency tests, such as TOEFL and IELTS, are also the examples of standardized tests.
Advantages of Standardized Tests
- A ready-made previously validated product that frees the teacher from having to spend hours creating a test.
- Easily administered to large groups within reasonable time limits.
- Scoring procedures are streamlined.
- Provide teachers with guidance for what and when something needs to be taught.
- Objective in nature.
- Provide accurate comparisons between subgroups.
Disadvantages of Standardized Tests
- Evaluates a student's performance on one particular day and does not take external factors in account.
- Also seems to ignore the gradual growth of a student over a period.
- Can create a lot of stress on both educators and students.
- Inappropriate use of such tests โ e.g., using an overall proficiency test as an achievement test because of the convenience of the standardization.
Norm-Referenced Tests: These tests are standardized tests designed to compare and rank test takers in relation to one another. A norm-referenced score is typically reported as a percentile ranking. For example, an individual who scores in the 90th percentile has performed as well as or better than 90% of other test takers.
Criterion-Referenced Tests: It measures an individual's performance against a set of predetermined criteria or performance standards. It is desirable for an individual to earn a perfect score. In educational settings, these tests may be used to assess whether the student has learned a specific body of knowledge.
โญ Key Takeaways
The most critical concepts to remember from this lecture are the distinction between testing (a formal, structured measurement), assessment (an ongoing, wider process), and teaching (the overall learning process). You must understand the different categories of tests: placement, diagnostic, progress/achievement, proficiency, aptitude, and language dominance, and their specific purposes. The three fundamental principles of language assessment โ validity, reliability, and the wash back effect โ are essential for evaluating any test's effectiveness, with validity ensuring the test measures what it intends to, reliability ensuring consistent results, and the wash back effect highlighting how testing can influence teaching. For designing classroom tests, remember the systematic steps: knowing the purpose, setting clear objectives, drawing specifications, devising practical tasks, and planning scoring/feedback. Finally, understand the characteristics, advantages, and disadvantages of standardized tests, and the difference between norm-referenced tests (comparing students to each other) and criterion-referenced tests (measuring against a fixed standard).
๐ง Quick Revision Questions
- What is the key difference between a test and an assessment, according to the lecture?
- List and briefly define four different kinds of language tests discussed in this lecture.
- Explain the concept of the "wash back effect." What is one strategy a teacher can use to manage it effectively?
- In the context of designing classroom tests, why is it important to state objectives in terms of overt performance? Provide an example.
- What is the primary purpose of a norm-referenced test, and how is its score typically reported?
๐ Lecture 16 โ Assessment of Language Skills II
๐ Overview: This lecture explores the critical processes of grading, test administration, and ethical considerations in language assessment. It emphasizes the importance of fair grading criteria, standardized administration procedures, and the need for alternative assessment methods that move beyond traditional standardized tests to capture a more holistic view of student ability.
๐๏ธ Topics Covered
The lecture covers grading systems (absolute and relative), cross-cultural factors affecting grading, test administration essentials including item writing and banking, training of staff, ethics and fairness in testing (critical language testing), and multiple alternatives in assessment such as portfolios, journals, conferences, interviews, observations, and self/peer assessments.
๐ Lecture Summary
Topic- 084: Grading and Student Evaluation
Our educational lives are determined by test grades, which define exceptional, failing, and average students differently across systems. This increases the importance of how grades should be assigned. Guidelines for Selecting Grading Criteria state that grades should be based on students' achievement only and represent the extent to which intended learning outcomes were achieved. They should not be contaminated by tardiness, misbehavior, or other extraneous factors. All grading components must be consistent with an institutional philosophy and explicitly stated in writing at the beginning of a term with percentages for each component.
For Calculating Grades, two systems exist. An absolute system pre-specifies standards on a numerical point system (e.g., established points for a midterm, final exam, semester totals). Relative grading is more common and allows the teacher's own interpretation and adjustment for unpredicted test ease or difficulty, usually accomplished by ranking students in order of performance using percentile ranks.
Cross-Cultural Factors affect grading significantly. In many cultures like Pakistan, students are not asked to self-assess; the teacher assigns a grade without questioning. A belief exists that a good teacher designs tests so difficult no student achieves a perfect score to demonstrate the teacher's superiority. One final examination is often the accepted determinant of a student's entire grade, and the notion of preparing students to do their best on a test can be seen as an educational contradiction.
Prototypes are preproduction models used to evaluate validity, perceived authenticity, and educational appropriateness of assessments. One or more prototypes guide teachers about the consequences of test results before full implementation.
Topic- 085: Administration and Training
The delivery of tests requires an infrastructure and set of procedures. Any mistakes, inconsistencies, or abnormalities in test administration can threaten validity, and any non-standard practice is a potential threat. Examples include an item writer not following test specifications, a rude usher, or a speaking test venue next to road work.
Essential Things for the Administration of Tests include several systems. Construction Systems require more than one form of a test, especially for testing at different times, making test security essential. Item Writing and Review requires trained writers to follow test specifications using item-writing templates, with the most problematic task being to ensure items meet specifications. Item Banking stores all items that survive review in a format allowing easy retrieval by search criteria (identifiers) and should contain statistical data like facility value, discrimination index, or difficulty estimate. Preparation and Dispatch requires uniform test presentation across all forms, with standardized computer interfaces and instructions in the same font type, style, and size. Distribution Systems require physical test components to be extracted from storage and dispatched securely to centers. Training of all staff who administer tests is crucial, especially raters for speaking and writing tests; this has frequently been why some large-scale tests lack speaking components. General training of test administration staff is vital because an interrupting invigilator can affect scores.
Topic- 086: Ethics and Fairness
The ethics of testing is seen as an extension of critical pedagogy, specifically critical language testing. Shohamy (1997) states, "Tests are most powerful as they are often the single indicators for determining the future of individuals." Proponents claim large-scale standardized testing is not unbiased but rather an "agent of cultural, social, political, educational, and ideological agendas that shape the lives of individual participants, teachers, and learners." Tests represent a social technology deeply embedded in education, government, and business, providing the mechanism for enforcing power and control.
Issues of Critical Language Testing include challenging psychometric traditions with interpretive, individualized procedures. Test designers have a responsibility to offer multiple modes of performance to account for varying styles and abilities. Tests are deeply embedded in culture and ideology; test-takers are political subjects in a political context, and testers always hold power over them. Tests can impose social and political ideologies and are used in some countries to deny citizenship. Tests promote the notion that real-world problems have unambiguous right and wrong answers. While language tests may be less susceptible to sociopolitical overtones than general-knowledge tests, teachers can exercise influence by choosing tests with the least culture bias, encouraging multiple measures of performance, and helping establish institutional systems of evaluation that emphasize ongoing formative evaluation over standardized tests.
Topic- 087: Alternatives in Assessment I
There is strong criticism of standardized tests because the test industry has become a powerful influence on decisions about people's lives (Kohn, 2000). Assessment is a broader concept than a test, which is administered for a specific purpose within a strict time limitation. In the early 1990s, a concept labeled "alternative assessment" emerged.
Common Characteristics of Various Alternatives in Assessment include requiring students to perform, create, produce, or do something; using real-world contexts or simulations; being nonintrusive and extending day-to-day classroom activities; assessing what students normally do in class; using meaningful instructional tasks; focusing on both processes and products; tapping into higher-level thinking and problem-solving skills; providing information about both strengths and weaknesses; being multiculturally sensitive; ensuring people, not machines, do the scoring using human judgment; encouraging open disclosure of standards; and calling upon teachers to perform new instructional and assessment roles.
Common Modes of Alternative Assessment include Portfolios, which contain essays, reports, poetry, artwork, recordings, journals, test scores, and homework. Journals are accounts of one's thoughts, feelings, reactions, assessments, ideas, or progress toward goals, written with little attention to structure or correctness. Most classroom journals are dialogue journals, implying interaction between a teacher and student through dialogues or responses.
Topic- 088: Alternatives in Assessment II
Conferences and Interviews are routine in language classrooms. A conference is a conversation about a draft that facilitates improvement of written work, where the teacher directs feedback toward specific needs. Possible functions include commenting on drafts, reviewing portfolios, responding to journals, advising on oral presentations, assessing project proposals, giving feedback on test results, clarifying reading, setting personal goals, and assessing general progress. Useful questions include: "What did you like about this work?", "What do you think you did well?", "How does it show improvement?", and "Did you have any difficulties?"
An Interview is a context where a teacher interviews a student for a designated assessment purpose. Possible goals include assessing oral production, ascertaining needs before designing a course, discovering learning styles/preferences, or requesting a course evaluation.
Observations are systematic, planned procedures for real-time assessment. All teachers constantly observe students, storing intuitive perceptions as information forming a composite impression of ability. Important steps include: determining specific objectives, deciding how many students to observe, setting up logistics for unnoticed observations, designing a recording system, limiting elements observed, determining how to use results, and using recording checklists and rating scales.
Self and Peer Assessments might be seen as a reversal of power relationships. Self-assessment derives from learner autonomy and intrinsic motivation, while peer-assessment appeals to cooperative learning. Types include: direct assessment of specific performance, indirect assessment of general competence, metacognitive assessment (for setting goals), and socio-affective assessment, which includes student-generated tests.
โญ Key Takeaways
The most critical concepts from this lecture are: 1) Grades should be based solely on achievement, not extraneous factors, and can be calculated using absolute or relative systems with cultural sensitivity. 2) Test administration requires rigorous quality assurance in item writing, banking, preparation, and staff training to maintain validity. 3) Ethics in testing is a critical concern because tests can act as agents of power and ideology, not neutral measurement tools. 4) Alternative assessment methods (portfolios, journals, conferences, interviews, observations, self/peer assessment) offer broader, more authentic evaluation than standardized tests by focusing on processes and real-world tasks. 5) Understanding cross-cultural factors is essential for fair grading, as different educational traditions view teacher authority, student self-assessment, and test difficulty differently.
๐ง Quick Revision Questions
- What are the two main systems for calculating grades, and how do they differ?
- List four essential steps in the observation process for alternative assessment.
- According to Shohamy (1997), why are tests considered "powerful" in society?
- What is the difference between a conference and an interview in the context of alternative assessment?
- What are three common characteristics that all forms of alternative assessment share?