📘 Lecture 20 — Measuring Competencies
📖 Overview: This lecture explains how employee competencies (which are indicators of displayed behaviors) are evaluated using comparative systems. It details four key methods—simple rank order, alternation rank order, paired comparisons, and forced distribution—and discusses the advantages and disadvantages of these relative evaluation techniques. Understanding these systems is critical for designing fair and legally defensible performance appraisals.
🗂️ Topics Covered
This lecture covers two main systems to evaluate employees’ competence levels: Comparative Systems and Absolute Systems, with a focus on the former. Within comparative systems, it explains four specific methods: Simple Rank Order, Alternation Rank Order, Paired Comparisons, and Forced Distribution. The lecture concludes with the advantages (ease of explanation, clear results, bias control) and disadvantages (single-criterion focus, legal challenges, insufficient feedback, forced distribution harms teamwork) of these evaluation techniques.
📝 Lecture Summary
Measuring Competencies
Employee competencies are considered as indicators of displayed behaviors. To assess employee behaviors, there is a need to develop a mechanism to measure the competence level of employees. There are mainly two systems to evaluate employees’ competence levels: Comparative Systems and Absolute Systems. This chapter focuses on comparative systems.
Comparative Systems
According to this system, an employee’s competence level is evaluated by comparing it with that of other employees. Behaviors of employees are evaluated and compared with one another through the following methods:
- Simple Rank Order
- Alternation Rank Order
- Paired Comparisons
- Forced Distribution
Simple Rank Order
In this method, employees are simply ranked from best to worst performer.
🔑 Definition — Simple Rank Order: A comparative performance evaluation method where employees are ranked from best to worst performer.
Alternation Rank Order
According to this evaluation technique, initially all the employees are listed. Then the supervisor selects the best performer, then the worst performer, then the second best, then the second worst, and so forth until all the employees have been evaluated/ranked.
🔑 Definition — Alternation Rank Order: A comparative evaluation technique where a supervisor identifies the best, then worst, then second best, then second worst performers sequentially until all employees are ranked.
Paired Comparison
This evaluation method consists of explicit comparisons between all pairs of employees to be evaluated. Performance of each employee is evaluated in comparison to the performance of all the other employees. The formula to count the pairs of employees to be evaluated is:
📐 Formula: n (n-1) / 2 → Where n is the total number of employees. This gives the number of unique pairs to be compared.
Once all the comparison pairs are developed, the best pair among all is selected, and the employee is ranked on the basis of the number of pairs in which he/she is considered better than other employees.
📌 Example: If there are 5 employees (n=5), the number of pairs is 5(5-1)/2 = 5*4/2 = 10 pairs. Each employee is compared with every other employee. The employee who is judged better in the most pairs receives the highest rank.
Forced Distribution
In the forced distribution method, employees are apportioned according to an approximately normal distribution. A quota is predefined for best, average, and poor performers. For instance, considering that 20% of the employees must be categorized as best, 20% as worst, and 60% should be labeled as average employees.
🔑 Definition — Forced Distribution: A comparative evaluation method where employees are distributed into predefined performance categories (e.g., top 20%, middle 60%, bottom 20%) approximating a normal distribution.
Advantages of Comparative Systems
The following characteristics have increased the popularity of this evaluation system:
- These comparison-based evaluations are easy to explain; specifically, simple rank order is the easiest way to rank employees.
- The evaluation results are simple, and an employee’s rank can be seen clearly among the list of performers.
- Evaluation techniques of comparative systems provide unbiased results; evaluation biases like leniency, strictness, and average rating can be controlled through simple rank order, alternation rank order, and paired comparisons.
Disadvantages of Comparative Systems
These evaluation methods also have limitations:
- These techniques evaluate the employee usually on a single criterion while ignoring other major traits like individual skills, competencies, knowledge, etc. The whole evaluation is based on comparison of overall performance and not on particular individual performance factors.
- As these evaluations are relative and not absolute, they are more likely to be legally challenged.
- Evaluation ranks only identify the difference in performance but do not measure the difference in performance. Therefore, performance feedback provided through ranks is insufficient to improve performance by low performers.
- The forced distribution method evaluates employees in a normal distribution, which cannot be applicable in every organization and/or department. Through this method, even the best performers may be forced to be considered as low or average performers. This forceful distribution destroys interpersonal harmony and support in the working environment, and therefore, a major part of contextual performance is ignored while making evaluations through this technique.
💡 Why this matters: Comparative systems are quick and easy but can harm morale and legal defensibility. Managers must choose methods that balance simplicity with fairness.
⭐ Key Takeaways
Comparative systems evaluate employee competence by comparing individuals against each other, using methods like simple rank order, alternation rank order, paired comparisons, and forced distribution. These methods are easy to explain and control for common rater biases like leniency and strictness. However, they are limited because they assess performance on a single overall criterion rather than multiple competencies, making them vulnerable to legal challenges. Additionally, ranks show only the order of performance, not the magnitude of difference, which provides insufficient feedback for improvement. Forced distribution in particular can disrupt teamwork by forcing even good performers into low categories.
🧠 Quick Revision Questions
- What is the main difference between comparative and absolute systems of performance evaluation?
- How does the alternation rank order method differ from simple rank order?
- Using the formula n(n-1)/2, how many paired comparisons are needed for 8 employees?
- List two advantages and two disadvantages of comparative systems.
- Why is forced distribution considered harmful to workplace relationships?
📘 Lecture 21 — Measuring Competencies; Continued...
📖 Overview: This lecture explores absolute systems of performance evaluation, where employees are assessed based solely on their actual performance without comparison to others. It covers five key methods—essays, behavior checklists, critical incidents, graphic rating scales, and behaviorally anchored rating scales (BARS)—detailing their procedures, strengths, and limitations.
🗂️ Topics Covered
The lecture defines absolute systems and then examines each method in sequence: Essays as narrative feedback tools, Behavior Checklists for behavior-based evaluation, Critical Incidents for capturing exceptional or problematic events, Graphic Rating Scales as the most popular trait-based method, and Behaviorally Anchored Rating Scales (BARS) which combine graphic ratings with critical incidents for job-specific behavioral assessment.
📝 Lecture Summary
Absolute Systems:
According to this system, employees are evaluated on the basis of their actual performance regardless of any comparison with other performers. Behaviors of employees are evaluated through the following methods in the absolute system of evaluation: Essays, Behavior Checklist, Critical Incidents, Graphic Rating Scales, and Behaviorally Anchored Rating Scales (BARS).
Essays:
In this appraisal approach, the supervisor writes essay-like statements describing specific strengths and weaknesses in the job performance of the employee being appraised. These appraisal essays address identified problem areas and provide suggestions to improve performance. As performance feedback is provided in the form of an essay, therefore any relevant issue or attribute of performance can be explained openly and clearly in this evaluation technique. However, there is no fixed format to report performance evaluation, therefore reports are considered more subjective and are difficult to compare and contrast individual performances in order to draw any broad conclusions.
💡 Why this matters: Essays provide rich qualitative feedback but lack standardization, making it hard to compare employees or aggregate data across a team.
Behavior Checklist:
The checklist method is a performance evaluation method in which performer’s behaviors are analyzed and evaluated. Employee performance is considered an outcome of his/her displayed behavior; therefore performance is evaluated on the basis of employee’s behavior. The evaluator/supervisor initially lists the essential work behaviors in a particular job, against which the rater mentions whether or not each behavior has been performed by the ratee, along with the degree to which the employee has displayed the desired behavior. The checklist of behaviors is derived from the job analysis, therefore reflects the complexity of the job.
🔑 Definition — Behavior Checklist: A performance evaluation method where essential work behaviors are listed, and the rater indicates whether each behavior was performed and the degree to which it was displayed.
Critical Incidents:
According to the critical incident method, specific events/incidents in which the employee performed exceptionally or did something that needs improvement are reported and considered while appraising employee’s performance. This technique incorporates the description of the event and does not rely on ratings or rankings. This method provides fruitful performance feedback to the employees in order to rectify issues and improve performance. In spite of all its benefits, it is considered as a time-consuming activity where it is difficult to quantify the critical incidents. Moreover, compilation of each critical incident is a hectic task.
🔑 Definition — Critical Incidents: Specific events where an employee performed exceptionally or did something needing improvement, described qualitatively without ratings or rankings.
Graphic Rating Scale:
This method is considered to be the most popular method of performance appraisal. In this evaluation method, job-related traits are listed against which the rater is supposed to appraise the employee’s performance. It is essential that the rater has complete description of each dimension and scale. For example, to assess a Project Manager, his/her awareness about knowledge of project management planning, updating status, working within budget, and delivering project on time and within budget is evaluated through a scale (typically ranging from poor to excellent).
🔑 Definition — Graphic Rating Scale: A performance appraisal method where job-related traits are listed, and the rater appraises performance using a defined scale for each dimension.
Behaviorally Anchored Rating Scales (BARS):
This is a type of graphic rating scale in which initially all the important dimensions of a job are identified. Afterwards, the rater generates critical incidents illustrating low, average, and high skills of performance for each dimension. Supervisors/managers consider each dimension with its accompanying definitions and a randomized list of relative critical incidents. Based on these ratings along with respective critical incidents, the evaluator assigns a scale value to each incident. In this manner, this evaluation method combines a graphic rating scale with a critical incidents system. BARS focuses on the desired behaviors of a specific job, therefore a common tool cannot be applied for multiple jobs.
💡 Why this matters: BARS provides greater clarity and consistency than a simple graphic rating scale because it ties each rating point to concrete behavioral examples specific to the job.
🔑 Definition — Behaviorally Anchored Rating Scales (BARS): A performance evaluation method that combines a graphic rating scale with critical incidents, where job dimensions are identified and specific incidents illustrate low, average, and high performance for each dimension.
⭐ Key Takeaways
Absolute systems evaluate employees purely on their own performance without comparison to others, using methods like essays, checklists, incidents, rating scales, and BARS. Essays are flexible but subjective and hard to compare, while behavior checklists provide structure derived from job analysis. Critical incidents offer rich qualitative feedback but are time-consuming and difficult to quantify. The graphic rating scale is the most popular method but relies on clear dimension definitions. BARS is the most sophisticated, combining graphic rating with behavioral anchors specific to each job, making it highly relevant but not transferable across jobs.
🧠 Quick Revision Questions
- What are the five methods of performance evaluation in the absolute system?
- Why are essays considered subjective and difficult to compare across employees?
- How does the behavior checklist method ensure that the evaluation reflects the complexity of the job?
- What is the main advantage and main disadvantage of the critical incidents method?
- How does BARS combine the features of a graphic rating scale and a critical incidents system?
📘 Lecture 22 — APPRAISAL FORMS
📖 Overview: This lecture explains the role and structure of appraisal forms as the primary tool for collecting performance information in a Performance Management System (PMS). It details the essential components of effective appraisal forms, the criteria for their effectiveness, and the advantages of electronic over manual forms, providing a practical guide for designing and using these forms.
🗂️ Topics Covered
This lecture covers the definition and purpose of appraisal forms, then systematically describes nine core components essential for an effective form, including basic employee information, accountabilities, competencies, achievements, stakeholder input, and signatures. It then outlines seven key criteria for evaluating form effectiveness—such as simplicity, relevancy, and definitional clarity—and concludes with a discussion of the benefits and practical use of electronically filled appraisal forms.
📝 Lecture Summary
Appraisal Forms
An appraisal form is an instrument used to collect information on employee performance, based on which performance is evaluated. It is also used to document employee performance and maintain a record. These forms can be filled manually or electronically. No single appraisal form is universally correct or acceptable; rather, the composition of a form is considered appropriate based on the purposes of the appraisal. For instance, some forms adopt a behavior approach emphasizing only competencies while ignoring results. Forms used for developmental purposes, and not for administrative usage, emphasize developmental issues and ignore both results and behaviors.
Components of Appraisal Forms
Whether the appraisal form is manual or electronic, it should contain the following information to ensure an effective performance evaluation:
-
Basic Employee Information: This section includes job title, division, department, employee number, pay scale/grade, dates of evaluation period, number of months/years the rater has supervised the employee, employee's starting date, reason for appraisal, current salary, and date of next scheduled evaluation.
-
Accountabilities, objectives and standards: This section includes the description of each accountability, the objectives agreed upon by manager and employee, and the extent to which those objectives have been achieved. In a result-based approach, performance goals are weighed by importance, and these assigned weights facilitate in calculating an overall performance score. It may also include a subsection describing the conditions under which performance was achieved.
-
Competencies and indicators: This section includes definitions of various competencies to be assessed, along with their behavioral indicators. A PMS following a behavioral approach of assessment must include this section.
-
Major achievements and contributions: The rater is asked to list the major accomplishments of the individual during the review period, which facilitates both result and behavioral performance assessment.
-
Developmental achievements: This section includes information about the extent to which developmental goals have been achieved (e.g., workshops attended, new skills learned). Some organizations exclude this section because it can be difficult for employees to focus constructively on development if they have received a low performance review.
-
Developmental needs, plans and goals: Future-oriented organizations include information about specific goals and timetables for employee development in this section.
-
Stakeholder input: This section is filled out by other stakeholders (e.g., customers, peers, subordinates) who rate the employee on relevant competencies, such as “teamwork” by peers and “reliability” by customers.
-
Employee’s comments: An effective appraisal form includes a section for the employee being rated to record their reactions/comments. This improves the perceived fairness of the system and addresses possible legal issues.
-
Signatures: In the final section, the employee, rater, and rater’s supervisor provide signatures to verify they have read and acknowledged the evaluation. The HR department may also approve the form's content.
Effectiveness of Appraisal Forms
To ensure effectiveness, an appraisal form should meet several desirable features:
-
Simplicity: The form must be easy to understand and administer, quick to complete, and clear and concise for both raters and ratees.
-
Relevancy: The form must include information directly related to the tasks and responsibilities of the job. It should be seen as a tool for performance improvement, not just an administrative burden.
-
Descriptiveness: The form must require raters to provide evidence of performance regardless of performance level. It should be descriptive enough that an outside party (e.g., a supervisor’s supervisor) has a clear understanding of the information.
-
Adaptability: The form must allow managers in different functions/departments to adapt it to their particular needs and situations, encouraging widespread use.
-
Comprehensiveness: The form must include all major areas of performance for a particular position for the entire review period.
-
Definitional clarity: The form must ensure that desirable competencies/results are defined for all raters so that everyone evaluates the same attributes. This enhances consistency of ratings across raters and organizational levels.
-
Communication: The meaning of each component must be successfully communicated to all people participating in the evaluation process. This feature enhances acceptance of the system and motivation to participate.
-
Time orientation: The form must help clarify expectations about performance and address both past and future performance aspects.
Electronically filled Appraisal Forms
Electronic appraisal forms are preferred over manual forms, especially with large numbers of employees and amounts of performance information. The benefits of electronic forms include:
- Information is stored and can be easily shared between the rater and the HR department.
- They can help in subsequent analyses (e.g., comparing average performance levels across organizational units).
- They are easier to modify, revise, and update as changes occur in the organization or job.
Sample of an Appraisal Form
A sample appraisal form is provided in the lecture text (pages 53-57) for reference, but its content is not summarized here.
⭐ Key Takeaways
An appraisal form is a critical instrument for collecting, documenting, and evaluating employee performance, and its design must align with the specific purposes of the appraisal system. A truly effective form must be composed of nine essential components, including basic employee info, accountabilities, competencies, achievements, and signatures, to ensure a comprehensive and fair evaluation. The effectiveness of a form is judged by its simplicity, relevancy, descriptiveness, adaptability, comprehensiveness, and definitional clarity, among other criteria, which help guarantee consistency and acceptance. Electronic forms offer significant advantages over manual ones, such as easier data sharing, analysis, and updating, making them preferable for modern, data-driven organizations. Finally, no universal form exists; the composition of an appraisal form must be thoughtfully tailored to fit the organization’s strategic and performance management goals.
🧠 Quick Revision Questions
- What is an appraisal form and what are its two primary functions in a Performance Management System?
- Name at least four of the nine essential components that an effective appraisal form should contain.
- List and briefly explain four of the eight desirable features that make an appraisal form effective, according to the lecture.
- Why are electronically filled appraisal forms generally preferred over manual ones? State at least two reasons.
- Why is it important for an appraisal form to include a section for "Employee's comments" and a "Signatures" section?