๐ Lecture 39 โ Measuring Personal Characteristics for Job Placement
๐ Overview: This lecture explores psychological methods for assessing personal characteristics to determine job suitability. It presents two major theoretical approaches โ Osipowโs Trait Factor Approach and Roeโs Career-choice Theory โ and describes the assessment tools derived from each. Understanding these approaches helps in matching individuals to careers based on their traits, interests, and upbringing.
๐๏ธ Topics Covered
The lecture begins by asking what factors people consider when choosing a job, such as personal interest, aptitude, skills, workplace setting, and colleagues. It then introduces two key theories: Osipowโs Vocational Dimensions Approach (Trait Factor Approach), which uses a battery of tests like the Kuder Occupational Interest Survey and Strong-Campbell Interest Inventory; and Roeโs Career-choice Theory, which emphasizes person vs. nonperson orientation and the influence of childhood family experiences on career choice, including the California Occupational Preference Survey and the concept of two independent continua.
๐ Lecture Summary
Osipowโs Vocational Dimensions Approach: The Trait Factor Approach
One psychologist best known for the use of the trait factor approach for job decision making is Samuel Osipow. This approach has a global perspective, considering a number of traits or aspects of a personโs personality. A battery of tests is used for assessment. The battery includes a variety of tests such as the Kuder Occupational Interest Survey (Kuder, 1979), Strong-Campbell Interest Inventory (Campbell, 1974), Seashore Measure of Musical Talents (Lezak, 1983), and Purdue Pegboard (Fleishman & Quaintance, 1984). This approach provides quite comprehensive information regarding the traits and interests of the person. However, it is criticized for not taking much into account the work environment. Nevertheless, this approach is found to be very useful in helping people make occupational decisions.
๐ก Why this matters: The Trait Factor Approach offers a structured, multi-test method for career counseling, but its limitation is ignoring workplace context, so it should be supplemented with environmental assessments.
Roeโs Career-choice Theory: The California Occupational Preference Survey
The core feature of Roeโs theory is its emphasis on โpersonโ or โnonpersonโ orientation found in people. According to Roe, this orientation plays a significant role in peopleโs career choice. In simpler terms, whether one likes to be with other people or not affects oneโs career choice. The person/people-oriented people would be looking for jobs where they are in contact with other people, e.g., Arts, entertainment, or other services. The individuals who are not people-oriented would be seeking jobs that involve little interpersonal contact, e.g., lab work, science and technology, field exploration, etc. Roe drew some very interesting conclusions from extensive examination of the personalities of scientists working in different areas of study. Roe proposes that career choices people make in life are a result of their childhood experiences of relationship with their families. According to Roe, whether people, as children, were reared in a warm family environment or a cold and aloof one determines if they are interested in other people or not. Children brought up in a warm and accepting family environment grow into people-oriented adults. On the other hand, children who experienced a cold and aloof environment turn into adults who are interested in things rather than people (Roe & Klos, 1969; Roe & Siegelman, 1964). Roe and Klos (1969) proposed the idea that occupational roles can be divided into two classes according to two independent continua. The first continuum goes from โorientation to purposeful communicationโ to โorientation to resource utilizationโ. The second continuum goes from โorientation to interpersonal relationsโ to โorientation to natural phenomenaโ. People make career choices according to where they stand on these two continua.
๐ Definition โ Person/Nonperson Orientation: A core concept in Roeโs theory where a personโs preference for being with other people (person-oriented) versus being with things or alone (nonperson-oriented) significantly influences career choice.
๐ Formula: Career choice = f(Childhood family environment โ Person/Nonperson orientation โ Position on two continua: [Purposeful Communication โ Resource Utilization] + [Interpersonal Relations โ Natural Phenomena]) โ Occupational role
๐ Example: A child raised in a warm, accepting family environment is likely to become a people-oriented adult. This person would be positioned closer to โorientation to interpersonal relationsโ on the second continuum and might choose a career in Arts or Entertainment (e.g., a theater director). In contrast, a child raised in a cold, aloof environment is likely to become a nonperson-oriented adult, positioned closer to โorientation to natural phenomenaโ on the second continuum, and might choose a career in science and technology (e.g., a research physicist working in a lab with minimal interpersonal contact).
โญ Key Takeaways
This lecture introduces two major theoretical approaches for matching personal characteristics to jobs. Osipowโs Trait Factor Approach emphasizes using a comprehensive battery of tests (e.g., Kuder, Strong-Campbell, Seashore, Purdue Pegboard) to assess multiple traits, though it is criticized for neglecting the work environment. Roeโs Career-choice Theory focuses on the person vs. nonperson orientation, arguing that career choices are shaped by childhood family experiences โ warm families produce people-oriented adults, while cold families produce thing-oriented adults. Roe further divides occupational roles using two continua: purposeful communication vs. resource utilization, and interpersonal relations vs. natural phenomena. For the exam, remember the names of the psychologists (Osipow and Roe), the specific tests in Osipowโs battery, and the key terms of Roeโs theory including the two continua.
๐ง Quick Revision Questions
- What is the main criticism of Osipowโs Trait Factor Approach?
- List four tests included in Osipowโs battery for vocational assessment.
- According to Roe, how does childhood family environment influence career choice?
- What are the two independent continua proposed by Roe and Klos (1969)?
- According to Roe, what type of career would a nonperson-oriented individual likely choose?
๐ Lecture 40 โ Achievement and Educational Tests
๐ Overview: This lecture explores the use of psychological tests in educational settings for various purposes including achievement assessment, diagnosis, selection, and screening. It focuses primarily on achievement tests, discussing their design, types, and key considerations like what, how, and when to assess, while also comparing teacher-made tests with standardized tests and clarifying the distinction between achievement and aptitude tests.
๐๏ธ Topics Covered
The lecture covers the various purposes of testing in educational settings, then focuses on achievement testsโtheir definition and the "What, How, and When" decisions. It discusses teacher-made tests, including objective/forced-choice items and subjective/descriptive tests, and their respective advantages and disadvantages. Other varieties of standardized achievement tests (SAT-I, GRE, MAT) are reviewed, followed by a comparison of achievement versus aptitude tests and interpretive issues like grading, percent scores, and percentile ranks.
๐ Lecture Summary
Achievement Tests
Achievement tests are meant to assess if students or trainees have learned whatever they were supposed to learn at the end of a course or program of instruction. These tests measure the students' achievement alongside the effectiveness of a program.
What, How, and When of Achievement Tests
The assessment of achievement involves three basic decisions:
What Is To Be Assessed? This decision pertains to: a. The course content to be covered by the assessment tool. b. The instructional objectives that specify the expected and desired outcomes of the teaching-learning process.
How to Assess? This decision pertains to: a. The type of the assessment tool. b. The administration procedure. c. The number, format, and difficulty level of test items.
When to Assess? This decision involves answers to these questions: a. At what time during the academic session will the assessment take place? b. Once in a term, or more than once? This decision will affect the content area to be covered in assessment.
๐ก Why this matters: Of all the above issues and decisions, the most significant is to cover in the test the content area that the students have been taught, keeping in mind the objectives specified for every component of the content.
Teacher Made Achievement Tests
Teacher made achievement tests are the most common type of achievement tests. Teachers have a choice to design and develop their tests the way they like them to be. A teacher made test can be either objective or subjective. On occasions it may be a combination of both.
Objective or Forced Choice Type of Items
These items are difficult to develop but easy to score. They allow the teacher to cover a wide range of content area. There is always a chance of selecting the right answer simply by guessing, but this can be controlled. If the items are MCQs with 4-5 options per item, and the options are carefully developed, then guessing can be controlled to a large extent. Another advantage is uniformity of scoring across examinersโno matter who does the scoring, the students will receive the same score. The essential requirement for availing these benefits is care in writing test items. The stem of every item should be clearly stated, should not be ambiguous, and should convey what the examiner wants to convey. Even more important is the selection of appropriate response options. A good MCQ item is the one in which every option appears to be the right answer, so only those who know the course content can select the right choice.
Subjective or Descriptive Tests
Subjective or descriptive tests also have their advantages. The nature of the items allows the examiner to test in-depth knowledge of the students. However, marking and evaluation of such examiner papers may be problematic. The inter-examiner uniformity of scoring is doubtful in such tests. Examiners' personal or ideological biases may interfere with the objectivity in evaluation required of a just teacher. Ultimately, it is for the examiners to decide what format they prefer to use and what would suit best to the course content.
Other Varieties of Achievement Tests: Standardized Achievement Tests
Other than teacher-made achievement tests, a variety of standardized achievement tests are used at national and international level.
The Scholastic Assessment Test (SAT-I): Previously known as Scholastic Aptitude Test or SAT, first used in 1926, this is the most commonly used college entrance test in the U.S. SAT-I has two parts: Verbal Reasoning and Mathematical Reasoning tests. SAT-II is also available.
Graduate Record Examination Aptitude Test (GRE): GRE is one of the most well-known tests across the globe and is the most commonly used graduate-school entrance test. GRE measures general scholastic ability and contains three sections: Verbal (GRE-V), Quantitative (GRE-Q), and Analytic (GRE-A).
Miller Analogies Test (MAT): MAT is the second major, widely used, scholastic aptitude test. It is a verbal test that measures a student's ability to find logical relationships for 100 different analogy problems.
๐ Definition โ Achievement tests: Tests meant to assess if students or trainees have learned whatever they were supposed to learn at the end of a course or program of instruction.
๐ Definition โ Teacher made achievement tests: The most common type of achievement tests, designed and developed by teachers, which can be objective, subjective, or a combination of both.
๐ Definition โ Objective/Forced Choice items: Items that are difficult to develop but easy to score, allow covering a wide range of content, and provide uniformity of scoring across examiners.
๐ Definition โ Subjective/Descriptive tests: Tests where the nature of items allows testing in-depth knowledge, but marking and inter-examiner uniformity of scoring may be problematic.
Achievement versus Aptitude Tests
A common question arises: what is the difference between achievement tests and aptitude tests? In most situations these terms are used interchangeably. If one analyzes logically, it is not possible to cover in one test all of the content that students from different institutions, regions, and countries have studied. Kaplan and Saccuzzo (2001, p. 343) have given a very good comparative description of the features of the two types of tests.
Grading, Percent Score, And Related Interpretive Issues
School/college tests usually use the grading system. Scores are also given in terms of percent. Grades make it easier to understand the relative position of students. In large scale tests, like GRE or GAT, the results are communicated in terms of percentile ranks. These describe a candidate's position in relation with those scoring above as well as those scoring below him or her.
โญ Key Takeaways
Achievement tests are designed to assess what students have learned in a program of study, and their construction requires careful decisions about content, instructional objectives, assessment format, and timing. Teacher-made tests can be objective (forced-choice) or subjective (descriptive), each with distinct trade-offs: objective items are harder to construct but easier to score and ensure inter-examiner reliability, while subjective items allow depth but risk evaluator bias. Standardized tests like SAT-I, GRE, and MAT assess general scholastic ability and are widely used for college and graduate admissions. The distinction between achievement and aptitude tests is often blurred in practice, and results are typically interpreted using grades, percent scores, or percentile ranks. The most critical principle is that tests must align with the content taught and specified instructional objectives.
๐ง Quick Revision Questions
- What are the three basic decisions involved in the assessment of achievement?
- What are the advantages and disadvantages of objective/forced-choice test items?
- What are the advantages and disadvantages of subjective/descriptive test items?
- Name three standardized achievement tests discussed in the lecture and briefly describe what each measures.
- How are results typically communicated in large scale tests like GRE or GAT, and what do these measures describe?
๐ Lecture 41 โ Multicultural Testing
๐ Overview: This lecture explores the challenges and solutions in psychological testing when test-takers come from diverse cultural backgrounds. It examines how cultural factors can introduce bias into standardized tests and presents specific tests designed to be culture-free or culture-fair, ensuring equitable assessment across different populations.
๐๏ธ Topics Covered
The lecture introduces the concept of multicultural testing and why it is necessary when working with diverse populations. It details four key factors that can cause cultural bias in testing: language, reading ability, speed, and familiarity with test formats. Finally, it describes four specific multicultural tests designed to minimize or eliminate cultural bias: the Leiter International Performance Scale-Revised, Raven Progressive Matrices, Goodenough-Harris Drawing Test, and the IPAT Culture Fair Intelligence Test.
๐ Lecture Summary
Multicultural Testing
Psychologists often work with subjects or clients from diverse cultural backgrounds, where cultural background may interfere with test performance. There is a need for tests that can be used with all people and that are neither biased against nor in favor of any specific cultural origin. Multicultural testing refers to tests and testing procedures that are not affected by the cultural background of the test taker. Such situations arise when immigrants from different cultural backgrounds settle in developed countries and need to be tested on the same variables using the same tests. Examples include measurement of IQ or personality, screening or selection for jobs, and diagnosis of maladjustment or mental illness. Even people belonging to subcultures within a larger society may experience cultural disadvantage. The content, administration, scoring procedures, or scores of multicultural tests are not affected by the cultural origin of the test taker. Multicultural testing is also known as transcultural testing or cross-cultural testing.
๐ Definition โ Multicultural Testing: Tests and testing procedures that are not affected by the cultural background of the test taker.
Factors That May Cause Cultural Bias
Cultural differences become significant when people have to take psychological tests developed in cultures other than their own. Anastasi and Urbina (2007) describe four parameters along which cultural differences may be found: a. Language: People are at a disadvantage if they can only use the language of their own culture, not the one used in the culture where they must adjust. They will be handicapped if psychological tests are administered in an unfamiliar language. b. Reading Ability: People are still at a disadvantage if they cannot read. Most tests require a certain level of reading ability. People may be familiar with the language the test is designed in, but they will remain handicapped if they cannot read the test items. c. Speed: The speed required for completing a test may also cause problems. In some cultures, life is fast and people are familiar with a sense of urgency to meet deadlines. In other cultures, the tempo of life is slower (e.g., rural and agricultural societies), and people are used to patiently waiting rather than striving for immediate outputs. Persons from such cultures may find it difficult to cope with speed-based tests. d. Familiarity With The Format, Style, And Contents Of Tests: People may not be familiar with certain forms of test items and formats. They may find it hard to attempt certain types of items, take longer than allocated time, and make mistakes because they cannot understand what they are supposed to do. For example, people may find it difficult to attempt MCQ-type questions if they have not seen such items previously. Problems involving figures for assessing spatial reasoning may be a totally new experience for test takers who have never seen geometric drawings.
Multicultural tests generally do not involve reading or writing, verbal ability, or test-taking speed. Familiarity with format, style, and contents is controlled by using performance and drawing-based items, and avoiding the use of designs and patterns that most people cannot relate to.
๐ Definition โ Cultural Disadvantage: The disadvantage experienced by certain segments of the population because the nature of many standardized tests favors specific cultural backgrounds. ๐ก Why this matters: Understanding these factors is crucial for identifying when a test score reflects genuine ability versus cultural unfamiliarity.
Some Multicultural Tests
The Leiter International Performance Scale- Revised (LIPS-Revised)
The LIPS-Revised (Roid & Miller, 1997) is an individually administered test measuring intellectual ability. It was first developed in 1940 and has undergone many revisions. It can be used with all age groups from 2 to 20 years. Its 1997 version was standardized on a sample of 2000, both atypical and normal subjects from the U.S. Special features:
- Does not involve verbal instructions.
- Individually administered, following a difficulty level sequence (easiest item first).
- No time limit.
- Easels are used to present graphic stimulus materials; picture cards are placed in a response tray.
The scale covers four domains: Reasoning, Visualization, Attention, and Memory. Tasks for Reasoning and Visualization include matching, form completion, design analogies, sequential ordering, paper folding, figure rotation, and classification. Tasks for Attention and Memory include sustained and divided attention measures, and immediate and delayed memory tasks.
Raven Progressive Matrices
One of the most popularly used nonverbal and culture-free tests of general intelligence is the Raven Progressive Matrices (RPM). It uses a multiple-choice format. In each test item, the subject is asked to identify the missing element that completes a pattern. The test can be administered to groups or individuals from 5 years old to older adults. There are 60 matrices with a missing part presented in graded difficulty. The subject selects the appropriate pattern from a group of eight options.
Goodenough-Harris Drawing Test
The Goodenough-Harris Drawing Test (G-HDT) is the quickest, easiest, and least expensive nonverbal test for measuring intelligence. The subject is asked to draw a whole human figure. The test is scored for each item included in the drawing. The subject gets credit for inclusion of elements such as individual body parts, proportion, perspective, and clothing details. The scoring follows the age differentiation principle; older children tend to get more points because of greater accuracy. It is not a test of drawing or artistic skill, but of the development of conceptual thinking and accuracy of observation. In the revised scale, the subject is asked to draw a picture of a man, a woman, and of one's own self. The self-scale is used as a projective test of personality. Scores on the G-HDT can be related to Wechsler IQ scores. The test can be more appropriately used in combination with other tests of intelligence.
๐ Definition โ Age Differentiation Principle: The principle that older children tend to get more points on the Goodenough-Harris Drawing Test because of greater accuracy in their drawings. ๐ Key Relationship: G-HDT scores โ can be related to Wechsler IQ scores.
IPAT Culture Fair Intelligence Test
R. B. Cattell directed the development of this test. The IPAT Culture Fair Intelligence Test is a paper-pencil test for three levels:
- Age levels 4-8 years and mentally disabled adults.
- Age levels 8-12 and randomly selected adults.
- High-school age and above-average adults.
โญ Key Takeaways
The core of this lecture is that cultural background can introduce significant bias into psychological testing, rendering scores invalid for individuals from diverse backgrounds. Four key factors causing bias are language, reading ability, speed, and familiarity with test formats, and multicultural tests aim to minimize these by avoiding reading and writing, verbal ability, and time limits. The Leiter International Performance Scale-Revised is a nonverbal, untimed test for intellectual ability that uses pantomimed instructions. The Raven Progressive Matrices is a classic, culture-free test of general intelligence using pattern completion. The Goodenough-Harris Drawing Test is a quick, inexpensive measure of intelligence based on drawing a human figure, scored for detail and accuracy. Finally, the IPAT Culture Fair Intelligence Test by Cattell is designed to measure intelligence with minimal cultural influence across different age levels.
๐ง Quick Revision Questions
- What is the definition of multicultural testing, and what are three specific testing scenarios where it is needed?
- List and briefly explain the four factors that can cause cultural bias in psychological testing as described by Anastasi and Urbina.
- What are the four domains measured by the Leiter International Performance Scale-Revised, and what are three of its special features that make it culture-free?
- Describe the task in the Raven Progressive Matrices. How many matrices are there, and from how many options does the subject choose the correct pattern?
- What is the Goodenough-Harris Drawing Test measuring, and what is the age differentiation principle that governs its scoring?
๐ Lecture 42 โ Adaptive Testing and Other Issues: Computer Based Administration
๐ Overview: This lecture explores innovative test administration procedures that adapt to individual test-taker characteristics, moving beyond one-size-fits-all testing. It covers two adaptive testing models (two-stage and pyramidal) and the role of computers in modern psychometrics. The lecture also introduces interviews as important alternatives to psychological tests, detailing their types, features, and required skills.
๐๏ธ Topics Covered
The lecture begins by acknowledging that test takers have different attitudes, motivations, abilities, and response characteristics. It then explains adaptive testing as a procedure that adjusts test item coverage according to individual response patterns, detailing the Two-Stage Adaptive Testing model and the Pyramidal Testing Model. The role of Computer Based Administration in scoring, item analysis, and large-scale testing is discussed. Finally, the lecture presents interviews as alternatives to psychological tests, covering their similarities with tests, four specific types (evaluation, structured clinical, case history, mental status, and employment), and essential interviewing skills for psychologists.
๐ Lecture Summary
Adaptive Testing
Psychologists have been working on tailor-making tests according to the individual response characteristics of test takers. The core idea is that people should not be at a disadvantage because of their specific response characteristics. Normally, test takers attempt all items with increasing difficulty, regardless of whether they answered easier items correctly. As a consequence, many people score worse than they could have if the test had been adapted to their individual response characteristics.
Adaptive testing refers to the testing procedure whereby test item coverage is adjusted according to the response characteristics of individual subjects.
๐ Definition โ Adaptive Testing: A testing procedure where the selection and presentation of test items is adjusted based on the individual response characteristics of each test taker.
๐ Two-Stage Adaptive Testing Model (Anastasi & Urbina, 2007): This model uses three measurement levels. A hypothetical test comprises 70 items in total. Ten items are placed in a routing test, while the remaining 60 items are divided into three measurement tests of 20 items each. These three measurement tests are of varying difficulty levels: easy, intermediate, and difficult.
๐ Example: All subjects first attempt the 10-item routing test, but not all of the other 60 items. Depending on their performance on the routing test, they take only one of the three measurement tests (easy, intermediate, or difficult). Therefore, everyone is given 30 items in total, but the last 20 items vary from person to person. If someone answers the difficult items correctly on the routing test, they get the 'difficult' measurement test. If someone only answers the easy items correctly, they get the 'easy' measurement test.
๐ Definition โ Pyramidal Testing Model: An alternative adaptive testing model where everyone begins with an item of intermediate difficulty level.
๐ Example: If a test taker answers the first intermediate item correctly, they are given the next item of a higher difficulty level. If they fail the first item, they are routed downward to an item of lower difficulty level. This procedure is repeated until the test taker manages to answer the desired number of items.
๐ก Why this matters: In both models, test takers are treated according to their response pattern. While these adaptive testing procedures can be done manually with paper and pencil, they are quite tedious. Computerized adaptive testing is a convenient option that provides facility to psychologists, requiring only suitable software and the psychologist's skill.
Computer Based Administration
Like all other fields of life, computers play a very significant role in psychometrics. Availability of computers has facilitated psychologists in a number of ways, making things possible and easier whether it is computerized administration, scoring, item analysis, analysis of data obtained from large standardization samples, or adaptive testing. Computers are especially useful in group testing involving large numbers of participants or tests with tedious procedures.
Computers can be used for administration and scoring in cases such as multilevel batteries, different forms of educational testing, aptitude testing (on its own or for career guidance), and achievement testing.
๐ Example: Today, all major achievement and ability tests are administered and/or scored with the help of computers, e.g., GRE (Graduate Record Examination), SAT (Scholastic Assessment Test), MAT (Miller Analogies Test), GAT (Graduate Assessment Test), IELTS (International English Language Testing System).
Alternatives to Psychological Tests - Interviews as Assessment Tools
Psychological tests are just one form of instrument for assessment. Interviews are another important instrument, providing an opportunity for direct, face-to-face interaction with the person being examined. Interviews can be used as an alternative to psychological tests.
According to Kaplan & Saccuzzo (2001), tests and interviews share these common features:
- Method for gathering data
- Used to make predictions
- Evaluated in terms of reliability
- Evaluated in terms of validity
- Can be group or individual
- Can be structured or unstructured
Types of Interviews That Are Used For Assessment
๐ Definition โ Evaluation Interview: This interview helps the psychologist assess and understand why the student/client/individual has come to them.
๐ Definition โ Structured Clinical Interview: Structured interviews follow a fixed and set pattern of questions and procedures. This pattern may be decided by the clinic/hospital/institution or recommended by another agency, e.g., the use of DSM (Diagnostic and Statistical Manual of Mental Disorders) according to a sequence of steps.
๐ Definition โ Case History Interview: This interview is more detailed compared to other types as it aims at in-depth information. It usually takes a developmental approach and is relatively flexible though focused.
๐ Definition โ Mental Status Examination: This interview is more fixed and focused, and is used more commonly in psychiatric settings. It is typically used when some psychiatric, neurological, or emotional problem is suspected.
๐ Definition โ Employment Interview: These interviews are used by employers for the selection of right people for available jobs. Such interviews may be both structured and/or unstructured, depending upon the nature of the organization, the employer, and the position.
Interviewing Skills Required In Psychologists
- Practice and training
- Command over language and vocabulary
- Overcoming personal complexes
- Empathy
- Flexibility and acceptance of the other person's opinion
- Control over own emotional reactions
- Cultural sensitivity
- Note taking skills and technological assistance
โญ Key Takeaways
Adaptive testing allows tests to be tailored to individual response characteristics using models like the two-stage (routing test followed by a difficulty-matched measurement test) or pyramidal (starting with an intermediate item and moving up or down based on performance). Computers have revolutionized psychometric testing by enabling efficient administration, scoring, and adaptive testing for major exams like the GRE and IELTS. Beyond formal tests, interviews serve as a valid alternative assessment tool, sharing key features with tests (reliability, validity, structure). Psychologists must master five specific interview types (evaluation, structured clinical, case history, mental status, and employment) and develop crucial skills including empathy, cultural sensitivity, and command of language.
๐ง Quick Revision Questions
- What is the fundamental purpose of adaptive testing, and what problem does it solve for test takers?
- Describe the two-stage adaptive testing model. How many items are in the routing test and each measurement test, and how is the measurement test assigned?
- Explain how the pyramidal testing model works, starting from the first item a test taker receives.
- List at least three major standardized tests that are now administered and/or scored with the help of computers.
- Name four of the eight interviewing skills required in psychologists, and describe the key differences between a case history interview and a mental status examination.
๐ Lecture 43 โ Social and Ethical Considerations in Testing
๐ Overview: This lecture examines the social and ethical issues surrounding psychological testing, emphasizing the importance of adhering to professional codes of conduct. It explains multiple agencies and documents that provide ethical standards, and details specific ethical issues that test developers, users, and administrators must consider to protect test takers' rights and well-being.
๐๏ธ Topics Covered
The lecture begins by introducing the major ethical codes and agencies regulating psychological testing, including the APA Ethics Code, SIOP guidelines, and the Board on Testing and Assessment. It then provides a detailed breakdown of eight specific ethical issues: the training and eligibility of test users, human rights in testing, invasion of privacy, confidentiality and openness, careful labeling, divided loyalties, issues for test developers, and testing across diverse populations.
๐ Lecture Summary
Ethical Issues in Psychological Testing
A number of agencies have proposed ethical standards covering all aspects of testing, from test development to real-world application. These standards are essential because psychological testing involves significant social and psychological consequences. Most psychologists follow the APA standards (American Psychological Association), though some guidelines may also appear in test manuals, particularly regarding who may administer the test.
๐ Definition โ APA Ethics Code: A comprehensive document by the American Psychological Association covering confidentiality, development, and use of psychological assessment techniques, including legal and forensic contexts. ๐ Definition โ Principles for the Validation and Use of Personnel Selection Procedures: Guidelines developed in 1987 by the Society for Industrial and Organizational Psychology (SIOP) for assessment procedures used in hiring. ๐ Definition โ The RUST Statement: "Responsibilities of Users of Standardized Tests," adopted by the American Counseling Association (ACA) in 1989. ๐ Definition โ Board on Testing and Assessment (BoTA): A board established in 1993 in the U.S., supported by the Departments of Defense, Education, and Labor, primarily working on the use of psychological tests as tools of public policy.
1. The Training and Eligibility of the Test User
The person administering a test must be properly trained and experienced. The personality and qualifications of the psychologist are critical, though standards vary by institution or region. Academic and professional associations specify minimum qualifications. The administrator should have completed sufficient supervised training hours before working independently. Training is especially important for intelligence tests (especially individually administered ones) and personality tests, and becomes even more significant for interpreting projective tests. For achievement tests (especially objective ones), a compromise on qualifications may be acceptable. The APA Ethics Code (1992, p. 1599) states that psychologists should "provide only those services and use only those techniques for which they are qualified by education, training, or experience."
๐ก Why this matters: Proper training prevents misinterpretation of test results, which could harm test takers through incorrect diagnoses or inappropriate recommendations.
2. Human Rights and Test Use
All individuals have the right to decide if they want to be tested or not. People should not be tested if they refuse. The only exception is legal or forensic scenarios where testing is directed by a court of law.
3. Invasion of Privacy
Confidentiality is essential in counseling and clinical encounters. Unless the test taker allows it, the psychologist must not disclose:
- That the person was tested
- The person's scores
- The interpretation of test results
- Any diagnosis
Legal situations are an exception. Also, for achievement tests, test results are generally understood to be made public.
๐ Definition โ Invasion of Privacy: The unauthorized disclosure of information about a person being tested, including the fact of testing, scores, interpretations, or diagnoses, without the test taker's consent.
4. Confidentiality, Honesty, and Openness
The psychologist must explain the nature and purpose of the test to the subject, and inform them about the possible use of test results. Test results cannot be used for purposes other than those mentioned to the subject. However, explaining the true nature of some tests beforehand can be problematic. For projective tests like Rorschach, TAT (Thematic Apperception Test), or WAT (Word Association Test), the required information may be provided immediately after the test is over, as foreknowledge could affect performance.
๐ Definition โ Informed Consent: The process of explaining the nature, purpose, and use of test results to the test taker before testing begins, ensuring they understand and agree.
5. Care with Labeling
Psychologists should avoid labeling unless essential. People may be diagnosed or show certain tendencies, but labeling should not occur unless it was the main objective of testing. Certain labels have social stigma attached, such as "schizophrenic" or PWA (Patient with AIDS). Such labels can damage the test taker socially, psychologically, and financially (e.g., being refused employment). Therefore, labeling should be avoided if possible.
๐ก Why this matters: Labels can follow a person for life, affecting their job prospects, social relationships, and self-image, even if the original diagnosis or tendency is no longer relevant.
6. The Issue of Divided Loyalties
Psychologists may be hired and paid by an organization, but their profession demands care and protection of the test taker as well. When organizational and test taker interests clash, the psychologist must make rational decisions. According to Kaplan & Saccuzzo (2001), the following steps should be taken:
- Inform clients beforehand about the purpose of test results
- Inform clients about the limits of confidentiality
- Explain results to the client or their representative
- Provide the organization only the required information
- In adverse decisions, the person's right to know results should be preferred over test security
๐ Definition โ Divided Loyalties: A situation where a psychologist faces a conflict between the interests of the organization that hired them and the interests of the test taker, requiring careful ethical decisions.
7. Issues Pertaining To the Test Developers
Test developers must be fair and objective. They should use test content that is not gender biased or culturally biased. If the test is to be used with diverse populations, it should be culture free.
8. Issues Pertaining To the Test User In Diverse Populations
Test users or administrators must be fair to test takers. Tests developed and standardized in other cultures should not be used blindly with subjects from very different cultures. Tests must either be culture free, or translated, adapted, and standardized for the indigenous culture.
โญ Key Takeaways
The core of ethical testing rests on several critical principles: test users must have proper training and qualifications, especially for intelligence and personality tests; test takers retain the right to refuse testing and must give informed consent; confidentiality must be maintained unless legally required or the test is an achievement test; labeling with stigmatizing terms must be avoided unless absolutely necessary; and tests developed in one culture cannot be blindly applied to another. The most important takeaway is that psychologists must balance their duty to the organization paying for testing with their ethical obligation to protect the test taker, and in cases of conflict, the test taker's right to know results takes precedence over test security.
๐ง Quick Revision Questions
- What are the four main documents/agencies that provide ethical standards for psychological testing?
- In which types of tests is the training and qualification of the test user most critical?
- Under what circumstances can a test be administered without the test taker's consent?
- What information must a psychologist NOT disclose without the test taker's permission?
- What is "divided loyalties" in psychological testing, and what should a psychologist do when it occurs?
๐ Lecture 44 โ Assessment and Psychological Testing in Clinical & Counseling Settings
๐ Overview: This lecture examines the role of psychological testing within the broader context of clinical and counseling assessment. It covers specific tests and batteries used for neuropsychological evaluation, outlines the components and tools of behavioral assessment, and discusses the advantages and limitations of various assessment techniques.
๐๏ธ Topics Covered
The lecture first distinguishes psychological testing from psychological assessment, then lists common purposes of testing in clinical settings. It details neuropsychological testing, including specific tests like the Bender-Gestalt and batteries like the Halstead-Reitan. The lecture then explains behavioral assessment, covering self-report tools like the BDI, direct observation, and physiological measures, and concludes with a brief evaluation of assessment techniques.
๐ Lecture Summary
Assessment and Psychological Testing in Clinical & Counseling Settings
Psychological testing is a part of psychological assessment, which is more comprehensive. Assessment involves behavioral observation, interviews, and examination of case history in addition to testing. In clinical and counseling settings, tests can be used independently or as part of a complete assessment package. Tests are used for diagnosis, treatment induction, general assessment, and gauging recovery rates. All intelligence and personality tests may be used; for example, the House-Tree-Person (HTP) test can depict psychopathology. The Kaufman Test of Educational Achievement (K-TEA) is used for diagnosing specific learning disabilities.
Common purposes for testing include:
- General assessment of ability/IQ
- General assessment of personality
- Diagnosis of intellectual deficits
- Diagnosis of mental disorders
- Assessment of aptitude
- Neuropsychological assessment
- Assessment of learning disabilities
Neuropsychological Testing
This is a complicated area of psychological assessment, particularly regarding the diagnosis of brain damage. It may involve an extensive battery of tests assessing cognitive ability, verbal ability, spatial relations, and more. A single test is often not accurate enough, so test batteries are preferred.
Some tests used include:
- Bender-Gestalt test and Benton Visual Retention Test: These are commonly used but are more reliable as part of a battery.
- Halstead-Reitan Neuropsychological Test Battery (HRB) and the Luria-Nebraska Neuropsychological Battery: These are preferred because they provide information in a variety of areas.
๐ Definition โ Neuropsychological Testing: An area of psychological assessment that uses tests to evaluate cognitive, verbal, and spatial abilities, often to diagnose brain damage. ๐ก Why this matters: A single test may not be accurate for diagnosing brain damage, so standardized batteries that measure multiple skills are preferred.
According to Anastasi & Urbina (2007), these batteries are useful because they:
- Provide measures of all significant neuropsychological skills.
- Can detect brain damage with a high degree of success.
- Help identify and localize impaired brain areas.
- Allow differentiation between particular syndromes associated with cerebral pathology.
Behavioral Assessment
Behavioral assessment procedures include self-report by the client, direct observation of behavior, and physiological measures.
Self-report by the client can take various forms, such as inventories, checklists, and clinical interviews. A commonly used tool is the Beck Depression Inventory (BDI). ๐ Definition โ Beck Depression Inventory (BDI): A self-report instrument where clients make self-ratings on 21 items to help assess the severity of depression. ๐ Example: A client completes the BDI by rating 21 items related to depressive symptoms, such as sadness, loss of pleasure, and changes in appetite, on a scale from 0 to 3. The sum of these ratings provides an overall score indicating the severity of depression (e.g., minimal, mild, moderate, or severe).
Another instrument is the Alcohol Use Inventory. Some instruments involve multiple informants. The Social Skills Rating System (SSRS) uses separate forms for parents, teachers, and students to evaluate positive and problematic behaviors in educational and family settings. The Behavior Assessment System for Children (BASC) is a comprehensive instrument that includes:
- Behavior rating scales for teachers and parents.
- A self-report questionnaire for children.
- A form for coding and recording classroom behavior.
- An additional structured interview for taking developmental history from parents.
Direct observation of behavior can be recorded by the psychologist, parents, or teachers in naturalistic settings. Observations may be recorded using narratives, checklists, rating scales, or record forms.
Physiological measures are used depending on the nature of the problem, especially in cases of anxiety or sleep disorders. These measures may include assessments of cardiovascular activity, cerebral functioning, electrodermal activity, and electro-ocular activity.
Evaluation of Various Assessment Techniques
All techniques have their advantages and disadvantages. Psychologists may choose any method that best serves their purpose and has minimum limitations.
โญ Key Takeaways
Psychological testing is a component of the broader process of psychological assessment, which also includes behavioral observation, interviews, and case history review. In clinical settings, tests are used for diagnosis, treatment planning, and monitoring progress. For neuropsychological assessment, comprehensive test batteries like the Halstead-Reitan are preferred over single tests for their ability to detect and localize brain damage across multiple functional areas. Behavioral assessment relies on multiple methods, including self-report inventories (e.g., BDI), direct observation in natural settings, and physiological measures, each with its own strengths and limitations.
๐ง Quick Revision Questions
- What is the key difference between psychological testing and psychological assessment?
- Name two test batteries used for neuropsychological assessment.
- According to Anastasi & Urbina, what is one advantage of using a neuropsychological test battery over a single test?
- What are the three main procedures included in behavioral assessment?
- Provide one specific example of a self-report instrument and describe its purpose.