π Lecture 1 β Psychological Testing and Measurement (PSY-631)
π Overview: This introductory lecture establishes the foundational context for psychological testing by directing students to key professional resources and information sources. It emphasizes the importance of consulting authoritative bodies like the American Psychological Association (APA), test manuals, and internet-based repositories for understanding and evaluating tests.
ποΈ Topics Covered
The lecture covers the identification of key APA divisions relevant to psychological testing, such as Division 5 (Evaluation, Measurement, and Statistics) and Division 14 (Society for Industrial and Organizational Psychology). It also outlines essential sources of test information, including test manuals, catalogues, and internet sites.
π Lecture Summary
Some Sources of Information on Tests
This section lists the primary channels through which students and professionals can access reliable information about psychological tests. It begins by directing attention to the American Psychological Association (APA) and its specific divisions that focus on testing and measurement.
π Definition β APA Divisions: Specialized subgroups within the American Psychological Association that focus on particular areas of psychology. For testing, Division 5 (Evaluation, Measurement, and Statistics) is the primary relevant division.
π Formula: N/A
π Example: The lecture provides two specific links for accessing APA division information:
- For Division 5, Evaluation, Measurement, and Statistics: http//www.apa.org/about/division/div5.html
- For Division 14, Society for Industrial and Organizational Psychology: http//www.apa.org/about/division/div14.html
π‘ Why this matters: Knowing which APA division to consult allows a psychologist to find peer-reviewed, professionally endorsed information about test development, validity, and proper usage.
The section continues by listing additional sources of information:
- Test manuals and catalogues: These are official documents provided by test publishers. A test manual contains the technical details of a testβs development, its reliability, validity, norms, and instructions for administration and scoring. Catalogues provide an overview of available tests from a particular publisher.
- Internet sites: The internet serves as a vast repository of information, allowing access to test reviews, publisher websites, professional forums, and databases for research on specific tests.
π Definition β Test manual: The official, comprehensive document that accompanies a standardized test, detailing its construction, psychometric properties, and administration procedures.
π Formula: N/A
π Example: A test manual for the Wechsler Adult Intelligence Scale (WAIS) would include chapters on its theoretical foundation, standardization sample (e.g., age ranges, demographics), reliability coefficients (e.g., split-half, test-retest), validity evidence (e.g., content, construct, criterion), and step-by-step administration and scoring rules.
π‘ Why this matters: Relying solely on internet summaries or second-hand descriptions of a test can lead to misuse. Accessing the primary test manual ensures the test is administered and interpreted according to the developer's validated procedures.
β Key Takeaways
A student must remember that the primary professional source for information on psychological tests is the APA, specifically Division 5 for evaluation and measurement. Test manuals are the definitive, technical source for understanding a testβs psychometric properties, while catalogues help identify available tests. Internet sites are a useful supplementary source, but must be used critically. Knowing these information sources is the first step toward responsible and competent test selection, use, and interpretation.
π§ Quick Revision Questions
- Which APA division is most directly concerned with evaluation, measurement, and statistics?
- What is the primary difference between a test manual and a test catalogue?
- How can a student find a list of all tests published by a specific company?
- Why is it considered essential to read the test manual before administering a psychological test?
- Name two specific types of professional information that can be found on internet sites related to psychological testing.
π Lecture 2 β Historical Background of Psychological Testing
π Overview: This lecture traces the historical roots of psychological testing from ancient China through the 19th and early 20th centuries in Europe and America. It explains how early civil service examinations, Darwinian theory, and pioneering psychologists like Galton, Cattell, and Binet laid the foundation for modern mental measurement. Understanding this history is essential because it reveals the origins of key concepts such as individual differences, standardized testing, and intelligence measurement.
ποΈ Topics Covered
The lecture begins with the origins of mental testing in ancient China, describing civil service examinations from 2200 BC through the Ming Dynasty. It then covers the spread of Chinese testing methods to Europe and America. The summary of key developments includes Darwinβs influence on studying individual differences, contributions of German experimental psychologists, and the pioneering work of Galton (hereditary genius, sensorimotor tests, correlation), Cattell (first use of "mental test"), and Binet (first effective intelligence test with Simon). The lecture concludes with other key pioneers in testing.
π Lecture Summary
Historical Background of Psychological Testing
Major developments in psychological testing took place in the West, especially the U.S., but the earliest roots are in the Orient. China was the first country to develop and use tests in the formal sense of mental measurement. The Greek philosophers Plato and Aristotle proposed ideas about individual differences around 300-400 BC, but the Chinese had a system of mental measurement even in 2200 BC.
More than 4000 years ago, the Chinese developed a civil service testing program. Under Chinese emperors, oral examinations were held every third year for work evaluations and promotions. During the Han Dynasty (206 BCE to 220 CE), test batteries (multiple measures) were common, covering topics like revenue, civil law, military affairs, agriculture, and geography.
The system broadened during the Chan dynasty (beginning 1115 BCE), covering archery, horsemanship, music, writing, arithmetic, civil law, agriculture, revenue, military affairs, geography, and social rites. By the Ming Dynasty (1368-1644 CE), a national multistage testing program existed, with tests at local and regional centers using special testing booths. Successful candidates at local level went to provincial capitals for extensive essay exams, then to the nationβs capital for a final round. Only those who passed the third set were eligible for public office. This civil service system prevailed until 1905.
The Chinese pattern was copied by other nations. In 1832, the English East India Company copied the Chinese model for selecting employees for overseas duty. The German and French governments later adopted it. In 1883, the U.S. Civil Service Commission was established, developing competitive exams for government jobs. This marked a period when the testing movement grew rapidly in the Western world.
By the sixteenth century, European society had become more advanced and capitalistic, with greater recognition of individuality. Major developments occurred during the Renaissance, with a rebirth of individualism. By the early nineteenth century, human knowledge was gathered through observation, but physical scientists were developing more precise instruments. The most significant shift came after Charles Darwin wrote On the Origins of Species in 1859. Darwin proposed that humans descended from apes as a result of chance variation, and that species are selected by nature based on adaptability and survival value (the "survival of the fittest").
Darwin generated scientific interest in the study of individual differences, noting that slight differences in offspring provide materials for natural selection. Around the same time, Gustav Fechner, Wilhelm Wundt, Hermann Ebbinghaus, and other German experimental psychologists showed that psychological phenomena could be expressed in quantitative, rational terms. U.S. psychologists also studied and reported on individual differences, and American experts began developing standardized measures of scholastic achievement. In France, psychiatrists and psychologists studied mental disorders, influencing the development of clinical assessment techniques.
The most significant names that initiated and contributed to the study of individual differences and test development in the 19th century included Sir Francis Galton, James McKean Cattell, and Alfred Binet.
π Definition β Individual differences: The variations among people in their psychological traits, abilities, and behaviors, which became a central focus for scientific study after Darwinβs work.
π Example: Darwin wrote that βthe many slight differences which appear in the offspring from the same parents... may be called individual differences... [they] afford materials for natural selection to act on.β
Sir Francis Galton
Galton was a cousin of Charles Darwin, born into a family of geniuses with an IQ over 200. He was a geographer, meteorologist, tropical explorer, "founder of differential psychology," inventor of fingerprint identification, pioneer of statistical correlation and regression, and a proponent of hereditarianism and eugenics. He gave the concept of "hereditary genius" in his 1869 book Hereditary Genius, arguing that gifted individuals tend to come from families with other gifted individuals. He analyzed biographical dictionaries and encyclopedias, concluding that talent in science, professions, and arts ran in families.
He attempted to measure human traits quantitatively to determine the distribution of heredity, using a word association test and tests of mental imagery. Galton argued it would be "quite practicable to produce a highly gifted race of men by judicious marriages during several consecutive generations." He defined eugenics as the study of agencies under social control that may improve or repair racial qualities of future generations, either physically or mentally. He stated, "What Nature does blindly, slowly, and ruthlessly, man may do providently, quickly, and kindly," and "Intelligence must be bred, not trained." These arguments appealed to many and were taken to extremes, supporting apartheid policies, sterilization programs, and withholding basic human rights from minority groups.
Galton was interested in the hereditary basis of intelligence and techniques for measuring abilities. He constructed sensorimotor tests and devised methods for investigating individual differences in abilities and temperament. Using these tests, he collected measurements of over 9000 people aged 5 to 80. Among his methodological contributions was the technique of "co-relations" (correlation), which remains popular for analyzing test scores.
π Definition β Eugenics: The study of the agencies under social control that may improve or repair the racial qualities of future generations, either physically or mentally.
π Definition β Correlation (co-relations): A statistical technique developed by Galton for analyzing relationships between test scores, showing how variables are associated.
π Example: Galton collected measurements from over 9000 people using sensorimotor tests to study individual differences in abilities and temperament.
James McKeen Cattell
James McKeen Cattell was an American psychologist who gave more importance to mental processes. He was the first ever to use the term "mental test" for devices used to measure intelligence. He developed tasks aimed to measure reaction time, word association, keenness of vision, and weight discrimination. These tests proved to be a failure because they were not comprehensive and complex enough to measure intelligence. Cattell joined Galton in his methods and tests, trying to relate scores on mental tests of reaction time and sensory discrimination to school marks.
π Definition β Mental test: A term first used by James McKeen Cattell to refer to devices used to measure intelligence, such as reaction time and sensory discrimination tasks.
π Example: Cattell developed tasks measuring reaction time, word association, keenness of vision, and weight discrimination, but these tests failed because they were not comprehensive enough to predict intelligence.
Alfred Binet and Theodore Simon
It remained for the Frenchman Alfred Binet to construct the first mental test that proved to be an effective predictor of scholastic achievement. Binet, along with Theodore Simon, developed the first formal measure of intelligence in 1905 in France. The test or scale was developed to assist the education ministry in identifying "dull" students in the Paris school system so they could be provided remedial aid.
The main idea was that intelligence could be measured in terms of a child's performance. The test could identify more intelligent children within a particular age group and differentiate intelligent children from less intelligent ones. The testing procedure involved: (1) Binet developed a number of tasks; (2) he took groups of students categorized as 'dull' or 'bright' by teachers; (3) tasks were presented, and those completed by 'bright' students were retained; (4) retained tasks were considered indicative of intelligence; (5) with further work, dull or bright children could be identified with reference to their age.
The original Binet-Simon scale was revised multiple times. American psychologist Lewis Terman gave the first Stanford revision in 1916, covering American standards from age 3 to adulthood. Further revisions were made in 1937 and 1960. The Stanford-Binet remains one of the most widely used tests today. The 1905 test was an individually administered test of 30 problems arranged in ascending difficulty, emphasizing the ability to judge, understand, and reason. The 1908 revision contained subtests grouped by age levels from 3 to 13 years. In scoring the 1908 revision, the concept of mental age was introduced to quantify overall performance.
π Definition β Mental age: A concept introduced in the 1908 revision of the Binet-Simon Intelligence Scale as a way of quantifying an examineeβs overall performance on the test, representing the age level at which a child performs intellectually.
π Example: A child who performs at the level of an average 8-year-old would have a mental age of 8, regardless of their chronological age.
Other Pioneers in Psychological Testing
Among other pioneers were Charles Spearman in test theory, Edward L. Thorndike in achievement testing, Lewis Terman in intelligence testing, Robert Woodworth and Hermann Rorschach in personality testing, and Edward Strong in interest measurement. The work of Arthur Otis on group-administered tests of intelligence led directly to the construction of the Army Examinations Alpha and Beta by a committee of psychologists during World War I.
π Definition β Army Examinations Alpha and Beta: Group-administered intelligence tests developed during World War I, based on Arthur Otis's work, used for screening military recruits.
β Key Takeaways
The most critical points from this lecture are that psychological testing originated in ancient China with civil service examinations over 4000 years ago, which later influenced testing systems in Europe and America. Darwinβs theory of evolution and concept of individual differences provided the scientific impetus for studying human abilities, while Galton pioneered sensorimotor tests, hereditarian views, and the statistical technique of correlation. Cattell introduced the term "mental test" but failed to predict intelligence with simple tasks, and it was Binet and Simon who created the first effective intelligence test in 1905, introducing the concept of mental age to identify students needing remedial education.
π§ Quick Revision Questions
- What was the earliest known formal mental measurement system, and when did it exist?
- How did Charles Darwinβs work influence the study of individual differences in psychology?
- What was Galtonβs concept of "hereditary genius," and what testing methods did he develop?
- Why did James McKeen Cattellβs mental tests fail to effectively measure intelligence?
- What was the purpose of the first Binet-Simon Intelligence Scale (1905), and what concept was introduced in its 1908 revision?
π Lecture 3 β Historical Background of Psychological Testing
π Overview: This lecture traces the historical development of psychological testing from ancient Chinese civil service exams to modern standardized tests. It explains how early pioneers like Esquirol, Seguin, Galton, Cattell, and Binet laid the foundation for intelligence testing, and how World War I accelerated the development of group testing. Understanding this history is crucial for appreciating why tests are designed and used the way they are today.
ποΈ Topics Covered
The lecture begins with early formal assessment systems in China and Greece, then covers 19th-century contributions by French physicians Esquirol and Seguin regarding mental retardation. It discusses Francis Galton's sensorimotor tests and anthropometric laboratory, James McKeen Cattell's introduction of the term "mental tests," and the influence of experimental psychology. The core focus is on Alfred Binet's development of the first intelligence scale (1905-1911), its revision as the Stanford-Binet, and the concept of IQ. Finally, it covers the emergence of group testing during World War I with Army Alpha and Beta, concluding with a timeline of significant milestones in testing history.
π Lecture Summary
Historical Background of Psychological Testing
The lecture establishes that while the Chinese had the first formal assessment system for civil servants (2200 B.C.), other societies like the Greeks used tests in education. European universities developed formal examination systems, awarding degrees based on exams. Modern psychological tests began in the 19th century, with key figures being Francis Galton, James McKeen Cattell, and Alfred Binet. Binet developed the first proper intelligence test to identify children who could not benefit from normal schooling, leading to the establishment of the Ministerial Commission for the Study of Retarded Children. Before Binet, professionals were increasingly recognizing the need for diagnostic tools to differentiate between the mentally retarded (born with intellectual deficit) and the "insane" (those with extreme emotional problems).
Esquirol
Esquirol was a French physician who published a two-volume work in 1838 that was a milestone in understanding and treating mental retardation. He described mental retardation as existing along a continuum from "normality" to "low grade idiocy" and found it in various degrees. He proposed that language use was the most reliable criterion for assessing intellectual level after trying other procedures. This idea proved influential, as most modern intelligence tests include verbal ability as a major component.
π Definition β Esquirol (Jean-Γtienne Dominique Esquirol): A French physician whose 1838 work established a comprehensive account of mental retardation, proposing that language use is the best criterion for assessing intellectual level.
Seguin
Seguin, another French physician, emigrated to the U.S. in 1848. He established the first school for the mentally retarded in 1837 and developed a "physiological method of training," believing mental retardation was not incurable. He created muscle and sense training techniques, including the Seguin Form Board, which contained variously shaped slots and corresponding blocks that the subject had to insert correctly. This type of performance-based item was later adopted for performance-based intelligence tests.
π Definition β Seguin Form Board: A performance test developed by Seguin containing slots of various shapes and corresponding blocks; the subject inserts the blocks into the correct slots, forming a basis for later performance-based intelligence test items.
π‘ Why this matters: Esquirol and Seguin's work established that mental retardation could be systematically assessed and trained, shifting views from incurable to treatable and moving toward objective measurement.
Sir Francis Galton
Sir Francis Galton was the most prominent figure in the 19th-century testing movement. He was primarily interested in the inheritance of genius and developed sensorimotor tests to measure intellectual ability. He believed that the more perceptive the senses are of differences, the larger the field for judgment and intelligence to act. He collected data from over 9,000 people (ages 5-80) at his anthropometric lab at the International Exposition of 1884. His tests included:
- Galton whistle for determining the highest audible pitch
- Galton bar for visual discrimination of length
- Graduated series of weights for measuring kinesthetic discrimination He also introduced rating scales, questionnaire methods, and the free association technique.
π Definition β Anthropometric Lab (Galton's): A laboratory established by Galton at the 1884 International Exposition to collect measurements of physical and sensory traits from thousands of people, aiming to study individual differences and the inheritance of genius.
π Formula: Sensory ability β Measure of intellectual ability (Galton's premise). π Example: Galton used a whistle to find the highest pitch a person could hear, assuming that better sensory discrimination indicated higher intelligence.
James McKeen Cattell
James McKeen Cattell was the first person to use the term "mental tests" in psychology, in an 1890 article. He wrote his doctoral dissertation on reaction time under Wilhelm Wundt in Leipzig, Germany. After lecturing in Cambridge, he interacted with Galton, strengthening his interest in individual differences. Cattell's mental tests measured speed of movement, muscular strength, sensitivity to pain, keenness of hearing and vision, memory, weight discrimination, and reaction time. However, these tests were not good predictors of intellectual functioning as their results did not correspond with teachers' ratings or academic grades, limiting their popularity.
π Definition β Mental tests (term origin): The term "mental tests" was first used by James McKeen Cattell in 1890 to describe a series of tests measuring sensory discrimination and reaction time to assess intellectual ability.
The Experimental Psychologists
Experimental psychologists of the 19th century, like those in Wundt's Leipzig lab, contributed indirectly to test development. While their main focus was on uniform patterns of behavior, not individual differences, their experiments revealed individual differences in behavior under the same conditions. They also generated the realization that objectivity required carefully designed measuring instruments and controlled conditions, leading to the formation of standardized procedures adopted in test development and administration.
20th Century: Binet's Scale and the Stanford-Binet
Alfred Binet's scale (first version 1905) was the first formal test of intelligence, consisting of 30 problems arranged in ascending difficulty. It was given to 50 normal children (ages 3-11) and some mentally retarded children and adults. Items covered sensory and perceptual tests as well as verbal content, with special emphasis on judgment, comprehension, and reasoning. In the 1908 revision, unsatisfactory tests were removed and new ones added. The scale was given to 300 normal children (ages 3-13) and was grouped into age levels. Tests passed by 80-90% of normal 3-year-olds were placed at the three-year level. This allowed the scale to determine a child's mental level (also called mental age). A further revision was made in 1911. The most significant translation and adaptation was by L. M. Terman and associates at Stanford University, called the Stanford-Binet. The first Stanford revision was in 1916, with further revisions in 1937 and 1960. The concept of Intelligence Quotient (IQ) was first used in the Stanford-Binet.
π Definition β Intelligence Quotient (IQ): A ratio between a person's Mental Age (MA) and their Chronological Age (CA), multiplied by 100. IQ = (MA/CA) x 100.
π Formula: IQ = (Mental Age / Chronological Age) Γ 100 β This expresses how a person's intellectual performance compares to others of the same age. π Example: A 7-year-old child with a mental age of 10 would have an IQ of (10/7) Γ 100 β 143. This indicates performance well above average. However comparing a 22-year-old with MA 25 (IQ β 114) vs. a 7-year-old with MA 10 (IQ β 143) is problematic, showing the limits of this ratio.
π‘ Why this matters: IQ allowed for a standardized comparison of intellectual ability across ages, but the ratio formula created problems comparing people of different ages, leading to later statistical refinements.
Group Testing
Group testing emerged prominently in early 20th century as a way to administer tests to many people simultaneously, rather than individually. This became critical when the U.S. entered World War I in 1917. The American Psychological Association appointed a committee to help, and the army needed to classify approximately 1.5 million recruits by intellectual level for selection, retention, duty allocation, and training. Arthur S. Otis had prepared an unpublished group intelligence test using multiple-choice questions. Using available tests including Otis's, army psychologists developed Army Alpha (for literate recruits) and Army Beta (for illiterate or non-English speaking recruits) β the first group intelligence tests. After this, test development exploded across all purposes.
π Definition β Group Testing: A method of test administration where a test is given to many individuals simultaneously, allowing for quick screening of large populations, as exemplified by the Army Alpha and Beta tests developed during World War I.
Significant Milestones in the History of Psychological Testing
The lecture provides a detailed timeline of key events in testing history, including:
- 2200 B.C.: Chinese civil-service testing program
- 1879: First psychological laboratory (Wilhelm Wundt, Leipzig)
- 1884: Galton's Anthropometric Laboratory
- 1905: First Binet-Simon intelligence scale
- 1916: Stanford-Binet Intelligence Scale published
- 1917: Army Alpha and Beta constructed
- 1921: Hermann Rorschach's Inkblot Test published
- 1939: Wechsler-Bellevue Intelligence Scale published
- 1947: Educational Testing Service founded
- 1975: Growth of behavioral assessment techniques
- 1989: MMPI-2 published
β Key Takeaways
The key concepts a student must remember are that psychological testing originated from ancient civil service exams but modern tests began in the 19th century with Galton's sensorimotor approach, Cattell's term "mental tests," and the crucial clinical contributions of Esquirol and Seguin distinguishing mental retardation from insanity. The most critical development was Binet's first formal intelligence test (1905), later revised as the Stanford-Binet by Terman, which introduced the concept of IQ as a ratio of mental age to chronological age. The need for mass screening during World War I led to the first group intelligence tests (Army Alpha and Beta), revolutionizing testing by allowing administration to large groups. Finally, the history reveals a shift from sensory/physical measures to verbal and reasoning-based tests, and from individual administration to group formats.
π§ Quick Revision Questions
- Who was the first person to use the term "mental tests" in psychology, and in what year?
- What was the main criterion Esquirol proposed for assessing intellectual level in people with mental retardation?
- What is the formula for Intelligence Quotient (IQ) as introduced in the Stanford-Binet, and what are its two components?
- What were the names of the first group intelligence tests developed during World War I, and what problem did they solve?
- Who developed the Seguin Form Board, and what type of test items did it influence?
π Lecture 04 β Types of Tests and Their Significance
π Overview: This lecture establishes the fundamental assumptions underlying all psychological testing and assessment, demonstrating why and how tests are valid tools for measuring human behavior. It then provides a comprehensive taxonomy of test types based on administration method, content, and purpose, and concludes by examining the three major real-world contexts where these tests are applied: education, occupation, and clinical settings.
ποΈ Topics Covered
The lecture begins with twelve basic assumptions of psychological testing and assessment, which explain the theoretical foundations for measuring traits and states. It then categorizes tests into seven types: individual vs. group, ability/achievement/aptitude, intelligence vs. personality, speed vs. ability, structured vs. projective, verbal vs. nonverbal/performance, and commercial vs. available-to-all tests. Finally, it covers the three major contexts of test use: educational, occupational, and clinical and counseling psychology.
π Lecture Summary
Assumptions of Psychological Testing and Assessment
Cohen and Swerdlik (1999) enumerate twelve assumptions that form the foundation of psychological testing. First, psychological traits and states exist β a trait is defined by Guilford (1959, p. 6) as "any distinguishable relatively enduring way in which one individual varies from another." Second, these traits and states can be quantified and measured. Quantification refers to gathering and presenting findings in numbers, making the process objective and scores comparable. Measurement is defined as "the act of assigning numbers or symbols to characteristics of subjects according to rules" (Cohen & Swerdlik, 1999, p. 19). A scale is "a set of numbers whose properties model empirical properties of the objects or traits to which numbers are assigned."
Third, various approaches to measuring the same thing can be useful β no single tool exists for measuring any one aspect of behavior. Fourth, assessment can provide answers to momentous life questions, leading to continuous test design and refinement. Fifth, assessment can pinpoint phenomena requiring further attention or study, meaning tests serve diagnostic purposes for therapy, forensic reasons, placement, or educational counseling. Sixth, various sources of data enrich and are part of the assessment process. Seventh, various sources of error are part of the assessment process β many variables may intervene even under controlled conditions. Eighth, tests and measurement techniques have strengths and weaknesses. Ninth, test-related behaviors predict non-test-related behaviors β for example, in the HTP (House, Tree, Person) test, drawing ability is not being tested; rather, the contents present cues to the subject's personality. Tenth, present-day behavior sampling predicts future behavior β test results are assumed to hold true beyond the day of administration. Eleventh, testing can be conducted in a fair and unbiased manner. Twelfth, testing and assessment benefit society.
π‘ Why this matters: These assumptions justify the entire enterprise of psychological testing β without them, we could not claim that a test score meaningfully represents a person's intelligence, personality, or aptitude.
Types of Tests
1- Individual Versus Group Tests: Individual tests require one examiner and one subject at a time, such as WAIS, WISC, Stanford-Binet Scales, and Kaufman Scales. Group tests involve one examiner working with many subjects simultaneously, such as Raven's Progressive Matrices (RPM) and Otis Self-Administering Tests of Mental Ability. RPM is available in three forms differing in difficulty level for both individual and group administration. Group tests are quick, easy to administer and score, usually based on multiple choice items, and can even use tape-recorded or computer administration. However, they are unsuitable where subject-examiner rapport is important.
2- Ability, Achievement, or Aptitude Tests: Ability tests measure intellectual ability or cognitive behavior and yield an IQ score. These tests cover a sample of what the person knows at the time of testing and indicate the level of development attained in those abilities. Achievement tests are designed to measure the effect of educational programs or trainings β they are given at the end of a program to determine if specific objectives have been achieved. The SAT is an example. Aptitude tests measure the cumulative influence of multiplicity of experiences in daily living (Anastasi & Urbina, 1997), predicting future performance based on learning under uncontrolled, general conditions. For example, a test measuring how many mathematics problems a child can solve now is an achievement test; a test measuring how well they could solve problems if provided training is an aptitude test. The Differential Aptitude Tests (DAT) are the most widely used aptitude test batteries.
3- Intelligence Versus Personality Tests: These two types are distinct. Intelligence tests yield IQ information, while personality tests assess traits like dispositions. Neither can substitute for the other, and both are available in large numbers.
4- Speed Tests versus Ability Tests: Ability tests measure the level or amount of ability (e.g., IQ), and time for completion is not of utmost importance β some have no time limit, like Raven's Progressive Matrices. Speed tests emphasize speed of performance, such as the Clerical Speed and Accuracy Test in DAT. A related variety is power tests, which have a time limit long enough to allow everyone to complete all items.
5- Structured Personality Tests versus Projective Tests: Structured personality tests (also called objective tests) provide fixed response options β alternate response (true/false), three, four, or more options (MCQs). Scoring is simple with an answer key. These are usually "self-report" type tests, such as the EPPS (Edwards Personal Preference Schedule). Projective tests present a vague or ambiguous stimulus that subjects describe or explain. Examples include Rorschach's Inkblots, TAT (Thematic Apperception Test) where subjects narrate a story about a picture, HTP (House, Tree, Person) where drawings are analyzed, RISB (Rotter's Incomplete Sentence Blank) where subjects complete sentences, and WAT (Word Association Test) where subjects give prompt answers to stimulus words.
π Definition β Structured personality test: A test with fixed response options where examinees choose the option that best describes them.
π Example (Structured): "I love animals [ ] Yes [ ] No" or "Animals are one's best friends [ ] Yes [ ] No"
6- Verbal versus Nonverbal/Performance Tests: Most tests are verbal, relying on language use β this is true of IQ tests and all structured personality tests. Nonverbal/performance tests do not involve the use or measurement of verbal ability, such as Raven's Progressive Matrices (RPM).
7- Commercial-Copyrighted Tests Versus "Available To All" or Online Tests: Commercial copyrighted tests like WAIS and WISC cannot be reproduced or photocopied β disclosing items would make them meaningless if examinees are familiar with contents. They must be purchased from the author or authorized agency. "Available to all" tests are found online or in textbooks, primarily for research rather than diagnostic or screening purposes. For example, the Multidimensional Health Locus of Control Scale (Wallston & Wallston) and Self-Efficacy Scale (Schwarzer & Jerusalem) can be downloaded and used freely, yielding valuable empirical evidence.
Major Contexts of Current Test Use
i) Educational Testing: Testing is used in schools at all levels, with the type depending on who uses it (counselor, psychologist, or teacher). Achievement, intelligence, special and multiple aptitude, and personality tests are used. Forms include: a) General Achievement Batteries that generate profiles of scores in major academic areas, such as the Stanford Achievement Test Series with Otis-Lennon School Ability Test, IOWA Test Series, California Achievement Test. b) Tests of Minimum Competency in Basic Skills that measure mastery of basic skills, such as the TABE (Tests of Adult Basic Education) battery covering five difficulty levels across reading, language, and applied mathematics. Results come as competency-based information and norm-referenced scores. c) Teacher-made classroom tests (objective or subjective). d) College level tests like the SAT (Scholastic Assessment Tests) Program including SAT I (Reasoning Test) and SAT II (Subject Tests). e) Graduate School Admission tests like the GRE (Graduate Record Examinations), used for admission to graduate and professional schools, honors, and scholarships, with a general test and subject tests.
ii) Occupational Testing: Tests are used for screening, induction, performance assessment, job analysis, and job performance prediction. Examples include: Academic Intelligence Tests (e.g., Wonderlic Personnel Test), Aptitude Tests (e.g., GATB β General Aptitude Test Battery; ASVAB β Armed Services Vocational Aptitude Battery), and Personality Tests (e.g., Five Factor Model Personality Inventories, MMPI for psychopathology, CPI, and HPI β Hogan Personality Inventory).
iii) Tests Used in Clinical and Counseling Psychology: Tests are used for diagnosis, treatment induction, general assessment, and gauging recovery rate. All intelligence and personality tests may be used β for example, HTP can depict psychopathology. Neuropsychological assessment tests include Bender Visual Motor Gestalt Test (Bender Gestalt Test/BGT) and Benton Visual Retention Test (BVRT). Specific learning disability tests include the Kaufman Test of Educational Achievement (K-TEA).
β Key Takeaways
The twelve assumptions of psychological testing provide the philosophical and scientific justification that traits exist, can be measured, and predict future behavior β without these, testing would lack validity. Tests are classified along multiple dimensions: individual vs. group administration, what they measure (ability, achievement, aptitude), speed vs. power, structured vs. projective format, and verbal vs. nonverbal content. Projective tests use ambiguous stimuli (inkblots, pictures, sentence completions) to reveal personality, whereas structured tests use fixed response options like true/false. The three major real-world contexts β educational, occupational, and clinical β each require different test types for different purposes, from school placement and job screening to diagnosing psychopathology.
π§ Quick Revision Questions
- According to Guilford (1959), what is a "trait" as distinct from a "state" in psychological testing?
- What is the fundamental difference between a speed test and an ability (power) test?
- Why are projective tests (like Rorschach's Inkblots or TAT) considered more difficult to score and interpret than structured personality tests?
- Name two commercially copyrighted IQ tests and explain why their items cannot be publicly disclosed.
- In the context of educational testing, what is the difference between a general achievement battery and a test of minimum competency in basic skills?
π Lecture 05 β The Testing Process: Test Administration and Test Taking
π Overview: This lecture examines the entire testing process, focusing on factors that can introduce error variance and reduce test validity. It covers the critical roles of examiner preparation, testing conditions, rapport building, and examinee variables such as test anxiety, coaching, and test sophistication, providing a comprehensive framework for understanding influences on test performance.
ποΈ Topics Covered
The lecture covers the test administration process including advance preparation of examiners and testing conditions. It explores introducing the test through rapport and test-taker orientation, alongside examiner and situational variables. Characteristics of a good examiner are outlined, followed by an in-depth look at examinee variables, focusing on test anxiety including its nature, measurement, and treatment. The lecture concludes by examining the effects of training on test performance, covering coaching, test sophistication, and instructions in broad cognitive skills.
π Lecture Summary
Test Administration Process
The main purpose of testing is to generalize results from the test sample to non-test situations. Any influences specific to the test situation constitute error variance and reduce test validity. It is crucial to recognize test-related influences, examiner-related variables, and subject/examinee-related variables as potential confounding variables that need to be controlled.
Advance Preparation Of Examiners
Advance preparation is required for the uniformity of the testing procedure. This preparation takes many forms: verbal instructions must be memorized to prevent misreading and hesitation. The preparation of test materials is another important step to avoid mishandling. Materials should be in easy reach, the testing procedure should be clear beforehand, and training for test administration is essential.
Testing Conditions
The testing environment must be appropriate, including a noise-free room, proper seating, and adequate lighting. It is important to recognize conditions that might affect test scores, such as noise, privacy, and traffic in the testing room. Even the type of answer sheet may affect scores. Subtle conditions affect performance; whether the examiner is a stranger or someone familiar can make a significant difference. The general manner and behavior of the examiner, such as smiling and nodding, can also have a decided effect on test results.
Introducing the Test: Rapport and Test-Taker Orientation
In test administration, rapport refers to the examinerβs efforts to arouse the test takerβs interest, elicit their cooperation, and encourage them to respond appropriately. Techniques for establishing rapport vary with the nature of the test and the age and characteristics of the person tested. Special motivational problems may be encountered with emotionally disturbed persons, prisoners, or juvenile delinquents, who may show suspicion, insecurity, or fear. The experienced examiner must make special efforts to establish rapport under these conditions.
Examiner and Situational Variables
Situational variables have been found to affect test-taking behavior and performance, especially with unstructured and ambiguous stimuli, as well as difficult and novel tasks. Children are more susceptible to examiner and situational influences than adults. Test results may be influenced by the examinerβs behavior, such as a "warm" versus a "cold" interpersonal relationship. The test taker's activities immediately preceding the test may also affect performance, as can feedback regarding test scores; "success" feedback leads to significantly higher performance than "failure" feedback.
π Definition β Rapport: The examinerβs efforts to arouse the test takerβs interest, elicit their cooperation, and encourage them to respond in a manner appropriate to the objectives of the test.
Characteristics of a Good Examiner
A good examiner possesses: understanding of the nature of the test, proper training and experience, knowledge of instructions, clear speech, empathy, sharp senses (hearing and vision), quickness in understanding and responding, and professional honesty and integrity.
Test Anxiety
Test anxiety is a reaction of the test taker in a testing situation, stimulated by the negative effect on test performance. Practices to reduce it include building rapport and reducing the strangeness of the testing situation. The examiner's smooth and well-organized handling of the process also helps reduce test anxiety.
Individual Differences in Test Anxiety
Research shows individual differences in test anxiety responses. Questionnaires were developed to assess these differences, with findings indicating negative correlations between test anxiety and intelligence/achievement test scores. In one study, low-anxious children significantly improved on repeated learning tasks compared to high-anxious children with equal intelligence scores.
Anxious and Relaxed States in Test Performance
Studies comparing "anxious" and "relaxed" states show that ego-involving instructions have a positive effect on low-anxious students but a negative effect on high-anxious students. Chronically high anxiety exerts a detrimental effect on school learning and intellectual development. Research suggests students high on test anxiety obtain lower GPAs and have poorer study habits.
Research on Nature, Measurement, and Treatment Of Test Anxiety
The nature of anxiety is believed to include two components: emotionality and worry. Emotionality includes feelings and physiological reactions (increased heart rate, tension), while worry is the cognitive component involving negative, self-oriented thoughts about failure. These cognitions disrupt test performance by drawing attention away from task-oriented behavior. π‘ Why this matters: Understanding that test anxiety has a cognitive "worry" component, not just a physiological one, is key to developing effective treatments, such as behavior therapy combined with cognitive therapies. π Definition β Emotionality: The component of anxiety that includes feelings and physiological reactions like increased heart rate and tension. π Definition β Worry: The cognitive component of anxiety that includes negative self-oriented thoughts about failure and its consequences, which disrupts test performance.
Coaching
Individual with deficient educational backgrounds are more likely to benefit from coaching than those with superior opportunities. How much someone benefits depends on: the ability of the test taker, earlier educational experiences, the nature of the test, and the amount and type of coaching. The more the test material and coaching materials have in common, the greater the improvement.
Test Sophistication
Research shows that test sophistication or test-taking practice has a positive effect on test performance. When alternate forms of the same test were used, the second score tended to be higher. Short orientation and practice sessions can be effective in equalizing test sophistication, as illustrated by booklets like Taking the SAT I: Reasoning Test and GRE familiarization materials. Test familiarization is not limited to print media but includes transparencies, slides, films, videos, and computer software.
Instructions in Broad Cognitive Skills
Some researchers advocate providing education rather than coaching to improve test performance. These programs, often working with educable mentally retarded individuals, are designed to develop effective problem-solving behavior such as careful analysis of problems and consideration of all alternatives. These programs are still in an exploratory stage.
β Key Takeaways
The testing process is vulnerable to error variance from examiner, situational, and examinee variables, all of which reduce test validity. Rapport building and proper orientation are critical to manage test anxiety and maximize the generalizability of results. Test anxiety has a cognitive "worry" component that disrupts performance and can be treated with cognitive-behavioral therapy. Training effects, including coaching and test sophistication, can improve scores, but coaching benefits depend on the test-taker's background and the nature of the test. Finally, a good examiner must be well-trained, empathetic, and aware of how their own behavior and expectations can influence test outcomes.
π§ Quick Revision Questions
- What are the three main categories of variables that can introduce error variance into the testing process?
- How does the "worry" component of anxiety differ from the "emotionality" component, and how does it affect test performance?
- What is rapport, and why is it particularly challenging to establish with certain populations like juvenile delinquents?
- According to the lecture, what factors determine how much an individual will benefit from coaching?
- What is the main difference between "coaching" and "instructions in broad cognitive skills" as approaches to improving test performance?