๐ Lecture 5 โ Discipline of Human Computer Interaction
๐ Overview: This lecture introduces Human-Computer Interaction (HCI) as a bridging discipline between human behavior and technology. It explores the concept of quality beyond mere conformance to specifications, and examines the interdisciplinary roots of HCI. The lecture also presents a detailed case study of a ticketing system to illustrate how HCI factors interact in real-world design.
๐๏ธ Topics Covered
This lecture covers the definition of HCI as a bridging discipline, the concept of quality from various perspectives including its relationship to usability, and the interdisciplinary nature of HCI. Key topics include the eight categories of factors in HCI design (organizational, environmental, health and safety, the user, cognitive processes, comfort, user interface, and task/system constraints), a detailed case study of a travel agency ticketing system, and the various contributing disciplines to HCI such as cognitive psychology, social psychology, ergonomics, linguistics, philosophy, sociology, anthropology, artificial intelligence, computer science, and engineering/design.
๐ Lecture Summary
5.1 Quality
The lecture begins by defining quality from several perspectives. According to the American Heritage Dictionary, quality is a โcharacteristic or attribute of something,โ referring to measurable characteristics. The British Defense Industries Quality Assurance Panel defines quality as โconformance to specifications,โ measuring how well design specifications are followed during manufacturing. Philip Crosby similarly states, โQuality is conformance to requirements,โ where lack of conformance means lack of quality. Juran defines it as โfitness for purpose or use,โ while Edward Deming says, โQuality is a predictable degree of uniformity and dependability, at low cost and suited to the market.โ R J Mortiboys equates quality with โcustomer needs and expectations,โ and Mike Robinson defines it as โmeeting the (stated) requirements of the customer- now and in the future.โ Armand Feigenbaum defines it as the total composite product and service characteristics that meet customer expectations in use. A final definition states, โTotality of characteristics of an entity that bear on its ability to satisfy stated and implied needs.โ
From an HCI perspective, the lecture argues that quality is beyond meeting specifications or requirements. If the specifications themselves are incomplete, the product may still lack quality. True quality is measured by the end user's expectations and needs. The more usable a product is for the end user, the higher its quality. This connects quality directly to usability. The lecture defines software quality as the extent to which a software product exhibits these characteristics:
- Functionality
- Reliability
- Usability
- Efficiency
- Maintainability
- Portability
๐ Definition โ Conformance to specifications: The measure of the degree to which design specifications are followed during manufacturing. ๐ก Why this matters: This lecture challenges the traditional view of quality, arguing that for HCI, quality is not just about meeting a written spec but about how well the product serves its actual end users. A product that meets all specs but is unusable is not a quality product.
5.2 Interdisciplinary nature of HCI
HCI is a discipline that is neither the study of humans nor technology alone, but the bridging between the two. A designer must always consider both what technology can do and what people will do with it. Failing to consider either leads to poor design. The main factors in HCI design are illustrated in a figure and include:
- Organizational Factors: Training, job design, politics, roles, work organization.
- Environmental Factors: Noise, heating, ventilation, lighting.
- Health and Safety: Stress, headaches, musculo-skeletal disorders.
- The User: Motivation, enjoyment, satisfaction, personality, experience level.
- Cognitive Processes and Capabilities
- Comfort Level: Seating, equipment layout.
- User Interface: Input devices, output displays, dialogue structures, use of color, icons, commands, graphics, natural language.
- Task Factors: Easy, complex, novel, task allocation, repetitive, monitoring, skills.
- System Functionality: Hardware, software, application.
- Constraints
- Productivity Factors: Increase output, increase quality, decrease costs, decrease errors, decrease labor requirements, decrease production time, increase creative ideas.
These factors interact with each other. For example, improving productivity may negatively affect user motivation if job design is ignored.
Case Study โ Ticketing System: A small travel agency with multiple shops wants a new ticketing system. The current practice is slow: sales staff call airlines to check seats, get customer approval, then hand-write tickets, receipts, and itineraries. Phone connections are often busy, causing delays. Accounting is also done by hand every two weeks. Before deciding, a manager visits another company with a computerized system and finds problems: staff donโt trust the computer, canโt understand error messages, and wish to return to the old system. Sales figures are down, and staff have left. Consultants then examine user needs and company goals, recommending a system with:
- Immediate ticket booking via computer connection (solving the phone problem).
- Automatic print-out of tickets, itineraries, and receipts (reducing errors and speeding up the process).
- Direct connection between booking and accounting (speeding up accounting).
- Elimination of booking forms (reducing overheads).
The interface is designed to mimic the non-computerized task using menus and forms. The consultants are optimistic about customer satisfaction. However, they also note that for success, the layout must be changed for comfort, staff need training, job design must be changed (e.g., support during change, handling computer malfunctions), employment conditions must be examined (e.g., rewards for more transactions), and staff relations (e.g., feelings of elitism) must be managed.
HCI understands the complex relationship between humans and computers, which are two distinct โspecies.โ Successful integration requires understanding both. HCI borrows from disciplines concerned with both:
- Human: Cognitive Psychology, Social/Organizational Psychology, Ergonomics/Human Factors, Linguistics, Philosophy, Sociology, Anthropology.
- Machine: Computer Science, Artificial Intelligence.
- Other: Engineering, Design.
Cognitive Psychology is concerned with understanding human behavior and mental processes through the notion of information processing. It characterizes these processes in terms of their capabilities and limitations.
Social and Organizational Psychology studies human behavior in a social context. Its four core concerns are: the influence of one individual on another, the impact of a group on its members, the impact of a member on a group, and the relationship between groups. Its role is to inform designers about social and organizational structures and how computers influence working practices.
Ergonomics or Human Factor developed to define and design tools and artifacts for various environments to suit user capabilities and capacities. The ergonomistโs role is to translate scientific information into design to maximize safety, efficiency, reliability, make tasks easier, and increase comfort and satisfaction.
Linguistics is the scientific study of language. It helps HCI understand issues like the order of words in command languages (e.g., delete โxyzโ vs. โxyzโ delete).
Philosophy, Sociology, and Anthropology consider the implication of IT on society. They apply social science methods to design and evaluation, providing a more accurate description of user interaction. An application is Computer Supported Cooperative Work (CSCW) , which designs shared software and hardware for groups.
Artificial Intelligence (AI) is concerned with designing intelligent computer programs that simulate intelligent human behavior. Its relationship to HCI involves user needs when interacting with an intelligent interface, such as using natural language or speech and having the system explain its advice.
Computer Science provides knowledge about technology capabilities and ideas for harnessing this potential. It develops techniques for software design, development, and maintenance.
Engineering and Design contribute through model building, empirical testing, and creative skills. Engineeringโs main influence on HCI is through software engineering. Design, particularly graphic design, is a well-established discipline with benefits for HCI.
๐ Definition โ Ergonomics: A discipline that defines and designs tools and artifacts for different environments to suit the capabilities and capacities of users, with the objective of maximizing safety, efficiency, and comfort. ๐ Formula: (No formula) ๐ Example: In the ticketing system case study, ergonomics would be applied to ensure the layout of the agency is changed to make it comfortable for staff to operate the computer while still allowing contact with customers.
โญ Key Takeaways
A student must remember that HCI is fundamentally a bridging discipline, requiring simultaneous consideration of human capabilities and technological possibilities. The concept of quality in HCI goes beyond simple conformance to specifications, placing the end user's usability and needs as the ultimate measure. The numerous factors in HCI design (organizational, environmental, user, task, etc.) are highly interdependent, and changes in one area can have ripple effects on others, as shown in the ticketing system case study. Finally, HCI is inherently interdisciplinary, drawing critical knowledge from fields like cognitive psychology, ergonomics, computer science, and social sciences to create successful human-computer interactions.
๐ง Quick Revision Questions
- According to the lecture, why is the traditional definition of quality as "conformance to specifications" insufficient for HCI?
- List at least four of the main factors that must be considered in HCI design, as shown in the lecture's figure.
- In the ticketing system case study, what were three key recommendations made by the consultants to improve the system beyond just the software itself?
- Name three disciplines that contribute to the "Human" side of HCI and briefly state what each contributes.
- What is the primary role of an ergonomist, as described in this lecture?
๐ Lecture 6 โ Cognitive Frameworks
๐ Overview: This lecture introduces cognitive frameworks in Human-Computer Interaction (HCI), exploring how understanding human cognitionโincluding perception, memory, attention, and reasoningโcan inform the design of interfaces. It explains classical models like information processing and GOMS, as well as modern approaches like distributed and external cognition, to help designers create more user-friendly systems.
๐๏ธ Topics Covered
The lecture begins by defining cognition and its importance, then covers two general modes: experiential and reflective cognition. It details the human information processing model and its extension with memory and attention, followed by the Human Processor Model and the GOMS framework (Goals, Operators, Methods, Selection Rules). Recent developments in cognitive psychology are explored, including computational and connectionist approaches. Finally, the lecture discusses External Cognition and Distributed Cognition as more situated frameworks for understanding human-computer interaction.
๐ Lecture Summary
Introduction
The lecture begins by asking you to imagine driving a car using only a keyboard (e.g., arrow keys for steering, space bar for braking). This scenario highlights how early video games required arbitrary key combinations, while modern consoles use joysticks and steering wheels that map better to human physical and cognitive capabilities. The core goal is to understand human limitations to design systems that ease interaction. Cognitive Psychology is concerned with understanding human behavior and the underlying mental processes, adopting an information processing metaphor where everything we sense is considered information. A major focus in the 1960s and 1970s was identifying the amount of information that could be processed and remembered at one time.
Cognition
Cognition is defined as โwhat goes on in our heads when we carry out our everyday activities.โ It refers to the processes by which we gain knowledge, including understanding, remembering, reasoning, attending, and acquiring skills. The main objective in HCI has been to understand how knowledge is transmitted between humans and computers. Specific cognitive processes include:
- Attention
- Perception and recognition
- Memory
- Learning
- Reading, speaking, and listening
- Problem solving, planning, reasoning, decision-making
These processes are interdependent; for example, learning for an exam requires attending, perceiving, reading, thinking, and remembering.
6.2 Modes of Cognition
Norman (1993) distinguishes between two general modes:
- Experiential cognition: The state of mind in which we perceive, act, and react to events around us effectively and effortlessly. It requires a certain level of expertise and engagement. Examples include driving a car, reading a book, and playing a video game.
- Reflective cognition: Involves thinking, comparing, and decision-making. This leads to new ideas and creativity. Examples include designing, learning, and writing a book.
๐ก Why this matters: Both modes are essential but require different kinds of technological support. For instance, a GPS supports experiential cognition while a spreadsheet supports reflective cognition.
Information processing models the mind as an information processor. It is thought to operate through four ordered, unidirectional, and sequential stages:
- Encoding: Information from the environment is transformed into an internal representation.
- Comparison: The internal representation is compared with memorized representations.
- Response Selection: A decision is made on a response to the encoded stimulus.
- Response Execution: The response is organized and an action is performed.
๐ Formula: (Stages of Information Processing) Input โ Stage 1 (Encoding) โ Stage 2 (Comparison) โ Stage 3 (Response Selection) โ Stage 4 (Response Execution) โ Output
๐ Example: To find a friendโs phone number, you must: identify the words, retrieve their meaning, understand the sentence, search memory for the number, generate a plan, and formulate a verbal answer.
Extending the model involves including attention (which selects information to process) and memory (which stores information for later use).
6.3 Human Processor Model
This model is based on the information-processing view and models cognition as a series of processing stages involving perceptual, cognitive, and motor processors. These processors are organized in relation to one another to predict user performance (e.g., reaction time) and identify bottlenecks when overloaded.
๐ Definition โ Human Processor Model: A model of the cognitive processes of a user interacting with a computer, which predicts how long a user will take to carry out various tasks, enabling comparisons between different interfaces (e.g., different word processors). It is based on the idea that cognitive activities involve people interacting with external representations (books, computers, environmental cues) rather than just internal processes.
6.4 GOMS
Card et al. developed the GOMS (Goals, Operators, Methods, and Selection Rules) family of models to translate qualitative descriptions of user performance into quantitative measures.
- Goals: Describes what the user wants to achieve. They represent a โmemory pointโ from which the user can evaluate what to do and to which they may return if errors occur.
- Operators: The lowest level of analysis; basic actions the user must perform (e.g., press a key, read a dialog box). Granularity is flexible (e.g., โissue commandโ vs. โmove mouse to menu barโ).
- Methods: Ways a goal can be split into sub-goals; there are typically several ways to achieve a goal.
- Selection: A means of choosing between competing methods when multiple methods exist for the same goal.
Recent focus has been on Knowledge Representation Models (how knowledge is represented), Mental Models (representations people construct of themselves, others, and the environment to guide behavior), User Interaction Learning Models (how users learn to interact), Conceptual Models (ways systems are understood by different people), and Interface Metaphors (GUIs that are electronic counterparts to physical objects).
6.5 Recent Development in Cognitive Psychology
Since the 1980s, there has been a move away from the strict information-processing framework towards other theoretical approaches.
- Computational Approaches: Adopt the computer metaphor as a theoretical framework, but focus on modeling what is involved when information is processed (e.g., goals, planning, action) rather than when and how much. They analyze how information is organized, classified, and retrieved.
- Connectionist Approaches (Neural Networks / Parallel Distributed Processing): Reject the computer metaphor and instead adopt the brain metaphor. Cognition is represented at the level of neural networks of interconnected nodes. All cognitive processes are viewed as activations of nodes and connections between them.
6.6 External Cognition
External Cognition explains the cognitive processes involved when we interact with different external representations. Its main goal is to explicate the cognitive benefits of using different representations.
The main benefits include:
- Externalizing to reduce memory load: Transforming knowledge into external representations (e.g., writing down birthdays, appointments) to remember to do something (e.g., buy a card) or when to do something (e.g., send it by a certain date).
- Computational offloading: Using a tool or device in conjunction with an external representation to help carry out a computation (e.g., using pen and paper to solve a math problem).
- Annotating and cognitive tracing:
- Annotating: Modifying external representations, such as crossing off or underlining items in a to-do list.
- Cognitive tracing: Externally manipulating items into different orders or structures (e.g., creating different piles of work).
Information Visualization is a design principle based on external cognition: providing external representations at the interface that reduce memory load and facilitate computational offloading, thereby extending or amplifying cognition (e.g., financial forecasting tools, identifying programming bugs).
6.7 Distributed Cognition
Distributed Cognition is a theoretical framework that goes beyond the individual to conceptualize cognitive activities as embodied and situated within the work context. It describes cognition as distributed across individuals, computer systems, and other technology in a setting, which together are called a functional system. Examples include ship navigation and air traffic control.
The main goal is to analyze how the different components of the functional system are coordinated, focusing on how information is propagated through the system in terms of technological, cognitive, social, and organizational aspects. It analyzes how information moves and transforms between different representational states.
โญ Key Takeaways
The most critical takeaway is that understanding human cognitive processesโattention, perception, memory, and learningโis fundamental to designing effective and intuitive interfaces. Classical models like the information processing model and GOMS provide frameworks for predicting user performance and comparing interface efficiency, but they are limited by their focus on internal, individual cognition. Modern frameworks like external cognition and distributed cognition offer more complete explanations by situating cognitive activity in the real world, emphasizing how people use external tools and collaborate with others. Ultimately, designers must recognize the interdependence of cognitive processes and support both experiential (effortless) and reflective (analytical) modes of thought.
๐ง Quick Revision Questions
- Define cognition and explain why it is a central concept in HCI.
- Distinguish between experiential and reflective cognition, giving an example of each and explaining why each requires different technological support.
- Briefly describe the four stages of the human information processing model. What is a major limitation of this model according to the lecture?
- What does GOMS stand for? Explain the role of each component and how this model is used to evaluate user interfaces.
- What is external cognition, and what are three key cognitive benefits it provides? Give an example of how you use each benefit in your daily life.
๐ Lecture 7 โ Human Input-Output Channels โ Part I
๐ Overview: This lecture introduces the study of human input-output channels in Human Computer Interaction. It covers the physiological and perceptual aspects of human vision, including the anatomy of the eye and how visual perception works. Understanding these human capabilities and limitations is essential for designing effective computer interfaces.
๐๏ธ Topics Covered
The lecture covers input-output channels in human-computer interaction, focusing on the five senses and effectors involved. It then delves deeply into vision, examining the human eye's physiology including rods, cones, fovea, and the blind spot, followed by visual perception covering size and depth perception, brightness perception, and color perception, along with the capabilities and limitations of visual processing including optical illusions.
๐ Lecture Summary
7.1 Input Output channels
A person's interaction with the outside world occurs through information being received (input) and sent (output). In computer interaction, the user's output becomes the computer's input and vice versa. The five major senses are sight, hearing, touch, taste, and smell โ of which the first three are most important to HCI. Taste and smell do not currently play a significant role in general computer systems.
The human effectors include limbs, fingers, eyes, head, and vocal system. In computer interaction, fingers play the primary role through typing or mouse control. For example, using a personal computer with a mouse and keyboard involves receiving information primarily by sight, with hearing and touch also providing feedback. The user sends information using hands through keystrokes or mouse movements.
7.2 Vision
Human vision is a highly complex activity with physical and perceptual limitations, yet it is the primary source of information. Visual perception can be divided into two stages: the physical reception of the stimulus from the outside world, and the processing and interpretation of that stimulus.
The human eye
Vision begins with light. Light is reflected from objects and focused upside down on the back of the eye. The cornea and lens at the front of the eye focus light into a sharp image on the retina. The retina is light sensitive and contains two types of photoreceptor: rods and cones.
๐ Definition โ Rods: Highly sensitive to light, allowing us to see under low illumination, but unable to resolve fine detail and subject to light saturation. There are approximately 120 million rods per eye, mainly situated towards the edges of the retina, dominating peripheral vision.
๐ Example โ Rod saturation: When moving from a darkened room into sunlight, rods that have been active become saturated by the sudden light, causing temporary blindness. Cones do not operate either as they are suppressed by the rods.
๐ Definition โ Cones: Less sensitive to light than rods and can tolerate more light. There are three types of cone, each sensitive to a different wavelength of light, allowing color vision. The eye has approximately 6 million cones, mainly concentrated on the fovea.
๐ Definition โ Fovea: A small area of the retina on which images are fixated.
๐ Definition โ Blind spot: An area of the retina where the optic nerve enters the eye, containing no rods or cones. The visual system compensates for this so we are normally unaware of it.
The retina also has specialized nerve cells called ganglion cells:
- X-cells: Concentrated in the fovea, responsible for early detection of pattern.
- Y-cells: More widely distributed, responsible for early detection of movement. This means we can perceive movement in peripheral vision even if we cannot detect pattern changes there.
7.3 Visual perception
Visual perception involves more than just the physical mechanism of vision. The information received by the visual apparatus must be filtered and passed to processing elements that allow us to recognize coherent scenes, disambiguate relative distances, and differentiate color.
Perceiving size and depth
The visual system easily interprets images to account for size and distance. The size of an image on the retina is specified as visual angle, which is affected by both the size of the object and its distance from the eye.
๐ Definition โ Visual angle: The angle between two lines drawn from the top and bottom of an object to a central point on the front of the eye. It indicates how much of the field of view is taken by the object. Visual angle is measured in degrees or minutes of arc (1 degree = 60 minutes of arc, 1 minute = 60 seconds of arc).
๐ Example โ Visual angle: If two objects are at the same distance, the larger one will have the larger visual angle. If two objects of the same size are placed at different distances, the furthest one will have the smaller visual angle.
๐ Definition โ Visual acuity: The ability of a person to perceive fine detail. A person with normal vision can detect a single line if it has a visual angle of 0.5 seconds of arc. Spaces between lines can be detected at 30 seconds to 1 minute of visual arc.
๐ Definition โ Law of size constancy: Our perception of an object's size remains constant even if its visual angle changes. A person's height is perceived as constant even if they move further away. This indicates that our perception of size relies on factors other than visual angle, such as depth perception.
Cues for depth perception:
- Overlap: If objects overlap, the partially covered object is perceived as being further away.
- Size and height in the field of view provides a cue to distance.
- Familiarity: If we expect an object to be a certain size, we can judge its distance accordingly.
Perceiving brightness
๐ Definition โ Brightness: A subjective reaction to the level of light. It is affected by luminance, which is the amount of light emitted by an object. Luminance depends on the amount of light falling on the object's surface and its reflective properties.
๐ Definition โ Contrast: A function of the luminance of an object and the luminance of its background.
In dim lighting, rods predominate vision. Since there are fewer rods on the fovea, objects in low lighting are more visible in peripheral vision. In normal lighting, cones take over.
Visual acuity increases with increased luminance, suggesting high display luminance is beneficial. However, as luminance increases, flicker also increases. The eye perceives a light switched on and off rapidly as constantly on if the switching speed is less than 50 Hz. Flicker is more noticeable in peripheral vision, meaning larger displays appear to flicker more.
๐ก Why this matters: This trade-off between luminance and flicker directly affects display design โ designers must balance clarity with visual comfort.
Perceiving color
Color is usually regarded as being made up of three components:
- Hue
- Intensity
- Saturation
๐ Definition โ Hue: Determined by the spectral wavelength of the light. Blues have short wavelength, greens medium, and reds long. Approximately 150 different hues can be discriminated by the average person.
๐ Definition โ Intensity: The brightness of the color.
๐ Definition โ Saturation: The amount of whiteness in the color.
By varying intensity and saturation, we can perceive approximately 7 million different colors. However, the number of colors identifiable without training is far fewer.
The eye perceives color because cones are sensitive to different wavelengths (blue, green, red). Color vision is best in the fovea and worst at the periphery. Only 3-4% of the fovea is occupied by cones sensitive to blue light, making blue acuity lower.
๐ Definition โ Color blindness: Around 8% of males and 1% of females suffer from color blindness, most commonly being unable to discriminate between red and green.
The capabilities and limitations of visual processing
Visual processing involves the transformation and interpretation of a complete image from light on the retina. Our expectations affect image perception โ for example, if we know an object's size, we perceive it as that size regardless of distance.
Visual processing compensates for:
- Movement of the image on the retina โ the perceived image remains stable even as we move
- Color and brightness of objects โ perceived as constant despite luminance changes
This ability to interpret and exploit expectations can resolve ambiguity, as context allows disambiguation (e.g., interpreting a shape as "B" or "13" based on surrounding characters).
However, expectations can also create optical illusions:
- Muller-Lyer illusion: Lines of equal length appear different due to arrowhead direction
- Ponzo illusion: Lines of equal length appear different due to perspective cues
- Proofreading illusion: Our expectations cause us to miss errors in familiar text
Our perception of geometric shapes is not exact โ we tend to magnify horizontal lines and reduce vertical lines, so a square needs to be slightly increased in height to appear square. Lines appear thicker if horizontal rather than vertical. The optical center of a page is perceived as slightly above the actual center, so symmetrical arrangement around the actual center appears too low.
โญ Key Takeaways
The most critical knowledge from this lecture is understanding that human vision involves two distinct stagesโphysical reception of light through the eye's anatomy and cognitive processing and interpretationโboth of which impose limitations on interface design. Students must remember that rods enable peripheral and low-light vision while cones enable color vision with concentration in the fovea, and that visual angle determines object perception but is modified by size constancy laws. Visual perception of brightness involves luminance and flicker thresholds (50 Hz), while color perception involves hue, intensity, and saturation with important implications given color blindness affects 8% of males. Finally, optical illusions demonstrate that visual processing compensates for and interprets images based on expectations, which designers must account for in layout and visual element placement.
๐ง Quick Revision Questions
-
What are the two stages of visual perception, and why must interface designers understand both?
-
Explain the functional differences between rods and cones, including their approximate numbers per eye and where each is concentrated on the retina.
-
What is visual angle, and how does it relate to the law of size constancy?
-
What is the flicker fusion threshold for the human eye, and why does it matter for display design?
-
What are the three components of color perception, and what percentage of males suffer from red-green color blindness?
๐ Lecture 8 โ Human Input-Output Channels Part II
๐ Overview: This lecture continues the exploration of human input-output channels, focusing on how humans perceive and process visual information through color, depth, and movement. It also covers hearing, touch (haptic perception), and the mechanics of reading and movement, all of which are critical for designing effective human-computer interfaces.
๐๏ธ Topics Covered
The lecture covers color theory including the color wheel, primary, secondary, and tertiary colors, color harmony, and color context. It also delves into stereopsis (3D vision), the reading process, the structure and function of hearing, haptic perception, and movement including reaction time, movement time, and various motion perception phenomena.
๐ Lecture Summary
8.1 Color Theory
Color theory encompasses definitions, concepts, and design applications. The color wheel is a circular diagram of colors, first developed by Sir Isaac Newton in 1666, based on red, yellow, and blue. Primary colors are red, yellow, and blueโthe three pigment colors that cannot be mixed from other colors. Secondary colors are green, orange, and purple, formed by mixing primary colors. Tertiary colors are yellow-orange, red-orange, red-purple, blue-purple, blue-green, and yellow-green, formed by mixing one primary and one secondary color.
Color harmony is a pleasing arrangement of parts that engages the viewer and creates balance. Extreme unity leads to under-stimulation; extreme complexity leads to over-stimulation. Harmony is a dynamic equilibrium.
Analogous colors are any three colors side by side on a 12-part color wheel (e.g., yellow-green, yellow, yellow-orange). Complementary colors are any two colors directly opposite each other (e.g., red and green), creating maximum contrast and stability. Natural harmony comes from nature, like red, yellow, and green together.
Color context refers to how color behaves relative to other colors. For example, red appears more brilliant against black, duller against white, and lifeless against orange. As we age, the lens becomes yellow and absorbs shorter wavelengths, so blue should not be used for text. Older people need brighter colors.
๐ก Why this matters: Color choices directly affect readability, user fatigue, and accessibility in interfaces.
Guidelines include:
- Opponent colors (red & green, yellow & blue) go well together
- Pick non-adjacent colors on the hue circle
- It's hard to detect changes in reds, purples, & greens; easier in yellows & blue-greens
- Older users need higher brightness levels
- Use both brightness & color differences for edges
- Avoid red & green in periphery; use yellows & blues
- Avoid pure blue for text, lines, & small shapes
- Blue makes a fine background color
- Avoid adjacent colors that differ only in blue
- Mixtures of colors should differ in 2 or 3 colors
- Accurate color discrimination is at ยฑ60 degrees of straight head position
- Limit of color awareness is ยฑ90 degrees
8.2 Stereopsis
Stereopsis is the direct sensing of an object's distance by comparing images received by the two eyes. It exists in animals with overlapping optical fields. It is the most reliable depth clue and overrides all others. The pair of views is called a stereopair or stereogram. The word comes from Greek ฯฯฮตฯฮตฮฟs (solid) and ฮฟฯฮนs (appearance). Haplopia is single vision; diplopia is double vision.
Stereopsis yields benefits for close work like fighting for cats and hand work for humans. The brain fuses the two images from the eyes. Visual perception uses many distance clues: strong clues include apparent sizes, overlapping, parallax, shadows, and perspective; weaker clues include atmospheric perspective, speed, and detail.
The interpretation is entirely mental and must be learned. Free fusion is the skill of fusing two pictures side by side by voluntarily diverging the eyes. A stereoscope helps achieve fusion without practice. When images are too different, rivalry occursโone image is favored or a patchwork is seen. When everything corresponds except illumination or color, the fused image exhibits lustre.
The fundamentals were discovered by Charles Wheatstone in 1836. An anaglyph is a stereopair drawn in two colors viewed through colored filters. About 4% of people have defective stereopsis.
The autostereogram is a single figure that gives stereoscopic images to the two eyes (e.g., the "wallpaper illusion" discovered by H. Meyer in 1842). A random-dot auto stereogram (Julesz, 1960) requires free fusion. No image is seen until fusion occurs.
๐ Definition โ Stereopsis: The direct sensing of distance by comparing images from two eyes. ๐ Example: Viewing a waterfall for a minute, then looking at a stationary object causes the object to appear to move upward (motion after effect).
8.3 Reading
Reading has several stages: perceiving the visual pattern of words, decoding with reference to internal language representation, and syntactic/semantic analysis. During reading, the eye makes jerky movements called saccades followed by fixations. Perception occurs during fixations, accounting for about 94% of time. Regressions are backward eye movements; complex text causes more regressions.
8.4 Hearing
Hearing begins with sound waves. The ear has three sections: outer ear, middle ear, and inner ear. The outer ear includes the pinna (visible structure) and auditory canal (which protects the middle ear and amplifies sounds). The middle ear is connected to the outer ear by the tympanic membrane (eardrum) and contains the ossicles (smallest bones in the body). The inner ear contains the cochlea (liquid-filled) with delicate hair cells or cilia that release a chemical transmitter causing impulses in the auditory nerve.
Pitch is the frequency of sound (low frequency = low pitch). Loudness is proportional to amplitude (frequency constant). Timbre relates to the type of sound.
๐ Definition โ Pitch: The frequency of a sound wave. ๐ Formula: Low frequency = Low pitch; High frequency = High pitch ๐ Example: A violin and a piano playing the same note at the same loudness have different timbres.
Sound characteristics: Audible range is 20 Hz to 15 KHz. The ear can distinguish changes less than 1.5 Hz but is less accurate at higher frequencies. The Cocktail Party Effect is the auditory system's ability to filter sounds.
8.5 Touch
Haptic perception involves sensors in the skin, hand, and arm. It includes mechanoreceptors (deformation, thermo reception, vibration), plus receptors in muscles, tendons, and joints. This combination of kinesthetic and sensory perception creates strong neural pathways.
Haptics vs. Vision: Vision is rapid and holistic, superior for macro geometry (shape). Haptics is superior for micro geometry (texture), detecting properties like roughness, hardness, wetness, stickiness, and temperature. Together they are superior for many learning contexts.
๐ Definition โ Haptic perception: The sense of touch involving sensors in the skin, hand, and arm.
8.6 Movement
A simple action like hitting a button involves: stimulus reception โ brain processing โ response generation โ muscle response. These stages divide into reaction time and movement time.
- Reaction time: Auditory signal ~150ms, Visual signal ~200ms, Pain ~700ms
- Movement time: Depends on age and fitness
Movement perception involves different ways of following moving objects: moving eyes alone, moving head alone, or combinations. All three give similar perception.
Real movement is when the physical stimulus actually moves. Apparent movement occurs when there is no physical motion. Examples:
- Motion After Effect (MAE): After viewing motion in one direction, stationary objects appear to move in the opposite direction.
- Phi phenomenon: Two lights alternately flashing appear as a single moving light (used in movies and marquees).
- Induced motion: When a nearby vehicle moves, you feel as if you are moving.
- Auto kinetic movement: A small dim light in a dark room appears to move randomly.
The visual system has motion detectors that undergo spontaneous activity. Adaptation of these detectors causes the MAE. Electro physiologists have discovered cortical neurons specialized for movement in specific directions.
๐ก Why this matters: Understanding movement perception helps design animations, notifications, and responsive interfaces.
๐ Definition โ Saccades: Jerky eye movements during reading followed by fixations. ๐ Definition โ Phi phenomenon: The perception of motion from alternating stationary lights.
โญ Key Takeaways
Color theory is essential for interface designโuse the color wheel, understand harmony (analogous, complementary, natural), and follow guidelines (avoid pure blue for text, use both brightness and color differences, consider aging users). Stereopsis (3D vision) relies on comparing two eye images and is the most reliable depth clue, overriding all others. Reading involves saccades and fixations (94% of time), with regressions for complex text. Hearing processes pitch, loudness, and timbre, with an audible range of 20 Hz to 15 KHz. Haptic perception is superior for texture and material properties, while vision dominates for shape. Movement perception includes reaction time (auditory fastest at 150ms) and phenomena like MAE, phi phenomenon, induced motion, and auto kinetic movement, all crucial for natural interface interactions.
๐ง Quick Revision Questions
- What are the three primary colors in traditional color theory, and why can't they be mixed from other colors?
- Explain the difference between analogous and complementary color schemes with examples.
- What is stereopsis, and why is it considered the most reliable depth clue?
- Describe the three main sections of the human ear and their functions in hearing.
- Compare the reaction times for auditory, visual, and pain stimuli, and list two examples of apparent movement perception.