MKT611 — Midterm Summary (Lectures 1–22)
📘 Lecture 01 — Introduction to Marketing Research
📖 Overview: This lecture introduces the fundamental concepts of marketing and marketing research, explaining how they are interconnected. It establishes why understanding customer needs through systematic information gathering is critical for business success and provides a foundational framework for the entire course.
🗂️ Topics Covered
The lecture begins with defining marketing and the marketing concept, then moves to marketing strategy and the types of information managers need. It provides formal definitions of marketing research, explains its role in strategy development through situation analysis and marketing mix decisions, and finally discusses the marketing research industry and types of research suppliers.
📝 Lecture Summary
Marketing
Marketing includes all activities necessary for the conception, pricing, promotion and distribution of goods, services and ideas to create exchanges that satisfy individual and organizational objectives (needs). The core of marketing is the marketing concept, a way of thinking that holds the organization can best achieve its goals by determining the needs and wants of the target market and delivering desired satisfactions more effectively and efficiently than competitors. The bottom line of marketing is that the focus of the entire firm is on satisfying consumer needs and wants.
Marketing Strategy
A marketing strategy consists of selecting a marketing segment as a company's target market and designing a proper marketing mix (the four Ps: product/service, price, promotion, and distribution system) to satisfy the needs and wants of the target market. To develop a good strategy, marketing managers need objective, accurate, and up-to-date information on questions such as: What is the market? How do we segment it? What are the needs of each segment? Who are our competitors? What is the best price? Because environments (social, cultural, political, economic, technological) are constantly changing, the marketer's need for up-to-date information is never-ending. The collection, analysis, and use of such information in decision-making is within the scope of marketing research.
Marketing Research - Definition
The American Marketing Association (AMA) defines marketing research as the "function that links the customer, customer and public to the marketer through information—information used to identify and define marketing opportunities and problems; generate, refine and evaluate marketing actions; monitor marketing performance; and improve understanding of marketing as a process."
🔑 Definition — Marketing Research (course definition): Marketing Research is a systematic and objective process of designing, gathering, analyzing and reporting information that may be used to solve specific marketing problems and assisting the management to improve their decision relating to marketing.
Role of Marketing Research
The major role of marketing research is to provide information that facilitates marketing decisions. In the absence of relevant information, the marketing manager may be making decisions based on experience or guesswork, which carries significant risk. For example, when launching a new product, if demand is unknown, the company risks failure; but if a feasibility study based on scientific research is conducted first, the product is more likely to capture the market. Marketing research provides substantial support in strategy development by giving managers an in-depth understanding of the situation and helping them choose appropriate strategy alternatives.
💡 Why this matters: Marketing research replaces guesswork with evidence-based decision-making, directly reducing the risk of costly marketing failures.
Situation Analysis
Understanding the markets and customers—who they are, how they behave, why and what they buy, and how they are likely to respond in the future—is the heart of marketing research. Marketing research helps acquire an in-depth understanding of both the environment and the markets. Key areas of information include:
- A. Market Environment: Economic trends, social trends, technology trends, legal requirements
- B. Market Characteristics: Market size, potential, growth; location and spread of customers; segments; competition; channels of distribution
- C. Consumer Behavior: Demographic and psychographic characteristics; brand preference; purchase location; motivation; influence of groups; purchase frequency; product evaluation; influence of advertising
Marketing Mix
The major aim of marketing strategy is to determine the marketing mix (the four Ps). Marketing research helps evaluate different alternatives and includes them in the marketing plan. It answers specific questions for each element:
- A. Product: What attributes are important? How to differentiate? How to design packaging? Importance of warranty and after-sale service?
- B. Price: What is the elasticity of demand? How should the product be priced? What is the paying capacity of the market? How to react to competitive price changes? How important is price to the buyer?
- C. Place: What kinds of outlets? How many intermediaries? Appropriate commission/discount? How to motivate channel members? How to manage physical distribution?
- D. Promotion: What is the optimum promotion mix? What should be the budget? Which media are most effective? How to measure advertising effectiveness? Which advertising agency to hire?
Marketing Research Industry
In early days, business owners knew their customers directly, so there was little need for formal marketing research. As businesses grew and customers became separated from managers, marketing research became necessary. In response to this need, companies have created their own Research and Development (R&D) departments, and many independent research companies called Research Suppliers have also emerged.
Research Suppliers are organizations that provide research services to business and industry on payment.
🔑 Definition — Full Service Research Supplier: A company that performs all functions of marketing research for its clients.
🔑 Definition — Limited Service Research Supplier: A company that performs one or more specific tasks of marketing research (e.g., only data collection or only data analysis) for its clients.
⭐ Key Takeaways
Marketing is fundamentally about customer satisfaction, and the marketing concept requires understanding customer needs—which is impossible without information. Marketing research is the systematic, objective process of gathering and analyzing that information to solve specific marketing problems and support decision-making. It plays a critical role in all phases of strategy development, from situation analysis (understanding markets, environment, and consumer behavior) to deciding the marketing mix (product, price, place, promotion). The absence of relevant information forces managers to rely on guesswork, while marketing research provides an evidence base that reduces risk and improves outcomes. The marketing research industry includes both internal R&D departments and external research suppliers, which can be full-service or limited-service firms.
🧠 Quick Revision Questions
- What is the core philosophy of the marketing concept, and why does it necessitate marketing research?
- According to the course definition, what are the four key steps in the marketing research process?
- Name three types of information about the marketing environment that marketing research can provide during a situation analysis.
- For which four elements of the marketing mix does marketing research provide decision-support information?
- What is the difference between a full-service research supplier and a limited-service research supplier?
📘 Lecture 2 — Selection of Marketing Research Supplier
📖 Overview: This lecture covers the criteria for selecting a marketing research supplier, career paths in marketing research, and the ethical responsibilities of researchers. It also defines the characteristics of successful marketing research and introduces the ten-step research process, emphasizing that research must be decision-oriented, relevant, timely, efficient, and accurate.
🗂️ Topics Covered
The lecture begins with factors for selecting a marketing research supplier and careers in the field. It then defines the four characteristics of successful marketing research: relevance, timeliness, efficiency, and accuracy. Next, it details the three categories of research ethics (towards clients, respondents, and the profession). Finally, it introduces the ten-step marketing research process, explaining the first five steps in detail: establishing the need, defining the problem, setting objectives, determining research design, and identifying data types and sources.
📝 Lecture Summary
Selection of Marketing Research Supplier
Clients consider several factors when choosing a marketing research company for a project. These include the firm’s reputation, the number of projects completed, their record for completion on schedule, and the quality of projects completed. A key factor is whether the firm has done similar projects before. The personnel—both technical and non-technical expertise—of the firm are important, as is client service, meaning they must communicate well. Cost-competitive bids are considered, but it is crucial to remember that a cheaper bid is not always the best. Cost and quality must be compared.
Careers in Marketing Research
The lecture lists a hierarchy of career positions in marketing research, ranging from executive to field-level roles. These positions include Vice President Marketing Research, Research Director, Assistant Director Research, Senior Project Manager, Statistician/Data Processing Specialist, Senior Analyst, Junior Analyst, Fieldwork Director, Operational Supervisor, and Fieldworker.
Ethics in Research
Ethics in research are categorized into three areas: ethics towards the client, ethics towards the profession, and ethics towards the respondent.
Successful Marketing Research
Successful marketing research is decision oriented. It should be undertaken when it is likely to reduce uncertainty of decisions. There is no use in doing marketing research if it does not provide any input into a marketing decision. Marketing research is considered successful if it is relevant, timely, efficient, and accurate.
A. Relevant: Marketing research should be undertaken to solve a specific marketing problem and support strategic or tactical planning. It should not be done merely to satisfy curiosity.
B. Timely: Marketing decisions are fixed in time, so relevant information must be made available before the decision deadline. For example, if a product is to be launched in November, research on its formulation, name, advertising, and price should be conducted before November so the launch can be successful.
C. Efficient: A research is efficient if its cost is less than its benefits. It is unwise to spend three million rupees on research to reduce a risk worth only two million rupees. Both the cost of the research (field work, data analysis, etc.) and the cost of a wrong decision must be considered.
D. Accurate: No research is better than the accuracy of its data. Timeliness, relevance, or efficiency should not compromise the accuracy of results. Methods and procedures must reduce biases and ensure accuracy.
Ethics in Research (Detailed)
There are three specific ethical responsibilities for a researcher.
Ethics towards Client: The research supplier must not share the results of the research with any other firm, especially competitors of the client. The client funded the research, so they have the sole right to its benefits.
Ethics towards Respondents: The data provided by the respondents must be kept confidential and should not be reported with the respondents' names. The right of anonymity of the respondents must be safeguarded.
Ethics towards Profession: The researcher must be a true professional and follow the code of conduct of the research profession. The researcher is morally obligated to provide an unbiased research design, honest fieldwork, and meticulous analysis. All research activities must be performed as agreed upon with the client. For example, if it was agreed that 1300 questionnaires will be distributed, the number should not be less than 1300.
Research Process
The research process is a series of steps. The ten steps are:
- Establish the need for marketing research
- Define research problem
- Establish research objectives
- Formulate research design
- Determine types and sources of data
- Determine sample size and select sample
- Design data collection instruments
- Collect data
- Analyze data
- Prepare and present research results
These steps are generally followed in this sequence, but the researcher may move back and forth as new things are discovered.
1. Establishing the Need for Marketing Research
Research is undertaken when there is a need for information to solve a marketing problem or assess an opportunity. A good monitoring system can alert the marketing manager to problems or opportunities that require research. Marketing research should be avoided if: a) the needed information is already available. b) there is not enough time (time is the enemy). c) sufficient funding is not available. d) the cost of doing research outweighs the benefits.
🔑 Definition — Marketing Research Need: The genuine requirement for information to solve a specific marketing problem or assess an opportunity, where existing data, time, and budget do not preclude the research.
2. Define the Problem
Defining the marketing research problem is the single most important step. "A problem well defined is half solved." The researcher must help the client translate the management problem into a research problem. Symptoms (tips of the iceberg) must be differentiated from the problem (the iceberg itself). Problem definition may involve discussions with the decision-maker, interviews with other managers, industry experts, or analysis of secondary data.
3. Establish Research Objectives
Research objectives are the information needed to solve the marketing problem. They are determined by the problem definition and can take the form of research questions or research hypotheses. 🔑 Example — Research Objective: Determine the average level of satisfaction for our service. 🔑 Example — Research Question: Is our service of average, below average, or above average for our customers? 🔑 Example — Research Hypothesis: Our customers are satisfied with our service.
4. Determining Research Design
A research design is a framework or blueprint to conduct a research project. It details the nature and sources of data, data collection instruments, hypothesis testing, scaling procedures, sampling, and data analysis plans. There are three basic research designs:
- Exploratory Design: Used when very little is known. It helps evaluate new opportunities and define/refine the research problem or generate research questions/hypotheses.
- Descriptive Design: Used to describe marketing phenomena. It answers what, who, why, how, when, and where questions. It describes consumer attitudes, intentions, behaviors, and competitor strategies. This is the mainstay of marketing research.
- Causal/Experimental Design: Used to isolate causes and effects. It determines which variable (the independent variable) is causing another variable (the dependent variable) to change. For example, if advertisement increases sales, advertisement is independent and sales is dependent. It involves experiments and controlling for intervening or moderating variables.
5. Determine Types and Sources of Data
There are two types of information: secondary data and primary data.
- Secondary Data: Information already collected for some other purpose. Sources include books, the internet, and databases. It is quickly collected and relatively inexpensive but may have a data fit problem and lack integrity.
- Primary Data: Data collected specially for the study at hand for the first time. It is collected via questionnaires, interviews, observation, or electronically. In marketing research, primary data is used perhaps more than secondary data.
🔑 Definition — Secondary Data: Information that has already been collected for some other purpose and is now being used for a secondary purpose. 📐 Definition — Primary Data: Data that is collected specially for the study at hand for the first time by the researcher’s team.
Determine Sample Size and Select Sample (Brief Intro)
Samples are selected from the population. The sample is a subset of the population from which data is collected to draw conclusions. The sample must be representative. In sampling, the researcher specifies: a) Sampling frame: an up-to-date list of all population elements. b) Size of the sample: decided based on precision, confidence, time, and budget. c) Method of selecting the sample: either probability or non-probability methods.
Designing Data Collection Instruments
The design of data collection tools is critical. Asking the wrong questions will destroy the research. Primary data is collected by asking questions (via questionnaires) or by observing. Questionnaires can be structured (close-ended, with pre-specified answer choices) or unstructured (open-ended, allowing respondents to answer freely).
⭐ Key Takeaways
A student must remember that successful marketing research must be decision-oriented and possess four key qualities: relevance, timeliness, efficiency, and accuracy. The single most critical step in the research process is correctly defining the problem, as a problem well-defined is half-solved. Researchers have three distinct ethical responsibilities: confidentiality towards the client, anonymity towards the respondent, and professional integrity towards the profession. The research process includes three main designs (exploratory, descriptive, and causal), and data is classified into secondary (pre-existing) and primary (collected for the first time). Finally, the choice of a research supplier must balance cost with quality, reputation, and expertise.
🧠 Quick Revision Questions
- List the four characteristics of successful marketing research.
- What is the single most important step in the marketing research process?
- What is the difference between a symptom and a problem in the context of defining a research problem?
- Name the three categories of ethics in research and briefly state the primary responsibility under each.
- What are the three basic types of research design, and what is the primary purpose of a causal design?
📘 Lecture 3 — Collect Data
📖 Overview: This lecture covers the final stages of the marketing research process, focusing on data collection, analysis, and report preparation. It also introduces the critical distinction between management problems and research problems, explaining how to properly define a research problem and the constructs involved.
🗂️ Topics Covered
The lecture begins with data collection methods and field force management, then moves to data analysis including preparation and statistical testing. It explains the importance of the research report, types of marketing research (basic vs. applied), and the critical process of problem definition. Finally, it covers the difference between managers and researchers, management vs. research problems, constructs and operational definitions, and the formal process of defining the research problem.
📝 Lecture Summary
Collect Data
The process of data collection is critical since it involves a large proportion of the research budget and a large proportion of total error in the research result. Data collection requires a field force of some type. This field staff operates in the field for personal interviewing (in-home, mall intercept or computer assisted personal interview) or telephonic interview or mailed questionnaire or electronic mail (e-mail or internet). Proper selection, training, supervision and evaluation of the field force are necessary to minimize errors in data collection.
Data Analysis
After the data have been collected by the field force, the data are to be analyzed. It has two steps: data preparation (or processing) and data analysis.
Data preparation includes editing, coding, transcription and verification. Each questionnaire or form is inspected or edited and if necessary, corrected. Numbers or codes are assigned to represent each response to each question in the data collection instrument e.g. male = 1, female = 2 etc. The data from the questionnaire is input directly into computer.
In the second stage, data are analyzed by the way of tabulation, cross-tabulation and statistical tests. Tabulation refers to counting of number of responses or observations that fall in each category of responses. It allows the researcher to understand what collected data means. Examining two or more response categories at the same time is called cross tabulation. Finally a variety of statistical tests including means, frequencies, correlations, trend analysis, test of significance etc are also used to analyze data. Data analysis leads to draw conclusions and answer the specific research questions.
Prepare and Present the Research Report
Last step (Report) is most important phase of marketing research. The research report properly communicates the study results to client. The entire project is documented in a research report. Details include: tables and graphs to enhance clarity and impact, neatly produced analysis according to objectives, SPSS or other (invariably oral presentation before finalization), major findings and conclusions, improvement and additional work, and finalization of the report.
The research report should be clear, concise, and complete. It must follow a standard format, use TOG language, and consider the level of the audience.
Types of Marketing Research
There are two types of marketing research. Basic research is knowledge valuable, laser all scientists. Applied research is undertaken to solve a specific research problem, mostly applied. Other types are action, co-relational, etc.
Defining Problem
Problem definition is critical. It gives direction to subsequent phases of marketing research. Standardized research (syndicated) uses the same process day in and day out (e.g. retail audit). It is done by a marketing research supplier. Research may be customized where a unique marketing management problem is confronting the manager.
The researcher should understand the unique situation for a customized problem and conduct discussions with the manager. Problem definition is in the form of a statement of the general problem and identification of the specific components of the marketing research problem.
Difference between Managers and Researchers
Both work in different worlds. The manager is line, focused on decision making and making profit, wants answers to questions, is emotional and political, wants the symptoms to disappear, and is practical-pragmatic. The researcher is staff, generates information, wants to ask questions, is scholarly, detached, unemotional, non-political, and wants to find the truth.
As marketing managers and marketing researchers have different orientations, they develop differences. Both should understand each other’s role and view marketing research as a partnership endeavor. They can have meaningful discussions to classify things, for example whether to investigate changes in the marketplace, select alternative marketing actions, help gain some competitive advantage, or stay abreast of market trends.
The marketing research problem differs from the marketing management problem.
🔑 Definition — Management Problem: It is a decision making situation confronting the marketing manager emerging from problems (low performance of the product), opportunities (new trends), or symptoms (market share declining).
🔑 Definition — Research Problem: Marketing research is defined as providing relevant, accurate, unbiased information that managers can use to solve their marketing management problem. The research problem is defined on the basis of the management problem; it is critical that the management problem be defined accurately and fully.
📌 Example of Relationship between Decision and Research Problem:
| Decision problems | Research problems |
|---|---|
| Develop packaging for a new product | Evaluate effectiveness of alternative packaging designs |
| Increase market penetration through the opening of new stores | Evaluate prospective locations |
| Increase store traffic | Measure current image of the store |
| Allocate advertising budget geographically | Determine current level of market penetration in respective areas |
| Introduce new product | Design test market and do market testing to check the acceptance of the new product |
Constructs and Operational Definitions
To formulate the research problems, the market researcher has to specify constructs and operational definitions and identify relationships between various constructs.
🔑 Definition — Construct: A term for a concept that is somewhat involved in the marketing management problem that will be researched. Examples of marketing constructs may be brand awareness, recall, attitude towards brand, lifestyle, and brand loyalty, etc.
Although general perception of these constructs may be shared by the managers and researcher, the market researcher translates the construct into an operational definition which describes how a construct will be measured. It ultimately helps in formulating the questions that will be asked to get information about the construct.
📌 Examples of Constructs and Operational Definitions:
| Construct | Operational definition |
|---|---|
| Brand awareness | Percentage of respondents having heard of the brand |
| Recall of ad | Number of people who remember seeing an ad |
| Knowledge of product | What they can tell about the product |
| Attitude towards brand | Number feel positive or negative about the brand |
| Satisfaction | How they evaluate its performance |
| Brand loyalty | How many times they bought the brand in the last six months |
💡 Why this matters: Without clear operational definitions, different researchers might measure the same construct in completely different ways, making results incomparable and conclusions unreliable.
Process of Defining the Research Problem
The tasks involved in the definition of problems are explained below.
The problem definition process includes: discussion with the manager, interview with experts, secondary data analysis, and preliminary research. These inputs are considered within the environmental context of the management decision problem. This leads to the formulation of the marketing research problem, which then defines the information needs, research questions, and hypotheses.
⭐ Key Takeaways
Data collection requires a carefully selected and trained field force to minimize errors. Data analysis flows from preparation (editing, coding) to analysis (tabulation, cross-tabulation, statistical tests). The research report is the most important phase, communicating results clearly to the client. The critical distinction is between a management decision problem (what the manager needs to decide) and a research problem (what information is needed to support that decision). Finally, constructs must be carefully defined with operational definitions to ensure valid and reliable measurement in the research process.
🧠 Quick Revision Questions
- What are the two main steps in data analysis after data collection?
- What is the difference between tabulation and cross-tabulation?
- What is the key distinction between a management problem and a research problem?
- What is a construct in marketing research, and why must it be translated into an operational definition?
- Name the four inputs involved in the process of defining the research problem.
📘 Lecture 4 — Examples of Marketing Management and Marketing Research Problems
📖 Overview: This lecture bridges marketing management problems with marketing research problems through two detailed examples. It then introduces the critical distinction between primary and secondary data, covering advantages, disadvantages, and the wide range of internal and external secondary data sources available to researchers.
🗂️ Topics Covered
The lecture covers two main case examples linking marketing management problems to marketing research problems with specific objectives and research questions. It then presents a comprehensive comparison of primary versus secondary data, the advantages and disadvantages of secondary data, internal sources of secondary data, external published sources, computerized databases (bibliographic, numeric, full-text, directory, and special-purpose), and syndicated sources of data.
📝 Lecture Summary
Example I Marketing Management Problem
Alpha company has a long history of successful marketing of business planning products such as calendars, appointment books, and diaries for business people. In the last few years, their sales have shown decline despite a booming economy and business expansion. Management believes this fall in sales can be attributed to the competitive strategy, particularly the xyz group. It may also be due to electronic scheduling books or softwares that are available now. Thus, Alpha must determine the causes of decline and suggest suitable marketing actions to counter the decline.
Marketing Research Problem
Research should be conducted to identify what competitor's actions have adversely affected Alpha's sales. It should also be determined if customers of the traditional day planners are switching over to electronic day planners and software scheduling systems.
Specific Research Objectives
- Trace market share of the competitors of the traditional day planners over the past five years.
- Determine changes of the competitors marketing strategy (i.e. 4Ps) for the same period.
- Evaluate the customer's potential for the adoption of electronic scheduling books and integrated software schedulers programs.
Example II Marketing Research Problem
Determine the weaknesses and strengths of Departmental Store A vis-à-vis other major departmental stores with respect to factors that influence the store patronage.
Research Questions
- What criteria do households use when selecting departmental stores?
- How do households evaluate Departmental Store A in terms of these criteria?
- Which stores are chosen for shopping the specific product categories?
- What is the market share of Departmental Store A for specific product categories?
- What is the demographic and psychographic profile of customers of Departmental Store A? Does it differ from competing stores?
Secondary Data in Marketing Research
As already defined, secondary data are those data which have already been collected by someone else (and not the researcher) for some other purpose in the past. Now these data are being gathered by the researcher second hand.
Primary data is originated by the researcher for the first time for the project at hand. It is time-taking and expensive.
🔑 Definition — Secondary Data: Data that have already been collected by someone else for a different purpose and are now being reused by the researcher. 🔑 Definition — Primary Data: Data originated by the researcher for the first time for the specific project at hand.
📐 Comparison of Secondary and Primary Data:
| Feature | Secondary | Primary |
|---|---|---|
| Purpose | Other project | This project |
| Process | Quick and easy | Time-taking |
| Cost | Relatively low | High |
| Time | Short | Long |
💡 Why this matters: Understanding whether to use primary or secondary data determines the entire research timeline and budget. Secondary data saves resources but may not perfectly fit the research problem.
Advantages and Disadvantages of Secondary Data
🔑 Advantages of Secondary Data: Easily accessible, relatively inexpensive, rapidly obtained. 🔑 Disadvantages of Secondary Data: Data may not fit the problem, may be outdated, relevance is doubtful, may not be accurate.
Sources of Secondary Data
Secondary data may be internal or external. Internal data are generated within the organization for which the research is being conducted. These data may be ready to use or may require further processing before it is used in the research. Some of the typical internal data include: a. Sales data (by product, period, territory) b. Cost data c. Accounting data d. Shipping data e. Budgets f. Sales calls data g. Record of advertising and promotion h. Manufacturing reports i. Quality check report j. Sales return reports k. Customer complaint reports l. R & D reports
External Sources of Secondary Data
In addition to internal sources, secondary data can be obtained from external sources which are generated outside the organization. Such data exist usually in published and online form. Federal, provincial, and local governments publish such data regularly. In addition, Chambers of Commerce, trade and professional associations, marketing research firms, and commercial publishers also publish such data for sale.
Published Sources
Such data are available from the libraries or such entities as trade associations, chambers of commerce, or supplier syndicate of research firms. General business data are in the form of books, journals, periodicals, reports, and magazines. Directories and guides regarding business and commerce are available in the libraries. Government sources include documents like census data, Economic Survey of Pakistan, and Statistical Reports.
Databases
A database is a collection of data and information describing items of interest. Theoretically, we can have a non-computerized database, but practically almost all databases are computerized because of computer's ability to sort, edit, and analyze the information.
Companies collect information about their customers and prepare internal databases for their marketing purposes. On the other hand, there are lots of external databases supplied by outside organizations. These are available either free or on a nominal fee.
Computerized Databases
A computerized database is a collection of data records in a computer-readable form. These databases are accessed online on a telecommunication network. Internet databases can also be accessed and downloaded for storing the data elsewhere. Databases are offline too. Such databases are available on CD-ROM disks. Online or offline, databases can be classified as bibliographic, numeric, full-text, directory, and special purpose databases.
Online and offline databases can further be classified as:
- Bibliographic databases: Such databases contain citations to journal articles, newspapers, government documents, technical reports, and marketing researches.
- Numeric databases: These databases contain numerical and statistical data. Industrial data are in the form of numeric databases.
- Full-text databases: Such databases offer the complete text of articles appearing in the selected publications including newspapers, journals, etc.
- Directory databases: These databases list information about individuals, organizations, government entities, and service providers.
- Special-Purpose databases: Such databases provide information of special nature, for example, data on a specialized industry.
🔑 Definition — Database: A collection of data and information describing items of interest, typically stored in computerized form for sorting, editing, and analysis.
Syndicated Sources of Data
Another important source of external secondary data is the syndicated service. As already explained, syndicated services are the marketing research companies that collect and provide information from a common pool of data to different clients who subscribe to their services. Such information needs are shared by many companies who are served by the syndicates on payment. Subscription of each client is nominal as compared to if the data were collected exclusively for this particular client. Syndicated firms collect the same standardized data. Such data are not collected for a particular client but drawing from a common pool, the data are fit to the individual needs of the client. Syndicated services collect and provide data on households and consumers, psychographics, lifestyles, advertising evaluations, scanner services, retail audits, wholesale audits, buying power index, etc. Companies use syndicated service data in segmentation, distribution, and media planning.
🔑 Definition — Syndicated Services: Marketing research companies that collect standardized data from a common pool and provide it to multiple subscribing clients at a nominal fee.
💡 Why this matters: Syndicated data allow companies to access high-quality, professionally collected market data at a fraction of the cost of conducting the research themselves, making it especially valuable for small and medium enterprises.
⭐ Key Takeaways
The lecture demonstrates how marketing management problems (like declining sales) must be translated into specific, researchable marketing research problems with clear objectives and research questions. Secondary data are readily available, inexpensive, and quick to obtain but may be outdated, irrelevant, or inaccurate. Researchers must carefully evaluate secondary data fit before using it. Internal sources (sales records, cost data, customer complaints) and external sources (government publications, trade associations, databases, syndicated services) offer vast amounts of secondary data. Computerized databases come in five types—bibliographic, numeric, full-text, directory, and special-purpose—each serving different research needs, while syndicated services provide cost-effective, standardized data for multiple clients.
🧠 Quick Revision Questions
- What is the difference between a marketing management problem and a marketing research problem? Use the Alpha Company example to illustrate.
- List four advantages and four disadvantages of using secondary data in marketing research.
- Name five types of computerized databases and give one example of what each type contains.
- What are syndicated services, and why do companies prefer to use them instead of collecting primary data?
- Identify three internal sources and three external sources of secondary data available to a marketing researcher.
📘 Lecture 5 — Research Design
📖 Overview: This lecture introduces the concept of research design as a blueprint for marketing research projects. It covers the major classification of research designs into exploratory and conclusive, explains their differences and purposes, and details the various methods for conducting exploratory research, with a special focus on the focus group interview.
🗂️ Topics Covered
This lecture begins by defining research design as a master plan for data collection and analysis. It then classifies research designs into exploratory and conclusive, highlighting their key differences in objectives, characteristics, samples, and outcomes. The lecture details the five main purposes of exploratory research and then dedicates substantial coverage to the five methods of conducting exploratory research, including secondary data analysis, focus groups, expert surveys, depth interviews, and projective techniques. The final part of the lecture provides an in-depth examination of the focus group interview, covering its objectives, operational characteristics, the qualifications of a good moderator, and the steps for conducting one.
📝 Lecture Summary
Research Design
Research design is a plan or blueprint for conducting the marketing research project. It specifies the details of the methods and procedures necessary for collecting and analyzing data. It is a set of advance decisions that make up the master plan for collection and analysis of the data. Developing a research design is important as it saves the time and money of the researcher by enabling efficiency and economy, serving the researcher as a blueprint serves a builder.
Classification of Research Design
Research design may be broadly classified into exploratory or conclusive.
Exploratory Research Design: The primary objective is to provide insight and comprehension of the problem situation. It is used to obtain background information, define terms, clarify problems and hypotheses, and establish research objectives. It is unstructured and informal, usually conducted at the outset of a project.
Conclusive Research Design: Typically more formal than exploratory research, it is based on large, representative samples and data gathered are quantitatively analyzed.
Differences between Exploratory and Conclusive Research
| Feature | Exploratory | Conclusive |
|---|---|---|
| Objective | To bring insight and understanding | To test specific hypotheses |
| Characteristics | Analysis of primary data is qualitative; flexible, unstructured, and informal process; information obtained is loosely defined | Analysis of data is quantitative; formal and structured process; information clearly defined |
| Sample | Small and non-representative | Representative and large sample |
| Conclusions | Tentative | Final-conclusion |
| Outcome | Followed by conclusive or further exploratory research | Findings used as input in decision making |
Purposes of Exploratory Research
The purposes of exploratory research are put to use in a number of situations:
- Gain Background Information: When the researcher has little understanding of the situation, much needed background information is collected.
- Precision and Clarity in the Problem: It is helpful in defining the research more clearly.
- Develop Hypotheses: Hypotheses are tentative statements which describe speculative relationships between variables. Exploratory research helps find out the variables before hypothesizing the relationship.
- Establish Research Priorities: It helps in determining the priorities of topics to research.
- Define Terms: It clarifies concepts and defines terms (e.g., ‘store image’, ‘customer satisfaction’) and reveals how to measure them.
Methods of conducting exploratory research
A variety of methods can be used to conduct exploratory research.
- Secondary Data Analysis: The search and analysis of secondary data (published and electronic material) is often the core of exploratory research.
- Focus Group: An increasingly popular method where a trained moderator conducts a spontaneous, unstructured discussion with a small group of respondents.
- Expert or Experience Survey: Gathering information from expert and knowledgeable persons through an unstructured personal interview. Experts are chosen on the basis of judgment and convenience, not as a representative sample.
- Depth Interview: An interview with a single person (one-to-one) conducted by a highly skilled interviewer to uncover attitudes, motivations, and feelings. It is more expensive than a focus group and is used in special situations like probing respondents, understanding complicated behavior, and discussing sensitive topics.
- Projective Techniques: Borrowed from clinical psychology, these are indirect forms of questioning that seek to explore hidden motives. Respondents are asked to interpret the behavior of others, thereby indirectly projecting their own needs and attitudes. They are classified as:
- a) Word Association: A respondent is presented a list of words and asked the first word that comes to mind.
- b) Sentence Completion: Incomplete sentences are given and respondents are asked to complete them.
- c) Construction Technique: The respondent is required to construct a response in the form of a dialogue, description, or story, often using a picture (e.g., Thematic Apperception Test - TAT) or a cartoon balloon test.
- d) Expressive Techniques: The respondent is presented with a visual or verbal situation and asked to relate the feelings and attitudes of other people through role playing or third-person techniques.
💡 Why this matters: Projective techniques are crucial for uncovering deep-seated, often unconscious, consumer motivations that respondents cannot or will not articulate directly.
Focus Group Interview
A focus group interview is a discussion led by a trained person called a moderator. It brings insight by talking to representatives of the target market and can yield unexpected findings.
Objectives of Focus Group: a. To generate ideas for new products, services, or improvements. b. To understand consumer vocabulary. c. To reveal consumer needs, attitudes, perceptions, and motives. d. To understand findings from quantitative studies.
Operational Characteristics of the Focus Group
| Characteristic | Description |
|---|---|
| Size | 8-12 |
| Composition | Pre-screened, homogeneous; provide incentive for participation |
| Moderator | Trained, with good interpersonal and observational skills |
| Duration | 1-3 hours |
| Physical setting | Informal and relaxed |
| Location | Focus group facility, hotel |
| Recording | Audio-video |
Qualification of a Good Focus Group Moderator
- A friendly leader
- Knowledgeable but not all-knowing
- A quick learner
- A good listener with excellent memory
- A facilitator, not a performer
- Encouraging to unresponsive members
- Flexible
- Permissive yet alert and focused
- Personally involved in discussion
- Sensitive to guide at intellectual and emotional levels
Conducting a Focus Group
- Determine the objectives of the research, project, and problem.
- Develop screening questions.
- Recruit the focus group members.
- Develop moderator’s outline.
- Conduct focus group (with audio-video recording).
- Review tapes and analyze data.
- Summarize the findings.
⭐ Key Takeaways
The most critical concept from this lecture is the distinction between exploratory and conclusive research designs, where the former is a flexible, qualitative approach for gaining insight and defining problems, while the latter is a formal, quantitative approach for testing specific hypotheses. You must remember the five specific purposes of exploratory research, which are to gain background information, clarify the problem, develop hypotheses, establish priorities, and define terms. The five methods for conducting exploratory research—secondary data analysis, focus groups, expert surveys, depth interviews, and projective techniques—are distinct tools that serve different needs for initial investigation. Finally, a deep understanding of the focus group interview is essential, including its four objectives, its operational characteristics like the ideal size of 8-12 people, and the ten specific qualifications of a good moderator.
🧠 Quick Revision Questions
- What is the primary difference in objectives between exploratory and conclusive research design?
- List at least four of the five purposes for which exploratory research is conducted.
- What are the five main methods for conducting exploratory research?
- In projective techniques, what is the difference between a word association test and a sentence completion test?
- What are the qualifications of a good focus group moderator? Name at least three.
📘 Lecture 06 — Online Focus Group
📖 Overview: This lecture covers the transition from traditional to online focus groups and provides a detailed examination of descriptive research design in marketing research. It explains the fundamental differences between cross-sectional and longitudinal studies, and provides a comprehensive overview of survey methods including personal interviews, telephone interviews, and mailed questionnaires.
🗂️ Topics Covered
The lecture begins with an explanation of online focus groups and their advantages/disadvantages compared to traditional focus groups, followed by applications of focus groups in marketing research and dos and don'ts. It then moves into descriptive research design, covering its purpose and classification into cross-sectional and longitudinal studies. The lecture concludes with a detailed examination of survey methods, including personal interviews (in-home, mall intercept, computer-assisted), telephone interviews, and mailed questionnaires/mail panels.
📝 Lecture Summary
Online Focus Group
Apart from the traditional focus group, it can now be conducted online. The online focus group size is usually four to six participants and can be conducted anywhere in the world. It continues for about an hour or so. Group dynamics are limited. It is inexpensive as compared to traditional focus group, but the data gathered through conventional focus group are more valuable than online focus group.
Advantages of Focus Group
Several advantages exist:
- Synergism: Several people put together to produce information
- Snowballing: A person's comment triggers a chain reaction
- Security: Group security; participants feel free to express themselves
- Spontaneity: Spontaneous responses, not planned, are accurate
- Speed: Many people contribute ideas
- Client observes the group: Through one-way glass
- Flexibility: Can change with the situation
Disadvantages of Focus Group
- Misjudgment: Subjective interpretation — a trained moderator is needed
- Cost: Per participant is high
- Sample: Not representative
- Moderation: Difficult to manage
- Domination of some members: Control of the moderator is needed
Application of Focus Group in Marketing Research
Focus groups can be used in almost any situation requiring some preliminary understanding and insight. In marketing research, they address issues like:
- Developing copy for advertisement
- Obtaining an impression about price of the product
- New product concept testing
- Understanding consumer perceptions, preference, and purchase behavior
- Finding new ideas about old products
- Generating hypotheses for research
Do’s and Don’ts about Focus Group
- Be sure to get the right people in the group
- Avoid judging participants on physical appearance
- With focus groups, fewer is better than many
- Never do a focus group without planning
- Never lose sight of the objectives of the research for which the focus group is being conducted
- Hire a trained and qualified moderator
- Complete the report and submit it quickly
Descriptive Research Design
The major purpose of descriptive research is to describe marketing functions or characteristics. It provides answers to questions such as who, what, how, when, where as they relate to the research problem. Descriptive research is typically conducted to answer the following basic questions to formulate effective marketing strategies:
- Describe the characteristics of relevant groups such as consumers, market areas, salespersons, etc.
- Percentage of units in a population showing certain behavior. For example, percentage of heavy users of a brand.
- Product characteristics as perceived by the market/customers.
- Degree of association of different marketing variables. For example, association of income and buying quantity. Such association does not mean cause-and-effect relationship.
- To make predictions about the occurrence of marketing phenomena. For example, what will be the sales of Bata stores in Okara during December 2007?
Classification of Descriptive Research
Descriptive research can further be classified into two types: cross-sectional and longitudinal.
Cross-Sectional Studies Cross-sectional studies measure data from a sample at one point in time. The sample is like a cross-section of the population. If you have to measure the population at different times, every time a new sample should be taken. Cross-sectional studies are quite prevalent in marketing research. As data from the sample are collected only once, they are also called snapshot studies. Usually, cross-sectional studies use a large sample, which is why these are called survey research — the method with which people are most familiar.
Longitudinal Research Longitudinal research is a type of research design which involves a fixed sample measured repeatedly on the same variables. In cross-sectional design, the sample changes every time, but in longitudinal research, the sample remains the same over time. In cross-sectional studies, there is only one picture or snapshot, but in longitudinal studies, there are series of pictures which provide a view of the changes that have taken place over time.
The term "panel" is used to describe a longitudinal design. A panel contains a sample of respondents who have agreed to provide information at specified intervals over an extended period of time. A panel may be a group of customers, experts, households, or stores. Panel members are compensated for their participation by gifts, coupons, or cash.
There are two types of panels:
- Traditional panel: A fixed sample where the same variables are measured repeatedly.
- Omnibus panel: A fixed sample which is measured repeatedly, but the variables measured are different.
Traditional panel studies can be used to analyze how members switched from one brand to another from one time period to the next. Another use of longitudinal study is that of market tracking studies. Through such studies, changes over time can be measured. A marketer can track how their brand is doing compared to other brands by having representative data on brand market share.
💡 Why this matters: Cross-sectional studies give a snapshot of the market at one moment, while longitudinal studies reveal trends and changes over time, which is critical for understanding brand loyalty and market dynamics.
Methods Used in Descriptive Design
There are basically two methods employed in descriptive research: survey and observation.
Survey method is based on questioning of respondents. Questions may be asked verbally, in written form, or through a computer. Questions may be asked about awareness, interactions, attitude, motivation, demographics, or lifestyle of the respondents.
Questions in a survey may be structured or unstructured. Structured questions, which are usually asked in survey research, are standardized and direct. Unstructured questions are open and do not have prearranged answer choices.
Advantages of Surveys
Comparatively, survey methods allow collection of a significant amount of data in an economical and efficient manner. Survey methods typically allow larger samples. There are at least four advantages:
- Standardization: Survey methods ensure that all respondents are asked the same questions. The same order of questions and same choices of answers are given to each respondent. The sequence of the questions is the same. In short, a standard questionnaire is administered to all respondents.
- Ease of Administration: Whether personal interview, telephonic interview, computer-assisted interview, or mailed questionnaire, survey methods are easy to administer. Mailed questionnaires are perhaps the simplest method. There are no tape recordings, note-taking, or analyzing projective or physiological data.
- Find Out "Unseen": Much of the unseen data can be found out through direct questions. For example, we can find out by asking respondents how many stores they visited before making a final purchase. Similarly, we can ask about income, family size, or occupation — information that was otherwise unobservable by the researcher. All unobservable information can be obtained through direct questioning.
- Suitable for Tabulation and Statistical Analysis: Survey methods are designed so that tables can easily be prepared and statistical packages like SPSS can be easily used. In contrast to qualitative research where samples are small and data prove frustrating when subjected to statistical analysis, large cross-sectional surveys perfectly suit these statistical procedures.
Classification of Survey Method
Survey methods can be classified based on the mode used to administer the questionnaire. These are:
- Personal interview
- Telephonic interview
- Mailed questionnaire
Personal Interview In personal interviews, respondents are interviewed face-to-face. The surveyor or interviewer reads the questions to the respondent and records the answers in writing, audiotape, or videotape form. This has been a primary method of survey for many years, but its use is declining due to advances in technology and rising costs. Nevertheless, personal interviews are still used due to their following advantages:
a. Feedback: Non-verbal cues give feedback to the interviewer as to whether the respondent is understanding the question or not. Clarification may be provided by the interviewer, or the question may be adjusted accordingly.
b. Rapport: Due to the personal presence of the interviewer, a rapport can be developed with the interviewee. Thus, the respondent starts relating to the interviewer and answers the questions more openly. Respondents are more truthful when they are face-to-face.
c. Quality control: For interviews, most of the time the researcher selects respondents based on certain distinguishing characteristics relevant to the research. Personal interviewers must ensure that respondents are selected correctly before the interview takes place. This helps maintain quality of the research.
d. Adaptability: Personal interviewers can easily adapt to the needs of different respondents. They can help an elderly respondent understand how to respond to "somewhat agree" or "strongly agree." Similarly, they can give examples to respondents on other issues. They can adjust the direction. If the interviewer does not understand the answer, they can ask probing questions to get clarification or depth in the answer.
Personal interviews have three main disadvantages: they are expensive, take more time, and lend themselves to interviewer's bias. The interviewer may ask leading questions or give hints to a specific answer, which is not desirable in research.
Categories of Personal Interview Personal interviewing may be categorized into three types: a. In-home personal interviews: Take place in the home or office of the respondent according to the convenience of the interviewer. The interviewer fixes an appointment for date, time, and place of the interview prior to going. b. Mall intercept personal interviews: Respondents are shoppers at shopping malls, and they are intercepted while shopping in the store or outside the store. Sometimes they are brought to an office facility built by the research firm in the shopping mall for this purpose. Mall intercepts take place in high-traffic shopping areas. Mall intercept has acquired a major role due to its ease of implementation. It is less expensive than depth interviews in home or office. This has a very low cost per interviewee. However, representativeness of mall intercept samples is always an issue. Some shoppers refuse to give an interview. Another disadvantage is that the environment of shopping malls is not as comfortable as an office or home; therefore, long questionnaires cannot yield meaningful information. c. Telephonic interview: Where physical contact with the respondent is not possible or is expensive, telephonic interviewing is an attractive option.
Advantages of telephonic interviews include speed and cost. Telephone is relatively inexpensive for collecting data. Telephone surveys are also quick — approximately one good interview per hour can be conducted.
Disadvantages include: First, you cannot demonstrate or show anything to the respondent on the phone; therefore, when showing an advertisement or package is important, telephone interviews are not a good alternative. Second, telephone interviews do not permit observation of body language, facial expression, or eye contact, so the interviewer is deprived of observational judgment available in face-to-face interviews. Third, the information obtained is more limited in quantity because people do not like to answer many questions on the phone and hang up quickly. Telephone interviews are a poor choice for surveys with many open-ended questions. They also have great potential for fake interviewees. An additional problem in countries like Pakistan is that most women respondents hesitate to be interviewed on the phone.
Computer-Assisted Interviewing (CAPI and CATI) Computers can assist interviewers in both personal and telephone interviews. Computer Assisted Personal Interview (CAPI) and Computer Assisted Telephone Interview (CATI) are being used in marketing research in advanced countries, but these are in the development stage in developing countries.
The Internet is also being used in marketing research. E-mail interviews or surveys are not uncommon. E-mail addresses are obtained, and questions are e-mailed to these addresses. Respondents type answers to close-ended questions at designated places and click on "reply" to send them back.
Mailed Questionnaire Another type of data collection is the mail interview, usually through mailed questionnaires or mail panels. In a typical mailed interview, questionnaires are sent to respondents by mail. The questionnaire is accompanied by a return envelope and a cover letter. Prior to that, respondents had been identified through an appropriate sampling method, and a mailing list was developed. The cover letter appeals to the respondent in an effective manner to return the questionnaire in the enclosed return envelope with postage stamps affixed by the researcher.
Mail surveys have advantages and disadvantages. Advantages include very low cost per respondent and convenience — respondents can fill out the questionnaire at their convenience. The main disadvantage is a very low response rate. People are more willing to participate in a survey for a worthy reason or incentive.
Mail Panel A variation of the mailed interview is the mail panel. A mail panel consists of a large sample of households who have agreed to participate in mailed questionnaires, product tests, or telephone surveys periodically. They either volunteer to do so or are provided with some incentive. Data from panels is updated periodically. The panel is pre-screened to ensure that panel members represent the target market or consumer of interest.
⭐ Key Takeaways
The most critical points from this lecture are the distinction between cross-sectional and longitudinal research designs, where cross-sectional provides a single snapshot and longitudinal tracks changes over time using a fixed panel. Focus groups, whether traditional or online, serve exploratory purposes but have limitations in representativeness and moderation. Within descriptive research, survey methods dominate and include personal interviews (in-home, mall intercept, and computer-assisted), telephone interviews, and mailed questionnaires — each with distinct trade-offs in cost, speed, data quality, and response rate. The key advantages of surveys — standardization, ease of administration, ability to uncover unseen data, and suitability for statistical analysis — make them the most widely used method. Finally, the presence of interviewer bias in personal interviews and low response rates in mailed questionnaires are critical limitations to remember for exam scenarios.
🧠 Quick Revision Questions
- What is the fundamental difference between cross-sectional and longitudinal research designs in terms of sampling?
- What are the four main advantages of survey methods mentioned in the lecture?
- What are the three categories of personal interviews, and what are the key disadvantages of personal interviews overall?
- What are the two types of panels used in longitudinal research, and how do they differ?
- Why is mail intercept interviewing popular despite its representativeness issues?
📘 Lecture 7 — Mailed Questionnaire
📖 Overview: This lecture covers mail-based survey methods and observation techniques in marketing research. It explains the design and administration of mailed questionnaires and mail panels, then provides a detailed comparison of all survey methods. The second half introduces observation methods including their classifications, types, advantages, and limitations—critical for collecting unbiased behavioral data.
🗂️ Topics Covered
The lecture covers mailed questionnaires and mail panels as data collection methods, followed by a comprehensive comparison table of personal interview, mall intercept, telephone interview, mail survey, and mail panels across factors like volume of data, speed, response rate, flexibility, accuracy, sensitivity, bias potential, time, expense, and sample control. It then introduces observation methods, explaining structured vs. unstructured, participant vs. non-participant, undisguised vs. disguised, and natural vs. contrived observation. Additional methods include human observation, mechanical observation, trace analysis, content analysis, and retail/wholesale audit, concluding with advantages and limitations of observation.
📝 Lecture Summary
Mailed Questionnaire
Another type of data collection is the mail interview, usually through mailed questionnaires or mail panels. In a typical mailed interview, questionnaires are sent to respondents by mail, accompanied by a return envelope and a cover letter. Prior to that, respondents are identified through appropriate sampling and a mailing list is developed. The cover letter appeals to the respondent to return the questionnaire in the accompanied return envelope with postage stamps affixed by the researcher.
The mail surveys have some advantages and disadvantages. Advantages include very low cost per respondent and convenience for the respondent to fill out the questionnaire at their convenience. The main disadvantage is a very low response rate. People are more willing to participate in a survey for a worthy reason or incentive.
Mail Panel
A variation of mailed interview is the mail panel. A mail panel consists of a large sample of households who have agreed to participate in mailed questionnaires and product tests or telephone surveys periodically. They either volunteer or are provided some incentive. Data from panels is updated periodically. The panel is prescreened to ensure that panel members represent the target market or consumer of interest.
Comparison of Survey Methods
The above mentioned survey methods are evaluated on different factors in the following table.
A Comparison of Different Survey Methods
| Factor | Personal interview | Mall intercept | Telephone interview | Mail survey | Mail panels |
|---|---|---|---|---|---|
| Volume of data | more | more | less | less | less |
| Speed | moderate | moderate/high | high | low | low |
| Response rate | high | high | moderate | low | moderate |
| Flexibility of data collection | high | high | moderate | low | low |
| Accuracy of data | very good | very good | good | very good | very good |
| Obtaining sensitive information | low | low | high | high | moderate/high |
| Possibility of interview bias | high | high | moderate | nil | nil |
| Time consumed | high | moderate | moderate | moderate | moderate |
| Expense | high | moderate | moderate | low | low/moderate |
| Sample control | high | moderate | moderate | low | moderate/high |
Observation Methods
Another method of data collection in descriptive research is observation, which records the behavior pattern of people, objects, or events in a systematic manner. Observation is limited to providing information about current behavior. There is no question or communication of observer with the people being observed. Observation can be structured and unstructured, disguised and undisguised, or natural vs. contrived.
💡 Why this matters: Observation captures actual behavior, not reported behavior, eliminating recall errors and response bias common in surveys.
Structured vs. Unstructured
In structured observation, the researchers determine in advance what behaviors are to be observed and recorded. The researcher prepares a checklist of these behaviors and ignores all others. Structured observation is useful in conclusive research. In unstructured observation, the researcher observes all the episodes under study and records whatever they find interesting and relevant. No details of what will be observed are set in advance. Observer's bias in unstructured observation is potentially high, and this type is more suitable for exploratory research.
Participant vs. Non-Participant Observation
Participant observation is a method in which the observer or researcher participates in the process being observed. For example, they can be a customer, a worker, or a trainee. In non-participant observation, the observer is just an observer.
Undisguised and Disguised Observation
When the subjects are informed that they are being observed for some purpose, such observation is known as undisguised observation. When the subjects are unaware that they are being observed, this observation is called disguised observation. Sometimes the observer disguises the observation process by using one-way mirrors or hidden cameras.
Natural versus Contrived Observation
Behavior can be observed in natural or artificial settings. If the observation takes place in a natural environment, it is known as natural observation—for example, a researcher observing the behavior of respondents while eating at McDonald's. It is called contrived observation when the respondent is brought into an artificial setting and observed. Tests done by varying shelf space, product flavors, and display locations fall under contrived observation.
Other Methods of Observation
The methods of observation based on mode of administration are classified as below:
-
Human Observation: In this method, the observer is the researcher themselves or a person hired for this purpose. The observer merely records what they observe.
-
Mechanical Observation: In this observation, a mechanical device rather than the human eye observes the phenomenon. Such mechanical devices include people meter, audiometer, on-site-cameras, turnstiles (to count people entering or leaving a building), and scanners. Scanners are good devices to collect information about consumer purchases by product category, price, quality, brand, and store type.
-
Trace Analysis: This is the observation of some traces of the event that has passed. Data collection is based on physical evidence or traces of past behavior. It is also known as unobtrusive method. Examples include:
- Erosion of tile in a building
- The magazines that were donated to charity showing the popularity of magazines
- Wear and tear of pages in a journal showing its readership
- Age and condition of the car in the parking lot to determine the affluence of customers
- Number of empties of Coke or Pepsi to determine the consumption of Coke or Pepsi
-
Content Analysis: It is the observation as well as analysis of various content of communication which is manifest. In marketing research context, applications of content analysis involve observation and analysis of the message of advertisement, radio and television programs, newspaper articles, and the like. In international marketing, content analysis has successfully been used in studying foreign cultures and cross-culture ads.
-
Retail and Wholesale Audit: In this method of observation, the researcher checks physical records or performs inventory analysis. This method is discussed in detail in the section on syndicated services.
Advantages and Limitations of Observation
Observation can be used to supplement and complement other research techniques to check on results obtained by others. Ideally, the subjects of observational research should not be aware that they are being observed, so they react in a natural manner. This provides the researcher insight into actual, not reported behavior. Subjects are not asked about something—they are observed, so there is no chance for recall error. Data obtained through observation is up-to-date and correct if interpreted correctly.
In some cases, observation may be the only choice to obtain correct information. For example, children who cannot express their opinion about a new toy can be observed while playing or not playing with the new toy. Observation methods can successfully collect marketing intelligence in retail marketing, and employee behavior through "mystery shoppers"—trained observers who pose as customers in competitors' stores.
Observation has limitations too. Due to small samples and subjective interpretation, results are usually considered tentative. A big limitation is that beliefs and internal conditions of the subjects cannot be observed—you cannot tell what is going beneath the surface behavior. Observation methods are successful when such feelings are unimportant for the research.
Another problem is that observation is sometimes time-consuming and expensive, with potential for observer's bias. It is suggested that observation should not be used alone but in combination with other survey methods. It is estimated that not more than only one percent of marketing research projects rely solely on observational methods for obtaining primary data.
⭐ Key Takeaways
The mailed questionnaire method offers low cost and respondent convenience but suffers from very low response rates, making mail panels a useful variation with prescreened households. The comparison table shows that personal interviews and mall intercepts have high response rates and flexibility but also high bias potential and expense, while mail surveys have nil bias and low expense but low response rates and sample control. Observation methods are essential for capturing actual behavior without recall error or response bias, with classifications including structured/unstructured, disguised/undisguised, natural/contrived, and human/mechanical/trace/content/audit approaches. The major limitation of observation is its inability to capture internal beliefs and feelings, and it should rarely be used alone—only about 1% of projects rely solely on observation.
🧠 Quick Revision Questions
- What is the main disadvantage of mailed questionnaires, and how does a mail panel attempt to address this?
- According to the comparison table, which survey method has the highest speed and which has the highest response rate?
- What is the key difference between structured and unstructured observation, and which type of research is each best suited for?
- Give two examples of mechanical observation devices and two examples of trace analysis.
- Why is observation considered to provide "actual, not reported behavior," and what is its biggest limitation?
📘 Lecture 08 — Casual Research
📖 Overview: This lecture introduces causal research and the conditions required to establish causality between variables. It defines key experimental concepts like independent, dependent, and extraneous variables, details the components of experimental design, and explains the critical threats to internal and external validity. Understanding these concepts is essential for designing valid experiments in marketing research.
🗂️ Topics Covered
The lecture begins with the definition and three necessary conditions for causality: concomitant variation, time order, and absence of other causal factors. It then defines key experimental concepts including independent and dependent variables, test units, extraneous variables, and experiments. The lecture explains experimental design and introduces standard symbols. It covers the distinction between internal and external validity, enumerates seven specific threats to internal validity (history, maturation, testing effects, instrumentation, statistical regression, selection bias, and mortality), and concludes with four methods for controlling extraneous variables: randomization, matching, statistical control, and design control.
📝 Lecture Summary
Casual Research
Causality is defined as when the occurrence of X increases the probability of the occurrence of Y. Before making causal inferences, three conditions must be satisfied: concomitant variation, time order of occurrence of variables, and elimination of other possible causal factors.
🔑 Definition — Concomitant Variation: the extent to which a cause (X) and an effect (Y) occur together or vary together in the way predicted by the hypothesis under consideration.
🔑 Definition — Time Order of Occurrence of Variables: the causing event must occur either before or simultaneously with the effect; it cannot occur afterwards.
🔑 Definition — Absence of Other Possible Causal Factors: the factor or variable being investigated should be the only possible causal explanation.
Definitions and Concepts
The lecture defines basic experimental concepts:
- Independent Variables: variables or alternatives that are manipulated (i.e., the levels are changed by the researcher) and whose effects are measured and compared. Also known as treatments, they may include price levels, package design, and advertising themes.
- Test Units: individuals, organizations, or other entities whose response to the independent variables or treatments is being examined. Test units may include consumers, stores, or geographic areas.
- Dependent Variables: variables that measure the effect of the independent variables on the test units. These may include sales, profits, and market shares.
- Extraneous Variables: all variables other than the independent variables that affect the response of the test units. These variables can confound the dependent variable measures, weakening or invalidating the results of the experiment. Examples include store size, store location, and competitive effort.
- Experiment: formed when the researcher manipulates one or more independent variables and measures their effect on one or more dependent variables, while controlling for the effect of extraneous variables.
Experimental Design
An experimental design is a set of procedures specifying:
- The test unit and how these units are to be divided into homogenous subsamples
- What independent variables or treatments are to be manipulated
- What dependent variables are to be measured
- How the extraneous variables are to be controlled
Definition of Symbols
A set of symbols is defined to facilitate discussion of extraneous variables and specific experimental designs:
- X = the exposure of a group to an independent variable, treatment, or event the effects of which are to be determined
- O = the process of observation or measurement of the dependent variable on the test units or group of units
- R = the random assignment of test units or groups to separate treatment
Additional conventions:
- Movement from left to right indicates movement through time
- Horizontal alignment of symbols implies all those symbols refer to one specific group, treatment, or control
- Vertical alignment of symbols implies all those symbols refer to activities or events that occur simultaneously
📌 Example: The symbol arrangement X O₁ O₂ means that a given group of test units was exposed to the treatment variable (X) and the response was measured at two different points in time (O₁ and O₂).
Validity in Experimentation
When conducting an experiment, a researcher has two goals:
- Draw valid conclusions about the effects of independent variables on the study group
- Make valid generalizations to a larger population of interest
Internal validity concerns the first goal, while external validity concerns the second.
🔑 Definition — Internal Validity: refers to whether the manipulation of the independent variables or treatments actually caused the observed effects on the dependent variables. Control of extraneous variables is a necessary condition for establishing internal validity.
🔑 Definition — External Validity: refers to whether the cause and effect relationships found in the experiment can be generalized. It is desirable to have an experimental design that has both internal and external validity, but in applied marketing research often we have to trade one type of validity for another.
💡 Why this matters: Understanding the trade-off between internal and external validity is crucial for designing experiments that are both rigorous and applicable to real-world marketing decisions.
Threats to Internal Validity
Following are seven threats to internal validity in the form of extraneous variables:
- History (H): refers to specific events that are external to the experiment but occur at the same time as the experiment. These events may affect the dependent variable. For example, if general economic conditions decline during the experiment and the local area is particularly hard hit by layoffs and plant closings. The longer the time interval between observations, the greater the possibility that history will confound an experiment.
- Maturation (MA): refers to changes in the test units themselves that occur with the passage of time, involving people. Maturation takes place as people become older, more experienced, tired, bored, or uninterested. Stores change over time in terms of physical layout, décor, traffic, and composition.
- Testing Effects: caused by the process of experimentation. The main testing effect (MT) occurs when a prior observation affects a latter observation.
- Instrumentation (I): refers to changes in the measuring instruments that are modified during the course. Instrumentation effects are likely when interviewers make pre- and post-treatment measurements. The effectiveness of interviewers can be different at different times.
- Statistical Regression (SR): effects occur when test units with extreme scores move closer to the average score during the course of the experiment. People with extreme attitudes have more room for change, so variation is more likely.
- Selection Bias (SB): refers to the improper assignment of test units to treatment conditions. If test units self-select their own groups or are assigned to groups on the basis of the researcher's judgment, selection bias is possible. For example, in a merchandising experiment where two different displays (old and new) are assigned to different department stores, the stores may not be equivalent and may vary with respect to store size, which is likely to affect sales regardless of which display was assigned.
- Mortality (MO): refers to the loss of test units while the experiment is in progress. This happens for many reasons, such as test units refusing to continue in the experiment. Mortality confounds results because it is difficult to determine if the lost test units would respond in the same manner to treatment as those that remain.
Controlling Extraneous Variables
Extraneous variables confound the results and are also called confounding variables. There are four ways of controlling extraneous variables:
- Randomization: refers to the random assignment of test units to experimental groups by using random numbers. Treatment conditions are also randomly assigned to experimental groups. Randomization may not be effective when the sample size is small.
- Matching: involves comparing test units on a set of key background variables before assigning them to the treatment conditions.
- Statistical Control: involves measuring the extraneous variables and adjusting for their effects through statistical analysis (ANCOVA).
- Design Control: involves the use of experiments designed to control specific extraneous variables.
⭐ Key Takeaways
To establish causality, three conditions must be simultaneously met: concomitant variation, correct time order (cause before effect), and the elimination of other possible causal factors. A valid experiment requires the researcher to manipulate independent variables while controlling for extraneous variables that threaten internal validity. The seven major threats to internal validity are history, maturation, testing effects, instrumentation, statistical regression, selection bias, and mortality. Extraneous variables can be controlled through four methods: randomization, matching, statistical control (ANCOVA), and design control. There is often a necessary trade-off between internal validity (accuracy of causal conclusions within the experiment) and external validity (generalizability to the larger population).
🧠 Quick Revision Questions
- What are the three necessary conditions for establishing causality in marketing research?
- Differentiate between independent variables, dependent variables, and extraneous variables in an experiment.
- Explain the threat of "selection bias" to internal validity and provide an example.
- How does "statistical regression" threaten the internal validity of an experiment?
- Name and briefly describe the four methods for controlling extraneous variables in an experimental design.
📘 Lecture 9 — Experimental Designs
📖 Overview: This lecture covers various experimental designs used in marketing research, including one-shot case studies, pretest-posttest control group designs, and Latin square designs. It also explains the differences between laboratory and field experiments, the limitations of experimentation, and introduces test marketing procedures. Finally, the lecture introduces fundamental concepts of measurement and scaling, including the four basic types of rating scales.
🗂️ Topics Covered
The lecture begins by describing several experimental designs: one-shot case study, static group design, pretest-posttest control group design, posttest-only control group design, randomized block design, and Latin square design. It then discusses experimental settings (laboratory vs. field experiments) and the limitations of experimentation (time, cost, administration). The topic of test marketing is covered, including standard, controlled, and simulated test markets. Finally, the lecture introduces measurement and scaling concepts, distinguishing between objective and subjective properties, and explains the four basic scales: nominal, ordinal, interval, and ratio.
📝 Lecture Summary
Experimental Designs
Various experimental designs are described below.
One-Shot Case Study
Also known as the after only design, the one-shot case study may be symbolically represented as X O₁. Here, X represents the exposure of a group to an experimental treatment, and O₁ represents the measurement of the dependent variable after the treatment. This design lacks a control group and a pretreatment measure, making it very weak for establishing causality.
Static Group Design
The static group design involves two groups: an experimental group that receives the treatment and a control group that does not. It is symbolically represented as:
- X O₁
- O₂
🔑 Definition — Treatment Effect (TE): The impact of the experimental manipulation on the dependent variable, calculated as the difference between the experimental and control group outcomes. 📐 Formula: TE = O₁ - O₂ → The treatment effect is measured by subtracting the measurement of the control group (O₂) from the measurement of the experimental group (O₁). 📌 Example: If O₁ (sales after an advertising campaign) = 100 units and O₂ (sales without the campaign) = 70 units, then TE = 100 - 70 = 30 units of sales attributed to the campaign.
Pretest-Posttest Control Group Design
In the pretest-posttest control group design, test units are randomly assigned to either the experimental or the control group, and a pretreatment measure is taken on each group. This design is symbolized as:
- R O₁ X O₂
- R O₃ O₄
Where R denotes random assignment, O₁ and O₃ are pretreatment measures, X is the treatment, and O₂ and O₄ are posttreatment measures.
🔑 Definition — Treatment Effect (TE): In this design, the treatment effect accounts for both the change in the experimental group and any change in the control group, isolating the true impact of the treatment. 📐 Formula: TE = (O₂ - O₁) - (O₄ - O₃) → The treatment effect is the difference between the change in the experimental group and the change in the control group. 📌 Example: Experimental group: O₁ = 50, O₂ = 70 (change = +20). Control group: O₃ = 55, O₄ = 60 (change = +5). TE = (70-50) - (60-55) = 20 - 5 = 15. This design controls for most extraneous variables. Selection bias is eliminated by randomization.
Posttest-Only Control Group Design
This design is similar to the pretest-posttest control group design but does not include a pretreatment measure. Test units are randomly assigned to experimental or control groups, and only a posttreatment measure is taken. Randomization is assumed to ensure the groups are equivalent before the treatment.
Randomized Block Design
A randomized block design is useful when there is only one major external variable, such as sales, store size, or income of the respondent, that might influence the dependent variable. This design groups test units into blocks based on the external variable, then randomly assigns treatments within each block to control for that variable's effect.
Latin Square Design
A Latin square design allows the researcher to statistically control two non-interacting external variables as well as to manipulate the independent variable. It ensures that each level of the independent variable appears exactly once in each row and column, balancing the effects of the two external variables.
An example of Latin square design:
| Store patronage \ Interest in the store | High | Medium | Low |
|---|---|---|---|
| High | B | A | C |
| Medium | C | B | A |
| Low and none | A | C | B |
In this example, the independent variable (e.g., a store feature) is varied across three levels (A, B, C), while store patronage and interest in the store are the two controlled external variables.
Experimental Settings
There are two types of settings in which experiments are conducted.
Laboratory Experiment
It is an artificial setting for experimentation in which the researcher constructs the desired conditions. The laboratory environment offers a high degree of control because it isolates the experiment in a carefully monitored environment.
Field Experiment
An experimental location is set in actual market conditions. Field experiments are conducted in real-world environments, offering greater external validity but less control over extraneous variables.
Limitations of Experimentation
- Time: Experiments can be time consuming.
- Cost: Experiments are often expensive.
- Administration: Experiments can be difficult to administer. It may be impossible to control for the effects of the extraneous variables, particularly in a field environment.
Test Marketing
Test marketing, also called market testing, is an application of controlled experiment, done in limited but carefully selected parts of the marketplace called test markets. It involves a replication of a planned national marketing program in the test markets. Often, the marketing mix variables (independent variables) are varied in test marketing, and the sales (dependent variable) are monitored so that an appropriate national marketing strategy can be identified.
The two major objectives of test marketing are:
- To determine market acceptance of the product
- To test alternative levels of marketing mix variables.
Test marketing procedures may be classified as standard test markets, controlled and min-market tests, and simulated test marketing.
Standard Test Market
It is a test market in which the product is sold through regular distribution channels. For example, no special considerations are given to products simply because they are being test-marketed. The duration of the test depends on the repurchase cycle for the product, the probability of competitive response, cost considerations, the initial consumer response, and company philosophy. The test should last long enough for repurchase activity to be observed. If competitive reaction to the test is anticipated, the duration should be short. Recent evidence suggests that tests of new brands should run for at least 10 months.
Controlled Test Market
A test-marketing program conducted by an outside research company in field experimentation. The research company guarantees distribution of the product in retail outlets that represent a predetermined percentage of the market.
Measuring and Scaling
Measurement in marketing research is determining how much of a property/characteristic is possessed by an object. Measurement is to determine the intensity of some characteristic of interest to the researcher.
Now what are we really measuring? We are not measuring objects but we are measuring some properties—called attributes or characteristics. Thus we do not measure buyers but their characteristics like their preferences or perceptions. Objects in marketing research are consumers, brands, stores, advertisements, etc. Properties are characteristics of an object that can be used to distinguish one object from the other.
Properties may be: a. Objective properties which are physically verifiable characteristics such as age, income, number of cans purchased, store last visited, and so on. b. Subjective properties which cannot be directly observed and are mental constructs such as perceptions, attitudes. Subjective properties are observer-able and intangible into a rating scale. There are several examples of both these properties in marketing, e.g., market potential for new product, sales of existing product, demographic and psychographic characteristics of the buyers, effectiveness of a new advertising campaign, market share, and the like.
Rating Scales
Subjective properties, e.g., attitude, beliefs, intentions, preferences, etc., are measured with the help of rating scales usually called scales. In a scale, numbers are assigned to the amount of characteristic or “construct” being measured. The number varies according to the amount of characteristic available in the object. There are four basic scales.
- Nominal scale: A nominal scale is one in which numbers serve as labels to identify or categorize objects or events. All numbers are equal with respect to characteristics of objects. Each number is assigned to only one object and each object has only one number. The number in a nominal scale does not have any relationship with the amount of characteristic. For example, a unique number is given to each player in a football team but a player having number 8 does not play better twice than a player having number 4. Although nominal scales are used for the lowest form of measurement, yet nominal scales are frequently used in marketing research. Nominal level identifications are needed in marketing research to identify brands, store types, sales territories, customers, gender, geographic location, race, religion, buyer/non-buyer, heavy and light users, etc. The numbers assigned to such categories are mutually exclusive. Alphabets, even symbols, could be used instead of numbers in nominal scales. Nominal scales simply label objects and do not provide information on greater than or less than. Usually counting is the permissible operation in nominal scales. Thus, statistics like frequency distribution, percentages, mode, chi-square, etc., are used while analyzing data gathered by nominal scale. Average in these scales is meaningless.
⭐ Key Takeaways
The most critical concepts from this lecture are the different experimental designs and their formulas for calculating treatment effects, particularly the pretest-posttest control group design which controls for extraneous variables through randomization and pretreatment measures. Understanding the distinction between laboratory and field experiments is essential, as is recognizing the limitations of experimentation including time, cost, and administration challenges. Test marketing procedures—standard, controlled, and simulated—are key applications of controlled experiments in real market conditions. Finally, the foundation of measurement in marketing research requires distinguishing between objective and subjective properties, and understanding that nominal scales are the simplest measurement level where numbers serve only as labels without quantitative meaning.
🧠 Quick Revision Questions
- What is the formula for calculating the treatment effect (TE) in a pretest-posttest control group design?
- How does a Latin square design differ from a randomized block design in controlling external variables?
- What are the two major objectives of test marketing?
- Why is calculating an average meaningless for data collected using a nominal scale?
- What is the key difference between objective and subjective properties in marketing research measurement?
📘 Lecture 10 — Rating Scales
📖 Overview: This lecture covers the four fundamental types of rating scales used in marketing research to measure subjective properties like attitudes, beliefs, and preferences. It explains the hierarchy of measurement from nominal to ratio scales, and details comparative scaling techniques including paired comparison, rank order, and constant-sum scales, which are essential for collecting and analyzing marketing data.
🗂️ Topics Covered
This lecture introduces the four basic rating scales: nominal, ordinal, interval, and ratio scales, explaining their nature, applications in marketing research, and permissible statistical analyses. It then covers comparative scaling techniques, specifically paired comparison, rank order, and constant-sum scales, detailing their procedures, advantages, disadvantages, and practical examples for measuring preferences and attribute importance.
📝 Lecture Summary
Subjective properties e.g. attitude, beliefs, intentions, preferences etc. are measured with the help of rating scales usually called scales.
In a scale, numbers are assigned to the amount of characteristic or “construct” being measured. The number varies according to the amount of characteristic available in the object. There are four basic scales.
1. Nominal scale
A nominal scale is one in which numbers serve as labels to identify or categorize objects or events. All numbers are equal with respect to characteristics of objects. Each number is assigned to only one object and each object has only one number. The number in a nominal scale does not have any relationship with the amount of characteristic. For example, a unique number is given to each player in a football team, but a player having number 8 does not play better twice than the player having number 4.
Although nominal scales are used for the lowest form of measurement, yet nominal scales are frequently used in marketing research. Nominal level identifications are needed in marketing research to identify brands, store types, sales territories, customers, gender, geographic location, race, religion, buyer/non-buyer, heavy and light users, etc. The numbers assigned to such categories are mutually exclusive. Alphabets, even symbols, could be used instead of numbers in nominal scales. Nominal scales simply label objects and do not provide information on greater than or less than. Usually counting is the permissible operation in a nominal scale. Thus statistics like frequency distribution, percentages, mode, chi-square, etc., are used while analyzing data gathered by a nominal scale. Average in these scales is meaningless.
🔑 Definition — Nominal Scale: A scale where numbers serve as labels to identify or categorize objects without indicating any quantitative relationship.
2. Ordinal Scale
An ordinal scale defines ordered relationships among the objects measured. It indicates relative size difference between objects. An ordinal scale shows whether an object has more or less of the attribute but not as to how much less or more. It shows the relative position of the objects under measurement but not what the magnitude of the difference is. World ranking of cricket teams, finishing order of horse races, positions of students in the class, and social class are examples of ordinal scales. In marketing research, opinions, measurement of preferences, relative attitudes, and evaluation of quality of different brands of the same product etc. are through ordinal scales. In an ordinal scale, the difference of numbers indicates difference in rank and nothing else. The statistics commonly used in analyzing data gathered by an ordinal scale are percentile, median, and rank order correlation, etc.
🔑 Definition — Ordinal Scale: A scale that defines an ordered relationship among the objects measured, indicating relative size difference but not the magnitude of the difference.
3. Interval scale
One problem with the ordinal scale is that it defines the order of the objects but it does not tell about what is the difference (or distance) between the objects. An interval scale shows that as the interval between the numbers on the scale represent equal increments of the attribute being measured, the differences can be compared. A difference between 25 and 26 is the same as between 26 and 27 which is the same as between 27 and 28. The most common example of an interval scale in life is that of a thermometer. But as you know, two types of thermometers, Celsius and Fahrenheit, do not have a fixed or true zero or freezing point. Both the zeros and units of measurements are different, although the amount of heat in various intervals on each thermometer will be the same. Let us illustrate it with figures. The amount of heat between 88° and 89° on Fahrenheit is the same as between 91°-92°, but the amount of heat between 88° and 89° on Fahrenheit is different from the amount of heat between 88° and 89° on Celsius. Statistical techniques that are used in nominal and ordinal scales can also be used in interval scales. In addition to that, statistics like mean, standard deviation, product moment correlation, etc., can also be used in interval scales.
🔑 Definition — Interval Scale: A scale where the intervals between numbers represent equal increments of the attribute being measured, allowing for the comparison of differences.
4. Ratio scale
A ratio scale is one in which a true zero exists. True zero or absolute zero means that the number zero is assigned to the absence of the characteristic being measured. Thus we can compute the ratio of scale values. For example, it is possible to say how many times greater or smaller one object is than another. This is the only type of scale that allows making comparison of absolute quantities. We can say that the market share of company A is twice as much as that of company B. In market research, data on the number of customers, costs, sales, market share, and some other marketing variables are measured on ratio scales. All statistical techniques can be applied to analyze ratio scale data.
🔑 Definition — Ratio Scale: A scale with a true absolute zero point, allowing for the computation of ratios and comparison of absolute quantities.
📐 Summary of the Four Basic Rating Scales:
| Scale Type | Nature | Application in Marketing Research |
|---|---|---|
| Nominal | Identification, labeling of objects | Classification by gender, location, social class; identification of stores, brands, etc. |
| Ordinal | Ordered relations according to more or less of the attribute | Ranking, preferences, merit list, positions in tournament |
| Interval | Interval between adjacent ranks are equal | Attitude measurement, index numbers, temperature |
| Ratio | Absolute zero exists; comparisons possible | Sales, income, age, units produced, costs, market share |
The scales used in marketing research can be divided into two types: Comparative and Non-comparative scales. In the first type, direct comparison of objects can be made with one another. Data in comparative scales have ordinal or rank order properties. Each object in non-comparative scaling is scaled independently of others in the set. The data in such scales is usually interval or ratio scaled. Likert scale, semantic differential or staple scales are the classification of itemized non-comparative scales.
Comparative scales
First type of comparative scaling is paired comparison scale.
Paired Comparison Scale
A paired comparative scale is a technique in which a respondent is presented with two objects at a time in the pair and asked to select one according to some criterion. It is like an ordinal scale in which two objects are ranked.
Example: Please indicate which one you like for your use among ten pairs of shampoo brands (A, B, C, D, E). The results can be compiled in a matrix where a '1' means the column brand is preferred over the row brand, and a '0' means the row brand is preferred over the column brand.
| A | B | C | D | E | |
|---|---|---|---|---|---|
| A | - | 1 | 1 | 0 | 0 |
| B | 0 | - | 0 | 0 | 0 |
| C | 0 | 1 | - | 0 | 0 |
| D | 1 | 1 | 1 | - | 1 |
| E | 1 | 1 | 1 | 0 | - |
| Sum | 2 | 4 | 3 | 0 | 1 |
In the above table, we see that figure 1 in the box means that the column brand is preferred to the corresponding brand in the row, and a zero in the box means that the brand in the row is preferred to the corresponding column. Data in this matrix can be analyzed by finding out percentages of preferences. In this case, brand A is preferred e.g., A is preferred by 2/10*100=20%, B=40%, C=30%, D=0% and E=10%. Thus you can find out the rank order of the five brands.
Paired comparison should be used if the number of brands is limited. In case the number of brands is large, then the exercise becomes unmanageable. Due to this difficulty, respondents cannot usually meaningfully rank more than five or six brands. Another problem with this technique is that the comparison of two objects at a time is seldom the way choices are really made in the marketplace. Thus a brand can be a first choice in a paired comparison situation but performs poorly in the actual marketplace. Paired comparison, however, is the most common method of testing taste.
📌 Example: For five brands (A, B, C, D, E) with paired comparison preference counts: A=2, B=4, C=3, D=0, E=1. Preference percentages are A=20%, B=40%, C=30%, D=0%, E=10%, leading to a rank order of B (1st), C (2nd), A (3rd), E (4th), D (5th).
Rank Order Scale
This scale is also comparative in nature. It involves asking the respondents to rank various brands/objects with regard to some criterion. For example, a respondent may be asked to rank five print ads on the basis of awareness it provides, liking of the respondent, or intention to buy.
Example: Please rank the following brands of fruit juices in order of preference from 1 to 7. Rate your most preferred brand as 1 and least preferred as 7; no two brands will receive the same rating.
- Brand A: 2
- Brand B: 6
- Brand C: 4
- Brand D: 1
- Brand E: 7
- Brand F: 5
- Brand G: 3
This technique is frequently used in marketing research. Advantages of rank-order scaling include that it is a simple concept, easy to administer, and less time-consuming to administer than other comparative scales such as paired comparison. The instructions for ranking objects are easy to comprehend. It is also said that the ranking made by the respondent is closer to his/her real purchase situation. The major disadvantage of a rank-order scale is that it produces only ordinal data. It does not mean that the first preference in the set is the most liked. It may be “least disliked” in the set.
💡 Why this matters: Rank-order scales are practical for getting a quick relative preference order but are limited to ordinal data, meaning one cannot determine the intensity of preference between ranks.
Constant-Sum Scale
In a constant-sum scale, respondents are required to allocate a fixed number of rating points (usually 100) among several objects. It is widely used to measure the relative importance of various attributes of the object.
Example: Please divide 100 points among the following characteristics of a toothpaste that reflects the relative importance of each characteristic to you.
- Taste: 8
- Fragrance: 7
- Tube: 5
- Cleanliness of teeth: 35
- Prevention of tooth decay: 25
- Price: 2
- Quality: 8
- Shining of the teeth: 10 Total: 100
The relative importance of the attributes is determined by counting the points assigned by all respondents and dividing by the number of respondents.
The main merit of the constant-sum scale is that it permits fine distinction of attributes of an object without much time. However, it may be difficult to allocate points to several categories. The main disadvantage of this scale is that respondents may allocate points that exceed or are short of the required total, say 103 or 97 instead of 100.
🔑 Definition — Constant-Sum Scale: A comparative scale where respondents allocate a fixed number of points (typically 100) among several objects to indicate their relative importance or preference.
⭐ Key Takeaways
The four basic rating scales—nominal, ordinal, interval, and ratio—form a hierarchy of measurement, each with specific properties, applications, and permissible statistics. Nominal scales merely label objects, ordinal scales rank them without measuring distance, interval scales have equal intervals but no true zero, and ratio scales possess a true zero allowing for absolute comparisons. For comparative scaling, the paired comparison scale is best for a limited number of items, the rank order scale is simple and efficient for obtaining ordinal preferences, and the constant-sum scale provides fine-grained measurement of attribute importance. It is critical to choose the appropriate scale for the research objective and to understand its limitations, such as the inability to measure magnitude in ordinal scales or the potential for respondent error in constant-sum scales.
🧠 Quick Revision Questions
- What is the key difference between an ordinal scale and an interval scale in terms of what they measure?
- In a paired comparison scale with 6 brands, how many total pairs would a respondent need to evaluate?
- What is the primary advantage of a ratio scale that is not available in any of the other three basic scales?
- What is a major potential problem when respondents use a constant-sum scale?
- Why might a brand that is a top choice in a paired comparison test perform poorly in an actual marketplace?
📘 Lecture 11 — Non-Comparative Scales
📖 Overview: This lecture introduces non-comparative (monadic) rating scales, where objects are evaluated independently. It covers two main types: continuous rating scales and itemized rating scales (Likert, Semantic Differential, and Staple scales). The lecture also explains critical decisions researchers must make when developing rating scales, such as the number of categories, odd/even options, and forced vs. unforced choices.
🗂️ Topics Covered
This lecture covers non-comparative scales, beginning with continuous rating scales (also called graphic scales) and itemized rating scales, specifically Likert, Semantic Differential, and Staple scales. It then explains the development of rating scales, including decisions on number of categories, odd or even numbers, balanced vs. unbalanced scales, forced vs. unforced scales, and degree of verbal description.
📝 Lecture Summary
Non-Comparative Scale
In non-comparative scales, objects are scaled independently of other objects in the set. For this reason, non-comparative scales are also called monadic scales. Non-comparative scales are of two kinds: continuous rating scales and itemized rating scales.
Continuous Rating Scales
A continuous rating scale requires the respondents to indicate their position by rating the object on a continuum that runs from one extreme of criterion to the other. The format of this scale varies. Such a scale is also called a graphic scale. See the following example:
How would you rate Airline A.? Version A: bad okay Good Very good Excellent Version B: Worst 0 10 20 30 40 50 60 70 80 90 100 Best
Graphic rating scales are easy to construct but answers may be unreliable and analysis complicated. However, use of computers has made the analysis easy and that has increased the use of continuous rating scales in marketing research.
Itemized Rating Scales
An itemized rating scale contains numbers or brief descriptions or both in respect of the categories of response. Respondents select the categories that best describe their rating about the object in question. Itemized rating scales are Likert, Semantic Differential, and Staple scales.
Likert Scale
This scale is named after Rensis Likert who developed this scale. The Likert scale requires a respondent to show a degree of agreement or disagreement with a variety of statements about the related object. Respondents indicate how much they agree or disagree with the statement. This scale captures the integrity of the respondents' feelings.
Example: Instructions: Listed below are some statements about Jeans Y. Please indicate your degree of agreement or disagreement by encircling the appropriate answer.
| Statement | Strongly Agree | Somewhat Agree | Neutral | Somewhat Disagree | Strongly Disagree |
|---|---|---|---|---|---|
| a. Jeans Y are easy to identify on someone | 1 | 2 | 3 | 4 | 5 |
| b. Jeans Y make me feel good | 1 | 2 | 3 | 4 | 5 |
| c. Jeans Y are good looking | 1 | 2 | 3 | 4 | 5 |
| d. Jeans Y are reasonably priced | 1 | 2 | 3 | 4 | 5 |
| e. Jeans Y will be my next pair of Jeans | 1 | 2 | 3 | 4 | 5 |
The score of each item by all the respondents in the Likert Scale are summed up and the average is drawn. Due to this reason, the Likert scale is also known as a summated scale.
🔑 Definition — Likert Scale: A scale that requires a respondent to show a degree of agreement or disagreement with a variety of statements about the related object. It is also called a summated scale. 📌 Example: A respondent selects "1" (Strongly Agree) for "Jeans Y are easy to identify on someone." 💡 Why this matters: Because Likert scales capture the intensity of feelings, they are widely used in attitude research.
Semantic Differential Scale
This scale has been borrowed from another area of research called "semantics". This scale contains a series of bipolar adjectives from the various characteristics of the object under study. Respondents indicate the impression of each characteristic by indicating the appropriate place on the continuum. It is usually a seven-point rating scale having two poles (adjectives), e.g., "friendly-unfriendly," "high quality-low quality," "convenient-inconvenient," or "dependable-undependable." Having seven separators between two poles is mandatory. While using the semantic differential scale, the respondent marks the blank that is closer to his rating.
Example: Please indicate your impression about Restaurant A by marking the line that best describes your opinion. Quick service ------- slow service High prices-------- low prices Good quality food ------- low quality food Limited variety of food ------- wide variety of food Poor location ------- good location
The Semantic Differential Scale is gaining popularity because of its versatility. This scale is used extensively in comparing different brands, company images, or stores. Mean is the statistic which is used in Semantic Differential Scales.
🔑 Definition — Semantic Differential Scale: A scale containing a series of bipolar adjectives from the various characteristics of the object under study, usually a seven-point rating scale. 📌 Example: "Quick service ------- slow service" for Restaurant A.
Staple Scales
Jan Staple developed this scale, and therefore this scale is called Staple scales. Typically, a Staple scale has ten categories of measurement ranging from -5 to +5 and usually shown vertically. Categories may be reduced if the researcher chooses to. Respondents select a category and mark the selected number to indicate their rating. The higher the positive score, the better the adjective describes the object. The Staple scale uses one pole rather than opposite poles. It is easier to construct and administer. It is equally suited to telephone interviewing.
Example: Please rate Bank A with regard to their "fast service" and "friendly environment" on the following scale.
Friendly environment Fast service +5 +5 +4 +4 +3 +3 +2 +2 +1 +1 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5
🔑 Definition — Staple Scale: A scale developed by Jan Staple, typically having ten categories ranging from -5 to +5, shown vertically, using one pole rather than opposite poles. 📌 Example: Rating Bank A on "fast service" with +4 or "friendly environment" with +2.
Development of Rating Scales
Rating scales take different forms as you have seen above. While using a rating scale in research, the researcher has to choose among several alternatives. The researcher must make decisions regarding the scales on these aspects: a. How many categories in the scale? b. Should the number of categories be odd or even? c. Should the scale be balanced or unbalanced? d. Should the choices be forced or unforced? e. Degree of verbal description. f. The final form (physical) of the scale.
1. How Many Categories in the Scale
There is no ideal number of categories in a scale. They could be as many as 13 or as few as 3. Many categories provide for finer discrimination by the respondents, but sometimes it is very difficult for the respondents to handle many categories. They really cannot discriminate. If the respondents are quite knowledgeable, a large number of categories can be used; otherwise, a small number may be employed. In telephonic interviews, a smaller number is appropriate. If you have limited space on the paper, use a small number of categories. For marketing research, five to seven categories are commonly used in rating scales.
2. Odd or Even
If you should provide a neutral point in the rating scale, then use an odd number. But if you think there will be no neutral respondent or you want to force the respondents to give some answer, then use an even number.
3. Balanced or Unbalanced Scale
A rating scale is balanced when it has an equal number of favorable and unfavorable responses. See the following scales:
Unbalanced Scale: Balanced Scale: The taste of drink A is. The taste of drink A is. Extremely delicious Extremely delicious Very delicious Very delicious Delicious Delicious Poor Delicious to some extent Very poor Poor Extremely poor Very poor
Usually, the rating scales are balanced. Balanced scales provide more objective data.
4. Forced Scales versus Non-Forced Scales
Forced scales force the respondents to express an opinion as no provision is made for "no opinion." But if the researcher thinks that many respondents will have no opinion on the issue, the scale contains a category of "no opinion." Such a scale is called a non-forced scale.
5. Degree of Verbal Description in a Scale
The description of scale categories may be numerical, verbal, and even pictorial. The researcher has a choice to label all or sometimes only categories on the extremes are verbally labeled. However, some people think that confusion in the scale can be reduced by labeling all scale categories.
⭐ Key Takeaways
The most critical things to remember from this lecture are the three types of itemized rating scales: Likert (summated scale measuring agreement/disagreement), Semantic Differential (bipolar adjectives on a seven-point scale, using mean as the statistic), and Staple (single-pole scale from -5 to +5, suited for telephone interviews). For scale development, researchers must decide on the number of categories (typically 5-7 for marketing research), whether to use odd (provides neutral point) or even numbers (forces a choice), balanced (equal favorable/unfavorable) or unbalanced scales, and forced (no "no opinion" option) or non-forced scales. Continuous rating scales, also called graphic scales, use a continuum from one extreme to another but may be unreliable and complicated to analyze.
🧠 Quick Revision Questions
- What is the fundamental difference between comparative and non-comparative (monadic) scales?
- Name the three types of itemized rating scales discussed in this lecture.
- What is the typical number of categories in a Semantic Differential scale, and what statistic is used for analysis?
- If a researcher wants to avoid neutral responses from participants, should they use an odd or even number of categories in the scale?
- What distinguishes a forced scale from a non-forced scale?
📘 Lecture 12 — Physical Form of Scale
📖 Overview: This lecture explores the physical configurations and verbal descriptors used in rating scales, then delves into the critical concepts of measurement accuracy. It explains the components of measurement error and introduces the foundational research principles of validity and reliability, essential for ensuring that marketing research instruments produce trustworthy and actionable data.
🗂️ Topics Covered
The lecture begins by detailing the various physical forms scales can take, including horizontal/vertical layouts and face scales for children, along with common verbal descriptors for different constructs like frequency and satisfaction. It then introduces the concept of measurement error (systematic vs. random) and the equation linking observed, true, and error scores. Finally, the core concepts of validity (face/content, predictive, convergent, discriminant) and reliability (test-retest, alternative forms, split-half) are defined, explained with examples, and their interrelationship is discussed.
📝 Lecture Summary
Physical Form of Scale
A scale can have different physical forms. A researcher can exercise different options including horizontal, vertical, boxes, lines, or a number assigned on a continuum. Positive or negative values may be used. For children, different shapes of faces (happy or otherwise) can indicate the choice of respondents.
An example of a physical configuration is: Very powerful - Powerful - Somewhat powerful - Neither weak nor powerful - Somewhat weak - Weak - Very weak
Similarly, verbal descriptors in the scale may change with the nature of the construct being measured. Common descriptors include:
- Frequency of purchase: never, casually, sometimes, often, most often
- Attitude: Very negative, Negative, Neither negative nor positive, Positive, Very positive
- Consumer satisfaction: Highly dissatisfied, Not satisfied, Neutral, Satisfied, Quite satisfied
- Intention to purchase: Will not buy at all, Inclined not to buy, Might or might not buy, Probably will buy, Will buy definitely
Accuracy of Measurement
When we measure through scales or otherwise, a measured value is not the true value of the characteristic; rather, it is the value we observed. This difference is called measurement error. Measurement error may be caused by many potential sources:
- Personal factors (fatigue, mood, health)
- Situational factors (noise, pressure, distracters)
- Respondent factors (intelligence, education)
- Variation in interview method (telephonic, face-to-face, mailed)
- Instrument factors (ambiguity, lack of clarity)
- Data analysis factors (coding and tabulation errors)
There are two components of total measurement error: systematic error and random error.
- Systematic error causes a constant bias in measurement. For example, a stopwatch that systematically runs fast will produce the same type and amount of error each time.
- Random error is not constant. For example, using many different stopwatches to record time will produce errors that fall within a range around the true time.
Thus, observed score is comprised of true score plus systematic error plus random error: 🔑 Definition — Observed Score: Oₘ = Tₘ + Sₑ + Rₑ Where:
- Oₘ = observed measurement
- Tₘ = true measurement
- Sₑ = systematic error
- Rₑ = random error
Validity
A measure has validity if it measures what it is supposed to measure. The differences in observed scores reflect true differences among objects or individuals on the measured characteristic. Validity is the accuracy of measurement—the extent to which measurement is free from both systematic and random error.
Face or Content Validity
Face or content validity is concerned with the degree to which the measurement “looks like” it measures what it is supposed to measure. It is a judgment by the researcher. For example, if a respondent recognizes an advertisement, it can usually be accepted at face value as if they had been exposed to the ad in the past. This is the weakest method of assessing validity but can be improved by having other researchers critique the instrument.
Predictive Validity
If a measure can predict some future event, the instrument has predictive validity. For example, a measure of brand preference or buying intention is valid if it can be shown that those with strong preference or intention actually bought the brands. Predictive validity is very important for decision making.
Convergent Validity
If a researcher uses two different methods or sources of data collection for the same information and both agree, the measure has convergent validity. In a survey, 214 questionnaires were left with household heads in the morning and collected in the evening, yielding an average age of 17.2 years. Then, 40 questionnaires were picked at random, and another household member was asked ages via telephone; the average was 17.1 years. The close agreement shows convergent validity.
Discriminant Validity
In discriminant validity, questions that measure different objects should yield different results. If a researcher knows there are real differences, they should find that responses actually differ. If two questions measure concern about theft security and fire security, but there are no differences between the two constructs, there is doubt about the instrument's validity.
Reliability
Reliability is the consistency of the instrument. If the measurement of the same group is made repeatedly by the same scale, the results should be consistent. Systematic error does not affect reliability; random error does. Therefore, reliability is the extent to which an instrument is free from random error. If Rₑ = 0, reliability is highest. The association between measurements obtained when the scale is administered at different times determines reliability. There are three assessment methods:
1. Test-Retest Reliability
Test-retest involves repeated measurement of the same respondents using the same scale under similar conditions. Results from both times are compared. If discrepancy is great, random error is great and reliability is low. If scores are similar, random error is small and reliability is high. Similarity is determined via correlation—a high correlation coefficient indicates high reliability.
⚠️ Problems with Test-Retest:
- It can be illogical or impossible to measure the same subjects twice (e.g., mall intercept).
- The time interval between test and retest influences reliability (longer interval = lower reliability).
- First measurement may change the second response (respondents may remember answers).
- Respondent attitude may change (e.g., thinking about high-fat milk could change health attitudes).
- Situational factors may change between measurements.
💡 Why this matters: Test-retest reliability is best used in combination with other approaches.
2. Alternative Forms Reliability
Two equivalent alternative forms of the scale/instrument are constructed and administered to the same group at two different times. Scales are equivalent but not identical. Time interval is 2-4 weeks. Degree of similarity is determined by correlation. ⚠️ Problems: Time-consuming and expensive (must develop an alternative form), and difficult to make both instruments equivalent in content.
3. Split Half Reliability
Split-half reliability is the simplest measure of internal consistency. It involves preparing a multi-item scale, dividing it into two halves, and correlating the item responses of these two halves. A high correlation shows high internal consistency and high reliability. This is a version of the alternative-forms technique used to indicate items measure the same characteristic. ⚠️ Problem: Results depend on how items are split (e.g., odd/even vs. random division).
⭐ Key Takeaways
The accuracy of any measurement is determined by its freedom from both systematic and random error, where observed scores are the sum of true scores and both error types. Validity, which ensures a measure captures the intended construct, is assessed through face, predictive, convergent, and discriminant validity. Reliability, the consistency of a measure and its freedom from random error, is evaluated using test-retest, alternative forms, and split-half methods, each with specific trade-offs regarding time, cost, and practical application.
🧠 Quick Revision Questions
- What is the difference between systematic error and random error, and how does each affect validity and reliability?
- What is the formula for observed measurement, and what does each component represent?
- Explain the difference between convergent validity and discriminant validity, providing an example for each.
- What are three methods for assessing reliability, and what is a key limitation of each?
- Why is test-retest reliability considered problematic for measuring attitudes that might change over time?
📘 Lecture 13 — Sampling
📖 Overview: This lecture introduces the concept of sampling as a fundamental tool in marketing research. It explains when to use a sample versus a census, details the systematic sampling process, and covers the crucial steps of defining the target population and determining sample size. Understanding these concepts is essential for designing efficient and accurate marketing studies.
🗂️ Topics Covered
The lecture begins by defining population, census, and sample, and compares the conditions favoring the use of each. It then outlines the six-step sampling process, starting with reviewing research objectives and defining the target population in terms of elements, sampling unit, time, and extent. The process continues with identifying the sampling frame, determining sample size through various practical approaches, and selecting the sample.
📝 Lecture Summary
Sampling
Marketing research relies heavily on sampling, the process of selecting a portion of the population to represent the whole. Surveying the entire population (a census) is often impractical due to budget and time constraints.
🔑 Definition — Population: All the elements which have the characteristics that we want to measure through the process of research; the entire group of study for the research at hand.
🔑 Definition — Census: A complete counting of the population, allowing direct measurement of its parameters.
🔑 Definition — Sample: A portion of the population that represents it; a representative subset selected for study. The sample unit is the basic level of investigation.
What should be used: Census or Sample
The choice depends on several factors. A census is feasible when: the population size is small; the research budget is plenty; the variance in the characteristic being measured is large; measurement is non-destructive; the study is not a secret; and the cost of sampling error is high. Conversely, a sample is appropriate when: the population size is large; available money is small; available time is short; sampling error cost is low; the measurement process is destructive; and variation in the characteristic is low. Sampling is more common in marketing research, offering benefits such as saving money and time, potentially greater accuracy (due to less non-sampling error), and being better when testing destroys the elements.
💡 Why this matters: Understanding these conditions helps a researcher make a critical, practical decision that directly impacts the study's cost, speed, and validity.
Sampling Process
The sampling process consists of a series of sequential steps:
- Look at the research objective
- Define the population for study (elements, sampling unit, time, extent)
- Identify the sampling frame
- Determine sample size
- Select a sampling procedure
- Actually select the sample
1. Look at the Research Objectives
The research objectives, which include information needs, research questions, hypotheses, and boundaries, provide the foundation for every subsequent step, including defining the population and selecting the sampling technique.
2. Define the Population for Study
This is a basic and critical step. The target population must be specified precisely to identify the group from which the sample will be drawn. A population should be defined in terms of elements, sampling unit, time, and extent.
🔑 Definition — Element: The object from which or about which the information is sought; the basis of analysis (e.g., individuals, families, companies).
🔑 Definition — Sampling Unit: An element or a unit containing the element, selected at some stage of the sampling process (e.g., an individual, or a household containing that individual).
🔑 Definition — Time: The time period under consideration (e.g., shoppers between October 01 to November 30, 2007).
🔑 Definition — Extent: The geographical boundaries for the study (e.g., Lahore city).
📌 Example I: For a survey of female health care products, the target population is defined as:
- Element: Female 20-35
- Sampling unit: Female 20-35
- Time: Shopping between October 01 to November 30, 2007
- Extent: Lahore
📌 Example II: For a population to measure the reaction of a buyer to an industrial chemical:
- Element: Chemical Engineer
- Sampling unit: Chemical Engineers of companies purchasing over Rs. 5 million of chemicals per annum
- Time: 2006
- Extent: Punjab
📌 Example III: For a population to monitor the sale of a newly launched product:
- Element: Retail outlet where our product is sold
- Sampling unit: Departmental stores, general stores, medical stores, which sell our product
- Time: September 10 to 17, 2007
- Extent: Lahore city
Determine the Sampling Frame
A sampling frame is an up-to-date, clean, master list of all sampling units from which the sample will be drawn (e.g., a class list, telephone directory, or map). A sampling frame error occurs if this listing is inaccurate or outdated. Sometimes a perfect list is unavailable, so the researcher must edit or construct one, or define the frame by access (e.g., "all shoppers who buy over Rs. 500... during first week of October").
Determine the Sample Size
Sample size refers to the number of elements of the population to be included in the study. Several qualitative and practical approaches are used:
- Resource Constraints: Limited money, time, or personnel may push for a smaller sample. However, using budget to dictate sample size is considered "backward thinking"; the sample size should determine the budget.
- Comparable Studies: The researcher can check what sample sizes were used in similar studies that achieved a desirable level of reliability and then take an average.
- What the Client Says: The client may suggest a sample size based on their own quality or cost consciousness.
- Rule of Thumb: An arbitrary but practical guideline. For example, "it should be at least 3% of the population" or "at least 100 units in a major group and at least 30 in a subgroup."
⭐ Key Takeaways
The fundamental distinction between a census (studying the entire population) and a sample (studying a representative subset) is crucial, with samples being far more common in marketing research due to practical constraints. The sampling process is a structured sequence starting with research objectives, which directly inform the precise definition of the target population using elements, sampling unit, time, and extent. An accurate sampling frame is essential to avoid frame error, and the sample size is determined by balancing resource constraints with practical heuristics like the "rule of thumb." The decision between sample and census depends on factors like population size, budget, and the destructive nature of measurement.
🧠 Quick Revision Questions
- What are the four components used to define a target population for a research study?
- Under what conditions is it more appropriate to conduct a census rather than a sample?
- What is a sampling frame, and what error can arise if it is inaccurate or outdated?
- Name the six sequential steps in the sampling process as described in the lecture.
- What is the "rule of thumb" for sample size when the research involves major and subgroups?
📘 Lecture 14 — Other Factors Affecting the Sample Size
📖 Overview: This lecture discusses additional factors that influence sample size determination in marketing research beyond basic considerations. It introduces important statistical terms such as parameter, statistic, confidence level, precision level, and variability, and provides a step-by-step statistical method for calculating sample size with practical examples.
🗂️ Topics Covered
The lecture begins by examining other factors affecting sample size such as population variability and precision requirements. It then introduces key statistical terms including parameter, statistic, confidence level, precision level, variability, and corresponding Z values. The lecture provides methods for determining standard deviation, outlines steps for statistical sample size determination, presents the formula n = S²Z²/e², and works through three detailed examples calculating sample size for different research scenarios.
📝 Lecture Summary
Other Factors Affecting the Sample Size
In addition to previous factors, population variability influences sample size. If the population is very heterogeneous, the sample must be divided into groups, requiring a larger sample size. Similarly, if research requires multivariate analysis, the sample size must be large. If the population is homogeneous and analysis is at the aggregate level, the sample can be small. Precision is another factor: if the decision based on research is important, data accuracy is a primary concern, calling for a larger sample to obtain data more precisely.
These concepts are used to determine sample size through the statistical method.
Some Important Statistical Terms
Parameter 🔑 Definition — Parameter: The summary measurement of the population or census.
Statistic 🔑 Definition — Statistic: The summary measurement of the sample, used to estimate the population parameter.
Confidence Level 🔑 Definition — Confidence Level: The probability with which we can say that our true value lies within a certain interval, called the confidence interval.
Precision Level 🔑 Definition — Precision Level: The allowable error between the parameter and the statistical value.
Variability 🔑 Definition — Variability: In statistics, variability is measured by variance or standard deviation. Standard deviation is the average distance of all units from the mean. In marketing research, usually 95% or 99% confidence level is used.
Corresponding 'Z' Values
- 'Z' value of 95% confidence level is 1.96
- 'Z' value of 99% confidence level is 2.58
- 'Z' value of 99.7% confidence level is 3.0
How to Determine Standard Deviation?
Standard deviation can be obtained from three sources:
- Taken from secondary data
- If you are an expert researcher, you can estimate the standard deviation
- Take a sample of 30 and measure its actual standard deviation
Steps for Determining the Sample Size Statistically
- Define precision level (e.g., ±1, ±2, etc.) — this varies from research to research according to objectives
- Define confidence level (e.g., 90%, 95%, etc.)
- Determine corresponding Z value for the confidence level
- Determine standard deviation
Symbols used:
- e = Precision level (error ±)
- s = Standard deviation (σ)
- z = Confidence level
- n = Sample size
📐 Formula: n = s²z² / e²
Plain-English meaning: The required sample size equals the square of the standard deviation multiplied by the square of the Z value, divided by the square of the allowable error.
After using this formula, the answer may be in fraction form and should be rounded up.
Examples for Determining Sample Size
Example I 📌 Example: We want to obtain the mean age of a magazine subscriber at 99% confidence level. We want our result to be ±2 of the true mean age. Suppose standard deviation is 5. What should be the sample size?
Solution:
- e = ±2
- s = 5
- z = 2.58
- n = s²z² / e²
- n = (5)² × (2.58)² / (2)²
- n = 25 × 6.6564 / 4
- n = 41.6 or n = 42
💡 Why this matters: Even with a relatively small standard deviation and modest precision, a 99% confidence level requires a larger sample size than lower confidence levels.
Example II 📌 Example: A dairy company wants to determine the average consumption of milk per household that should be within ±1.5 liters of the actual consumption. Past trend indicates that average variation in milk consumption per household is 4.5 liters. What should be the sample size if 95% confidence level is required?
Solution:
- e = ±1.5
- s = 4.5
- z = 1.96
- n = s²z² / e²
- n = (4.5)² × (1.96)² / (1.5)²
- n = 20.25 × 3.8416 / 2.25
- n = 34.5 or n = 35
Note: If we know the value of 'n' and are missing any one among precision level, standard deviation, or 'z' value, then the unknown value can also be determined by using the same formula: n = s²z² / e²
Example III 📌 Example: A researcher wants to find the monthly amount spent on lunch in restaurants. The researcher wants to be 95% confident that the results are within ± Rs. 100. What will be the sample size if the standard deviation is estimated to be Rs. 400?
Solution:
- e = ±100
- s = 400
- z = 1.96
- n = s²z² / e²
- n = (400)² × (1.96)² / (100)²
- n = 160,000 × 3.8416 / 10,000
- n = 61.44 or n = 62
This shows that the researcher should take 62 people as sample in order to estimate the average income spent on lunch by professionals.
Key Relationships:
- When we increase the precision level, error decreases and sample size increases (and vice versa)
- When we increase the standard deviation, sample size increases
- When we increase the confidence level, sample size increases
⭐ Key Takeaways
Sample size determination depends on population variability and required precision, especially for important decisions. The formula n = s²z²/e² is the core statistical method, where 's' is standard deviation, 'z' is the Z value corresponding to the chosen confidence level (1.96 for 95%, 2.58 for 99%), and 'e' is the allowable precision error. Increasing precision, standard deviation, or confidence level all lead to larger required sample sizes. Standard deviation can be obtained from secondary data, expert estimation, or a pilot sample of 30. When calculating sample size, fractional results should be rounded up to the next whole number.
🧠 Quick Revision Questions
- What are the three ways to determine standard deviation for sample size calculation?
- If a researcher wants to decrease the error from ±2 to ±1 while keeping everything else constant, what happens to the required sample size?
- Why is a sample size of 42 needed in Example I instead of just 41?
- What does it mean when we say "at 95% confidence level" in terms of the Z value and probability?
- If you know the sample size (n) but are missing the precision level (e), how can you find the missing value?
📘 Lecture 15 — Sampling Techniques
📖 Overview: This lecture introduces the two major categories of sampling techniques in marketing research: non-probability and probability sampling. It explains the definitions, procedures, advantages, and limitations of each technique, helping researchers understand when and how to select representative samples from a population.
🗂️ Topics Covered
The lecture covers the broad classification of sampling techniques into non-probability and probability sampling. Non-probability techniques discussed include convenience sampling, judgmental sampling, quota sampling, and snowball sampling. Probability techniques include simple random sampling, systematic sampling, and stratified sampling.
📝 Lecture Summary
Non-Probability Sampling Techniques
Non-probability sampling relies on the personal judgment of the researcher rather than chance to select sample elements. The researcher can arbitrarily or consciously decide what elements to include. While these methods may yield good estimates of population characteristics, they do not allow for objective evaluation of the precision of sample results, and the estimates obtained are not statistically projectable to the population.
Convenience Sampling
Convenience sampling attempts to obtain a sample of convenient elements. The selection of sampling units is left primarily to the interviewer. Examples include use of students, church groups, and members of social organizations; mall intercept interviews without qualifying respondents; department stores using charge account lists; tear-out questionnaires in magazines; and "people on the street" interviews.
Convenience sampling is the least expensive and least time-consuming of all sampling techniques. The sampling units are accessible, easy to measure, and cooperative. In spite of these advantages, this form of sampling has serious limitations. Many potential sources of selection bias are present, including respondent self-selection. Convenience samples are not representative of any definable population.
🔑 Definition — Selection Bias: Bias that occurs when the procedure used to select the sample results in a sample that is not representative of the population.
Hence, it is not theoretically meaningful to generalize to any population from a convenience sample, and convenience samples are not appropriate for marketing research projects involving population inferences. Convenience samples are not recommended for descriptive or causal research, but they can be used in exploratory research for generating ideas, insights, or hypotheses. Convenience samples can be used for focus groups, pretesting questionnaires, or pilot studies. Nevertheless, this technique is sometimes used even in large surveys.
Judgmental Sampling
Judgmental sampling is a form of convenience sampling in which the population elements are selected based on the judgment of the researcher. The researcher, exercising judgment or expertise, chooses the elements to be included in the sample because he or she believes they are representative of the population of interest or are otherwise appropriate. Common examples include: test markets selected to determine the potential of a new product; purchase engineers selected in industrial marketing research; expert witnesses used in court; and department stores selected to test a new merchandising display system.
Judgmental sampling is low cost, convenient, and quick, yet it does not allow direct generalizations to a specific population. Judgmental sampling is subjective, and its value depends entirely on the researcher's judgment, expertise, and creativity. It may be useful if broad population inferences are not required.
Quota Sampling
Quota sampling may be viewed as two-stage restricted judgmental sampling. The first stage consists of developing control categories, or quotas, of population elements. The relevant control characteristics, which may include sex, age, and race, are identified on the basis of judgment. In other words, the quotas ensure that the composition of the sample is the same as the composition of the population with respect to the characteristics of interest. In the second stage, sample elements are selected based on convenience or judgment.
Snowball Sampling
In snowball sampling, an initial group of respondents is selected, usually at random. After being interviewed, these respondents are asked to identify others who belong to the target population of interest. Subsequent respondents are selected based on the referrals. This process may be carried out in waves by obtaining referrals from referrals, thus leading to a snowballing effect. A major objective of snowball sampling is to estimate characteristics that are rare in the population. Snowball sampling is used in industrial buyer-seller research to identify buyer-seller pairs. The major advantage of snowball sampling is that it substantially increases the likelihood of locating the desired characteristic in the population.
Probability Sampling Techniques
In probability sampling, sampling units are selected by chance. Every potential sample need not have the same probability of selection, but it is possible to specify the probability of selecting any particular sample of a given size.
Simple Random Sampling
In Simple Random Sampling (SRS), each element in the population has a known and equal probability of selection. Every element is selected independently of every other element. The sample is drawn by a random procedure from a sampling frame. This method is equivalent to a lottery system in which names are placed in a container, the container is shaken, and the names of the winners are then drawn out in an unbiased manner.
🔑 Definition — Sampling Frame: A list of all the elements in the population from which the sample is drawn.
The researcher first compiles a sampling frame in which each element is assigned a unique identification number. Then random numbers are generated to determine which elements to include in the sample.
📐 Formula: Sampling interval (i) = Population size (N) / Sample size (n) → This determines how often to select elements in systematic sampling.
SRS has many desirable features. It is easily understood. The sample results may be projected to the target population. SRS suffers from at least four significant limitations:
- It is often difficult to construct a sampling frame.
- SRS can result in samples that are very large or spread over large geographic areas, increasing time and cost of data collection.
- SRS often results in lower precision with larger standard errors than other probability sampling techniques.
- SRS may or may not result in a representative sample. Although samples drawn will represent the population well on average, a given simple random sample may grossly misrepresent the target population.
For these reasons, SRS is not widely used in marketing research.
Systematic Sampling
In systematic sampling, the sample is chosen by selecting a random starting point and then picking every i-th element in succession from the sampling frame. The sampling interval, i, is determined by dividing the population size N by the sample size n and rounding to the nearest integer.
Systematic sampling is less costly and easier than SRS, because random selection is done only once. Moreover, the random numbers do not have to be matched with individual elements as in SRS. Systematic sampling is often employed in consumer mail, telephone, mall intercept, and internet interviews.
Stratified Sampling
Stratified Sampling is a two-step process in which the population is partitioned into sub-populations, or strata. The strata should be mutually exclusive and collectively exhaustive in that every population element should be assigned to one and only one stratum and no population elements should be omitted. Next, elements are selected from each stratum by a random procedure, usually SRS.
Stratified sampling differs from quota sampling in that the sample elements are selected probabilistically rather than based on convenience or judgment. A major objective of stratified sampling is to increase precision without increasing cost.
🔑 Definition — Strata: Sub-populations within a larger population that are partitioned for sampling purposes.
The elements within a stratum should be as homogeneous as possible, but the elements in different strata should be as heterogeneous as possible. Variables commonly used for stratification include demographic characteristics, type of customer (credit card versus non-credit card), size of firm, or type of industry.
Stratified sampling can be proportionate or disproportionate.
💡 Why this matters: Stratified sampling is one of the most efficient probability techniques. By ensuring that all important subgroups are represented, it can provide more precise estimates than simple random sampling for the same sample size.
⭐ Key Takeaways
The most critical distinction in sampling is between non-probability and probability techniques. Non-probability sampling relies on researcher judgment, is faster and cheaper, but does not allow for statistical projection to the population. Probability sampling uses chance selection, permits objective evaluation of precision, and allows for population inference. Key techniques include convenience (easiest but least representative), judgmental (expert-based but subjective), quota (two-stage restricted judgmental), and snowball (for rare populations) for non-probability, and SRS (equal probability but difficult to implement), systematic (sampling interval), and stratified (partitioning into homogeneous subgroups for increased precision) for probability. Stratified sampling is often preferred for precision, while systematic sampling is more practical than SRS.
🧠 Quick Revision Questions
- What is the fundamental difference between non-probability and probability sampling?
- What are the main limitations of convenience sampling, and when can it be appropriately used?
- How does quota sampling differ from stratified sampling?
- What is a sampling frame, and why is it essential for Simple Random Sampling?
- What is the major objective of stratified sampling, and what property should elements within a stratum exhibit?
📘 Lecture 16 — Stratified Sampling
📖 Overview: This lecture covers advanced probability sampling techniques, focusing on stratified and cluster sampling methods. It explains how these techniques differ in objectives, implementation, and when each is appropriate for marketing research, while also comparing various probability and non-probability sampling methods.
🗂️ Topics Covered
The lecture explains stratified sampling (both proportionate and disproportionate), cluster sampling and area sampling, other techniques like sequential and double sampling, a comparison table of all sampling methods, mall intercept sampling challenges, and sampling errors including sampling frame errors.
📝 Lecture Summary
Stratified Sampling
Stratified Sampling is a two-step process where the population is partitioned into sub-populations called strata. Strata must be mutually exclusive and collectively exhaustive, meaning every population element belongs to exactly one stratum and no elements are omitted. Elements are then selected from each stratum using a random procedure, usually Simple Random Sampling (SRS). This differs from quota sampling because elements are selected probabilistically, not by convenience or judgment. A major objective of stratified sampling is to increase precision without increasing cost.
🔑 Definition — Strata: Sub-populations within a population that are mutually exclusive and collectively exhaustive, created to improve sampling precision.
Elements within a stratum should be as homogeneous as possible, while elements in different strata should be as heterogeneous as possible. Common stratification variables include demographic characteristics, type of customer (credit card vs. non-credit card), firm size, or industry type. Stratified sampling can be either proportionate or disproportionate.
Proportionate Stratified Sampling
In proportionate stratified sampling, the sample size from each stratum is proportional to that stratum's size in the population.
📌 Example: Population sizes: A=450, B=350, C=100, D=250, E=50 (Total=1200). Sample sizes: A=90, B=70, C=20, D=50, E=10 (Total=240). Each sample size is exactly 20% of its stratum population (e.g., 90/450 = 20%).
Disproportionate Sampling
In disproportionate sampling, the sample size is not proportional to the population size of each stratum.
📌 Example: Population sizes: A=450, B=350, C=100, D=250, E=50 (Total=1200). Sample sizes: A=70, B=60, C=30, D=50, E=30 (Total=240). Here, stratum C (population 100) gets 30 instead of 20, while stratum A (population 450) gets 70 instead of 90.
💡 Why this matters: Disproportionate sampling is useful when certain strata have small populations but are critically important, or when some strata have greater variability and need larger samples.
Cluster Sampling
In cluster sampling, the target population is first divided into mutually exclusive and collectively exhaustive subpopulations called clusters. The key distinction from stratified sampling is that in cluster sampling, only a sample of clusters is chosen for further sampling, whereas in stratified sampling, all strata are selected.
The objectives differ: cluster sampling aims to increase sampling efficiency by decreasing costs, while stratified sampling aims to increase precision. Elements within a cluster should be as heterogeneous as possible, but clusters themselves should be as homogeneous as possible — the opposite of stratified sampling.
A common form is area sampling, where clusters consist of geographic areas like counties, housing tracts, or blocks. In one-stage area sampling, all households in selected blocks are included.
Advantages of cluster sampling: feasibility and low cost. Often, only cluster-level sampling frames are available, not element-level frames. It is the most cost-effective probability sampling technique.
Limitations: Cluster sampling produces relatively imprecise samples, and it is difficult to form heterogeneous clusters because households in a block tend to be similar.
Other Probability Sampling Techniques
Sequential Sampling: Population elements are sampled sequentially, with data collection and analysis at each stage. A decision is made whether to continue sampling. The sample size is not known in advance, but a decision rule is stated before sampling begins, indicating when enough information has been obtained.
Double Sampling (also called two-phase sampling): Certain population elements are sampled twice.
Comparison of Various Sampling Techniques
Probability Sampling Strengths and Weaknesses:
| Method | Strengths | Weaknesses |
|---|---|---|
| Simple Random Sampling | Projectable results, easy to understand | Hard to construct sampling frame, expensive, low precision, representativeness uncertain with high variability |
| Systematic Sampling | Can work without sampling frame, easier implementation | Representativeness can decrease |
| Stratified Sampling | More precision, handles all subpopulations' variability | Stratification variables hard to identify, difficult with many variables, more expensive |
| Cluster Sampling | Economical in cost and time | Lacks precision, difficult computation and interpretation |
Non-Probability Sampling Strengths and Weaknesses:
| Method | Strengths | Weaknesses |
|---|---|---|
| Convenience Sampling | Economical, less time-consuming, convenient | Researcher bias, lack of representativeness, not recommended for conclusive research |
| Judgmental Sampling | Low cost, convenient, least time-consuming | Subjective results, very tentative generalization |
| Quota Sampling | Sample controllable for certain characteristics | Selection bias, lack of representativeness |
| Snowball Sampling | Easy identification of relevant units | Very time-consuming |
Mall Intercept Sampling
Mall intercept sampling (shopping center sampling) presents unique difficulties. Bias may be introduced by three factors:
-
Selection of shopping center: A shopping center reflects the local area's family type (e.g., low vs. high income). Using several centers in different areas improves representativeness. If possible, select cities with diversity.
-
Selection of location within the shopping center: The part of the mall (beginning, center, or end) affects representativeness. All locations should be used in rotation. Different parking lot entrances matter. If the interviewing facility is far, refusals may increase due to time constraints.
-
Part of the day (time) selection: Different people shop at different times — women on weekdays, working people in evenings, families on weekends, working people at lunch hour. Evenings are usually peak hours. Samples should be taken at different hours.
Sampling Errors
Sampling error is the difference between the sample value (statistic) and the true underlying population value (parameter) . It occurs due to sample size and sampling technique. Some methods can minimize sampling error.
A sampling frame error is the degree to which the sampling frame (or list) fails to account for the population. For example, Yellow Pages and telephone directories often contain sufficient sampling frame errors because they are not up-to-date — some numbers are redundant while others are not listed.
🔑 Definition — Sampling Error: The difference between the sample statistic and the true population parameter, caused by sample size and sampling technique. 🔑 Definition — Sampling Frame Error: The degree to which the sampling frame fails to accurately represent the target population.
⭐ Key Takeaways
Stratified sampling increases precision by creating homogeneous strata and sampling all of them, while cluster sampling reduces costs by sampling only some clusters with heterogeneous elements within them. Proportionate stratified sampling matches population proportions, while disproportionate sampling allows different strata weights. Mall intercept sampling requires careful consideration of center selection, location within center, and time of day to minimize bias. Sampling error is the difference between sample and population values, while sampling frame error occurs when the list used does not accurately represent the population. Understanding the trade-off between cost, precision, and representativeness is critical for choosing the appropriate sampling technique.
🧠 Quick Revision Questions
- What is the key difference in objectives between stratified sampling and cluster sampling?
- In stratified sampling, should elements within a stratum be homogeneous or heterogeneous?
- Give an example of a variable commonly used for stratification in marketing research.
- Why is mall intercept sampling prone to bias, and what three factors must be carefully considered?
- What is the difference between sampling error and sampling frame error?
📘 Lecture 17 — Development of Questionnaire
📖 Overview: This lecture focuses on the systematic process of developing questionnaires and observation forms for marketing research. It explains how to design questions that gather accurate, consistent data while motivating respondents to participate, covering everything from question content to overcoming respondent limitations.
🗂️ Topics Covered
The lecture covers the definition and objectives of questionnaires, the questionnaire design process starting with specifying information needed, determining the type of interviewing method, individual question content including necessity and double-barreled questions, overcoming inability to answer (informedness, memory, articulation), and overcoming unwillingness to answer (effort, context, legitimacy, sensitivity) with techniques to increase respondent willingness.
📝 Lecture Summary
Questionnaire and Observation Forms
Survey and observations are the two basic methods for obtaining quantitative primary data in descriptive research. Both require a procedure for standardizing the data collection process so that data are internally consistent and can be analyzed uniformly. If 40 different interviewers conduct personal interviews or make observations in different parts of the country, the data they collect will not be comparable unless they follow specific guidelines and ask questions and record answers in a standard way. A standardized questionnaire or form will ensure comparability of the data, increase speed and accuracy of recording, and facilitates data processing.
Questionnaire Definition
A questionnaire, whether called a schedule, interview form, or measuring instrument, is a formalized set of questions for obtaining information from respondents.
Objectives of a Questionnaire
Any questionnaire has three specific objectives:
- First, it must translate the information needed into a set of specific questions that the respondents can and will answer.
- Second, a questionnaire must uplift, motivate, and encourage the respondent to become involved in the interview, to cooperate, and to complete the interview. A well designed questionnaire can motivate the respondents and increase the response rate.
- Third, a questionnaire should minimize response error, defined as the error that arises when respondents give inaccurate answers or their answers are miss-recorded or miss-analyzed. A questionnaire can be a major source of response error.
Questionnaire Design Process
The lecture presents a flow diagram of the questionnaire design process with the following steps:
- Specify the Information Needed
- Specify the Type of Questioning Method
- Design the Questions
- Determine Structure of the Question
- Determine the Question Wording
- Identify Layout of the Questionnaire
- Determine the Sequence of Questions
- Produce the Questionnaire Form
- Do Pre-testing
Specify the Information Needed
The first step in questionnaire design is to specify the information needed, which is also the first step in the research design process. It is helpful to review components of the problem and the approach, particularly the research questions, hypotheses, and the information needed. It is also important to have a clear idea of the target population. The characteristics of the respondents group have a great influence on questionnaire design. Questions that are appropriate for college students may not be appropriate for housewives. Understanding is related to respondent socioeconomic characteristics. The more diversified the respondent group, the more difficult it is to design a single questionnaire that is appropriate for the entire group.
Type of Interviewing Method
An appreciation of how the type of interviewing method influences questionnaire design can be obtained by considering how the questionnaire is administered under each method. In personal interviews, respondents see the questionnaire and interact face to face with the interviewer, so lengthy, complex, and varied questions can be asked. In telephone interviews, the respondents interact with the interviewer but do not see the questionnaire, which limits questions to short and simple ones. Mail questionnaires are self-administered, so the questions must be simple and detailed instructions must be provided.
Individual Question Content
Is the Question Necessary?
Every question in a questionnaire should contribute to the information needed or serve some specific purpose. If there is no satisfactory use for the data resulting from a question, that question should be eliminated. It is useful to ask some neutral questions at the beginning of the questionnaire to establish involvement and rapport, particularly when the topic is sensitive or controversial. Sometimes filler questions are asked to disguise the purpose or sponsorship of the project. Rather than limiting the questions to the brand of interest, questions about competing brands may also be included to disguise the sponsorship.
Are Several Questions Needed Instead of One?
A double-barreled question combines two or more questions into one and is incorrect. For example: "Do you think Cola A is a tasty and refreshing soft drink?" is incorrect because it asks about taste and refreshment together. To obtain the required information, two distinct questions should be asked:
- "Do you think Cola A is a tasty soft drink?"
- "Do you think Cola A is a refreshing soft drink?" (Correct)
Overcoming Inability to Answer
Researchers should not assume that respondents can provide accurate or reasonable answers to all questions.
Is the Respondent Informed?
A husband may not be informed about monthly expenses for groceries and department store purchases if it is the wife who makes these purchases, or vice versa. Research has shown that respondents will often answer questions even though they are uninformed. In situations where not all respondents are likely to be informed, filter questions that measure familiarity, product use, and past experience should be asked before questions about the topic themselves. Filter questions enable the researcher to filter out the respondents who are not adequately informed.
Can the Respondent Remember?
Many things that we might expect everyone to know are remembered by only a few. Examples of questions that exceed memory ability include:
- "What is the brand name of the trouser you were wearing three weeks ago?"
- "What did you have for dinner two weeks ago?"
- "How many liters of soft drinks did you consume during the last three weeks?"
These questions are incorrect as they exceed the ability of respondents to remember. Evidence indicates that consumers are particularly poor at remembering quantities of products consumed. Soft drink consumption may be better obtained by asking frequency questions with categories:
- Less than once a week
- One to three times per week
- Four to six times per week
- Seven or more times per week
Can the Respondent Articulate?
Respondents may be unable to articulate certain types of responses, for example, the atmosphere of a department store. If respondents are unable to articulate their responses to a question, they are likely to ignore that question and may refuse to respond to the rest of the questionnaire. Respondents should be given aids such as pictures, maps, and descriptions to help them articulate their responses.
Overcoming Unwillingness to Answer
If respondents are able to answer a particular question, they may be unwilling to do so because too much effort is required, the context may not seem appropriate for disclosure, no legitimate purpose or need for the information is apparent, or the information requested is sensitive.
Effort Required of the Respondents
The researcher should minimize the effort required of the respondents. Suppose the researcher is interested in determining from which departments in a store the respondent purchased merchandise on the most recent shopping trip. Asking respondents to list all departments (open-ended) is incorrect. A better approach is to provide a checklist where respondents can check all departments, such as:
- Women’s shoes
- Men’s apparel
- Children’s apparel
- Cosmetics
- Jewelry
- Other (please specify)
The second option is preferable because it requires less effort from respondents.
Context
Some questions may seem appropriate in some contexts but not in others. For example, questions about personal hygiene habits may be appropriate when asked in a survey sponsored by the Pakistan Medical Association, but not in one sponsored by a fast food restaurant. Respondents are unwilling to respond to questions they consider inappropriate for the given context.
Legitimate Purpose
Respondents are also unwilling to divulge information that they do not see as serving a legitimate purpose. For example: "Why should a firm marketing cereals want to know their age, income, and occupation?" A statement such as, "To determine how the consumption of cereal and preferences of cereal brands vary among people of different ages, incomes, and occupations, we need information on..." can make the request for information seem legitimate.
Sensitive Information
Respondents are unwilling to disclose, at least accurately, sensitive information because this may cause embarrassment or threaten the respondent's prestige or self-image. Sensitive topics include money, family life, political and religious beliefs, and involvement in accidents or crimes.
Increasing the Willingness of Respondents
Two techniques to increase willingness:
- Place sensitive topics at the end of the questionnaire. By then, initial mistrust has been overcome, rapport has been created, legitimacy of the project has been established, and respondents are more willing to give information.
- Preface the question with a counter biasing statement — a statement that the behavior of interest is common. For example, before requesting information on credit card debt, say, "Recent studies show that most Pakistanis are in debt."
⭐ Key Takeaways
Questionnaire design is a systematic process that begins with specifying the information needed and understanding the target population. The three key objectives of any questionnaire are translating information needs into answerable questions, motivating respondent participation, and minimizing response error. Researchers must design questions that overcome both inability to answer (through filter questions, memory aids, and articulation support) and unwillingness to answer (by reducing effort, ensuring context-appropriateness, establishing legitimate purpose, and handling sensitive topics carefully). The interviewing method used (personal, telephone, or mail) directly influences question complexity and structure. Finally, counter biasing statements and placing sensitive questions at the end are proven techniques to increase respondent willingness to disclose difficult information.
🧠 Quick Revision Questions
- What are the three specific objectives of any questionnaire?
- What is a double-barreled question, and why should it be avoided?
- What is a filter question, and when should it be used?
- What is a counter biasing statement, and how does it help overcome unwillingness to answer?
- How does the type of interviewing method (personal vs. telephone vs. mail) influence questionnaire design?
📘 Lecture 18 — Designing a good research questionnaire...contd
📖 Overview: This lecture continues the discussion on designing effective research questionnaires, focusing on choosing the structure of questions (unstructured vs. structured) and the critical task of wording questions properly. It provides guidelines for avoiding common pitfalls and establishing a logical sequence for questions, which are essential for collecting valid and reliable data.
🗂️ Topics Covered
The lecture first differentiates between unstructured (open-ended) and structured (multiple-choice, dichotomous, scale) questions, detailing their advantages and disadvantages. It then provides extensive guidelines for choosing question wording, including defining the issue, using ordinary and unambiguous words, and avoiding leading questions, implicit alternatives, and assumptions. Finally, it offers suggestions for sequencing questions, covering the funnel approach, placement of sensitive topics, and the order of basic, classification, and identification information.
📝 Lecture Summary
Choosing Question Structure
A question may be unstructured or structured. Unstructured questions are open-ended, allowing respondents to answer in their own words. Structured questions specify a set of response alternatives and a response format, such as multiple-choice, dichotomous, or scale.
Unstructured Questions
Unstructured questions (also called free-response or free-answer questions) allow respondents to answer in their own words, e.g., "What is your hobby?". They are good as first questions on a topic because they provide rich insights and are useful in exploratory research. A principal disadvantage is the high potential for interviewer bias. Another major disadvantage is that coding of responses is costly and time-consuming.
Structured Questions
Structured questions specify the set of response alternatives and the response format.
Multiple-choice Questions
In multiple-choice questions, the researcher provides a choice of answers, and respondents select one or more alternatives. The response alternatives should include the set of all possible choices and be mutually exclusive. Order or position bias is the tendency to check an alternative merely because of its position; each alternative should appear in each extreme position once.
✅ Advantages: Reduces interviewer bias, quick to administer, and less costly/time-consuming for coding. ❌ Disadvantages: Considerable effort to design, difficult to obtain information on alternatives not listed, and potential for order bias.
Dichotomous Questions
A dichotomous question has only two response alternatives (e.g., yes/no, agree/disagree), often supplemented by a neutral alternative like "no opinion" or "don't know". A key issue is whether to include the neutral alternative.
📌 Example: "Do you intend to buy a new house within the next three months?" with options "Yes," "No," and "Don't know."
🔑 Guideline: If a substantial proportion of respondents can be expected to be neutral, include a neutral alternative. If the proportion is expected to be small, avoid it.
Scales
This topic was discussed in detail in previous chapters (8 and 9).
Choosing Question Wording
Deciding on question wording is the most critical and difficult task in developing a questionnaire. The following guidelines help avoid problems.
Define the Issue
A question should clearly define the issue being addressed. For example, "Which brand of soap do you use?" is incorrect because it is vague. A better wording is, "Which brand or brands of soap have you personally used during the last month? In case of more than one brand, please list all the brands that apply."
Use Ordinary Words
Ordinary words matching the vocabulary level of the respondents should be used. Technical jargon should be avoided. For example, "Do you think the distribution of soft drinks is adequate?" is incorrect. A better wording is, "Do you think soft drinks are readily available when you want to buy them?"
Use Unambiguous Words
Words like "usually," "normally," "frequently," and "often" can have different meanings. Specific options should be used. For example, instead of "Never," "Occasionally," "Sometimes," "Often," and "Regularly," use specific ranges like "Less than once," "1 or 2 times," "3 or 4 times," and "More than 4 times."
Avoid Leading or Biasing Questions
A leading question clues the respondent to what answer is desired. For example, "Do you think that patriotic Pakistanis should buy imported automobiles when that would put Pakistani labor out of work?" is biased. A more neutral wording is, "Do you think that Pakistanis should buy imported automobiles?"
Avoid Implicit Alternatives
An implicit alternative is not explicitly expressed in the options. For example, "Do you like to fly when traveling short distances?" has an implicit alternative of driving. A better question is, "Do you like to fly when traveling short distances, or would you rather drive?" The first question is likely to yield a greater preference for flying.
Avoid Implicit Assumptions
Questions should not be worded so the answer depends on implicit assumptions about consequences. For example, "Are you in favor of a balanced budget?" has implicit assumptions about how it would be achieved. A better question is, "Are you in favor of a balanced budget if it would result in an increase in the personal income tax?"
Avoid Generalizations and Estimates
Questions should be specific. For example, "What is the annual per capita expenditure on cosmetics in your household?" is incorrect. Better questions are, "What is the monthly (or weekly) expenditure on cosmetics in your household?" and "How many members are there who use cosmetics in your household?" The researcher can then calculate the annual per capita expenditure.
💡 Why this matters: Poorly worded questions lead to biased, confusing, or unusable data, wasting time and resources. Precise wording is essential for obtaining accurate and reliable responses.
Sequencing the Questions
After the wording of the questions is described, their sequence should be established.
📌 Guidelines for sequencing:
- Use a simple and interesting question in the beginning to capture the respondent's interest.
- General questions should be asked first and specific questions later. Moving from general to specific is called the Funnel Approach.
- Uninteresting and hard questions should be placed late in the sequence. Embarrassing, sensitive, dull, and complex questions, including personal ones about age and income, should be placed at the end.
There are three types of information gathered with a questionnaire: Basic information (relates directly to the research problem), Identification information (name, telephone, address), and Classification information (used to classify respondents for analysis). The general order is: Basic information first, followed by classification, and finally identification information.
Logical Order: The questionnaire should flow smoothly and logically from one topic to the next. When a new topic is introduced, a transaction statement should be given. Branching questions should be designed carefully. It is advised that the research questionnaire be divided into several parts for basic information and arranged logically.
⭐ Key Takeaways
The most critical points from this lecture are: first, to master the distinction between unstructured (open-ended) and structured (multiple-choice, dichotomous) questions, knowing their respective advantages and disadvantages in terms of bias, cost, and depth of insight. Second, you must apply the rigorous guidelines for wording questions: define the issue, use ordinary and unambiguous words, and avoid leading questions, implicit alternatives, and implicit assumptions. Third, understand the proper sequencing of questions, which starts with simple, general questions and ends with difficult or sensitive ones (the "funnel approach"). Fourth, know the order of information types: basic first, then classification, then identification. Finally, remember that a well-designed questionnaire is a balance of clear structure, precise wording, and logical flow to minimize bias and maximize the quality of data collected.
🧠 Quick Revision Questions
- What is the primary advantage of an unstructured question, and what is its major disadvantage?
- What is "order bias" in multiple-choice questions, and how can it be minimized?
- When designing a dichotomous question, under what circumstance should you include a neutral response alternative like "Don't know"?
- Why is the question "Do you like to fly when traveling short distances?" considered to have an implicit alternative, and what is the correct way to reword it?
- What is the "funnel approach" in questionnaire sequencing, and what is the recommended order for basic, classification, and identification information?
Here is the summary of Lecture 19, following the exact format and rules provided.
📘 Lecture 19 — Data collection and fieldwork
📖 Overview: This lecture details the critical steps in preparing a questionnaire for field use, focusing on how to introduce it via a covering letter, why and how to pre-test it, and the final process of pre-coding. Mastering these elements ensures higher response rates, data quality, and efficient data processing, which are essential for valid research outcomes.
🗂️ Topics Covered
The lecture begins by explaining the components and purpose of a covering letter for a questionnaire, including whether to disguise the sponsor. It then details the vital process of pre-testing the questionnaire to identify and fix errors, covering the purpose and methods like protocol analysis and debriefing. Finally, it concludes with the concept of pre-coding the questionnaire to assign numerical codes for efficient data entry.
📝 Lecture Summary
Covering Letter for Questionnaire
Introducing the questionnaire is an important step, usually done via a covering letter (or opening remarks in person). This introduction must contain: the name of the sponsor or survey team, why the survey is being conducted, how the respondents were selected, a request for response, and any incentive provided.
💡 Why this matters: The covering letter is the first point of contact and significantly impacts a respondent's willingness to participate.
- Regarding the sponsor, the survey can be undisguised (researcher and sponsor identified) or disguised (sponsor concealed). Hiding the sponsor prevents competitor knowledge and prevents the sponsor's name from biasing responses.
- The purpose of the survey should be stated simply and clearly, sometimes even concealing the sponsor's name.
- Respondents must be told how they were selected (e.g., at random, judgmental, or by referral/snowballing) to address their curiosity.
- The letter must include a polite request for cooperation and participation.
- The final section may mention incentives, such as:
- Assurance of confidentiality and anonymity.
- A sample of a product.
- An offer to provide a copy of the research results.
- Monetary incentives (e.g., Rs. 100 for a complete questionnaire).
Pre-testing the Questionnaire
Before field use, a questionnaire must be pre-tested (used on a trial basis in a small pilot study) and revised to see how it performs under actual conditions. At least one pre-test and revision is vital.
The main purpose of pre-testing is to improve the questionnaire by checking for:
- Precise instructions for the respondent.
- Double-barreled questions (asking for two bits of information at once).
- Understanding wording, confusion, or double meanings.
- Leading or loading questions.
- Unfamiliar technical words or abbreviations.
- Whether the questions cover all conceivable answers.
- Adequate sequence and flow of questions.
- An appealing and motivating general appearance.
Method of Pre-testing the Questionnaire involves:
- Selecting 10-15 persons similar to the actual sample.
- Informing them of the pre-test's purpose and asking them to identify confusing elements.
- First, pre-testing via personal interview, then revising.
- Next, pre-testing the revised questionnaire in the final intended mode (mail, telephone).
- Protocol analysis: Respondents think aloud while answering; comments are recorded.
- Debriefing: After completion, respondents are told it was a pre-test and invited to comment on problems.
- Preparing dummy tables from pre-test responses to check for tabulation issues.
- Revising the questionnaire based on findings. If many changes are made, re-test with a new sample.
Pre-coding the Questionnaire
Pre-coding is the final task in questionnaire development, involving placing codes (numbers) on the questionnaire to facilitate data entry. The objective is to associate each response with a unique number or letter. Numbers are preferred as they are faster to keystroke into computers.
📐 Formula (Procedure): Assign a numeric code to each possible answer → this allows for fast and efficient data entry and computer processing.
📌 Example:
- Have you purchased Pizza A in the last fifteen days?
- Yes (1)
- No (2)
- The last time you bought Pizza A
- Was delivered to your house (1)
- You picked it yourself (2)
- Was delivered in your office (3)
- You ate the pizza at their restaurant. (4)
- What is your opinion about the taste of Pizza A?
- Excellent (1)
- Good (2)
- Satisfactory (3)
- Poor (4)
⭐ Key Takeaways
The covering letter is crucial for securing respondent cooperation and must clearly state the survey’s purpose, how the respondent was selected, provide an assurance of confidentiality, and offer an incentive. To ensure data quality, a questionnaire must be pre-tested, not just reviewed internally. Pre-testing should involve a small group of representative respondents and use methods like protocol analysis or debriefing to identify confusing questions, wording issues, and poor flow. The final step is pre-coding, where each possible answer is assigned a unique numerical value to make data entry and computer processing faster and more efficient. A poorly introduced, un-tested, or un-coded questionnaire will lead to biased data, low response rates, and logistical nightmares.
🧠 Quick Revision Questions
- What are the five essential elements that must be included in a covering letter for a questionnaire?
- Explain the difference between a "disguised" and an "undisguised" survey, and give one reason for using the disguised approach.
- What is the main purpose of pre-testing a questionnaire, and what is a "double-barreled question" that pre-testing helps identify?
- Describe the difference between "protocol analysis" and "debriefing" as methods for pre-testing a questionnaire.
- What is "pre-coding" of a questionnaire, and why are numbers preferred over letters for this process?
📘 Lecture 20 — Data Analysis: Data preparation and data cleaning
📖 Overview: This lecture focuses on the final production of the questionnaire and provides a comprehensive final checklist for questionnaire design. It emphasizes the physical appearance, structuring, and pre-testing of questionnaires to ensure high response rates and data accuracy, which are critical for effective data analysis.
🗂️ Topics Covered
The lecture covers the final production of the questionnaire, detailing physical appearance considerations like paper quality, booklet format, question numbering, and layout. It then provides a comprehensive final checklist for questionnaire design, covering information specification, question content, response format, wording, sequencing, physical characteristics, and pre-testing procedures.
📝 Lecture Summary
Final Production of Questionnaire
After pre-testing and pre-coding, the questionnaire should be produced finally. The physical appearance of the questionnaire can affect the response rate and the accuracy of the answers. The following points should be kept in mind in the final production/reproduction of the questionnaire.
- Use good quality paper. A professional appearance is crucial; if the quality is poor, the respondent may think the research is unimportant.
- If the questionnaire runs to several pages, it should be in the form of a booklet instead of stapled sheets of paper.
- Questions should be numbered serially to help control in field operation, but avoid numbers if anonymity is an issue.
- Leave reasonable space for open-ended questions; too little space will result in short answers.
- Use "go to" instructions if the respondent must skip a question or section.
- Each question should fit on one page only; do not spread a question across two pages.
- Type and font should be large enough to be read clearly.
- Use vertical instead of horizontal response columns, as it is easier to read down the column.
- Color coding may be used, including different colors for different respondent groups.
- The questionnaire should appear short, but not at the expense of overcrowding the questions.
- Instructions and directions should be clear and placed close to the questions.
Final Checklist for Questionnaire Design
This section provides a detailed checklist organized into several key areas for designing a questionnaire.
Specify what information will be sought:
- Review the research problem, information needed, research questions, and hypotheses.
- Have a clear idea of your respondents.
- Determine the type of interviewing (personal, telephonic, or mailed questionnaire).
Determine the content of questions:
- Check if the question is necessary and how many are needed.
- Avoid double-barreled questions; ensure each question addresses only one issue.
- Use filter questions if the respondent is informed.
- Use aided recall if the respondent can remember.
- Provide necessary motivation if the respondent is willing to share information.
- Avoid threatening questions.
- Consider if the request appears legitimate and the level of effort required.
- If the information is sensitive, bring sensitive topics to the end, use third person technique, and use counter biasing statements.
🔑 Definition — Double-barreled question: a question that asks about two or more issues at the same time, making it difficult for the respondent to answer accurately. 🔑 Definition — Filter question: an initial question that screens respondents to determine if they are qualified or informed enough to answer subsequent questions. 🔑 Definition — Aided recall: a technique used to help respondents remember information by providing cues or prompts. 🔑 Definition — Third person technique: a method of asking questions by referring to another person or group to reduce the respondent's discomfort with sensitive topics. 🔑 Definition — Counter biasing statement: a statement that acknowledges the sensitive nature of a question to make the respondent more comfortable and reduce bias.
Determine response Format/Structure:
- Decide on the appropriate structure: open-ended, structured, multiple choice, or dichotomous.
- Use open-ended questions in exploratory research; use structured questions whenever possible.
- In multiple choice questions, include all possible choices.
- Clearly indicate if items are to be ranked or only one item is to be selected.
- In dichotomous questions, include a neutral choice if many neutral opinions are expected.
🔑 Definition — Structured question: a question with a predetermined set of response options, such as multiple choice or dichotomous. 🔑 Definition — Dichotomous question: a question with only two response options, such as "yes" or "no."
Determine the wording of the questions:
- Use simple language and words.
- Avoid ambiguous wording like "frequently" or "often."
- Avoid leading questions and loading questions.
- Avoid implicit assumptions and implicit alternatives.
- Use positive and negative statements.
- Don't make the respondent compute a lot.
🔑 Definition — Leading question: a question that suggests or implies a particular answer, biasing the response. 🔑 Definition — Loading question: a question that is phrased to evoke a positive or negative emotional response. 🔑 Definition — Implicit assumption: an assumption that is not explicitly stated but is built into the question. 🔑 Definition — Implicit alternative: a question that presents only one option while implying there is a different one.
Determine the sequence of questions:
- Use a simple, non-threatening open-ended question at the beginning.
- Use the funnel approach: ask broad questions first, then narrow them down.
- Ask sensitive or hard questions late in the questionnaire.
- Follow chronological order when collecting historical data.
- Ask filter questions if needed.
- Complete questions about one topic before moving to the next.
- Use logical order in sequencing wherever possible.
🔑 Definition — Funnel approach: a questioning technique that starts with broad, general questions and gradually narrows to more specific ones.
Determine physical characteristics of questionnaire:
- Ensure the questionnaire has a professional appearance.
- Start with an introduction (or separate introductory letter).
- Use good quality print and paper.
- Keep the questionnaire short but not overcrowded.
- Use a booklet form for many pages.
- List the organization's name on the first page unless there is a reason to disguise it.
- Number questions and pre-code answers for easy computer processing.
- Use "go to" instructions for skipping questions.
- Number the questionnaire in serial order.
- Use vertical response columns.
- Place directions or instructions close to the questions.
Pre-test and revise the questionnaire
Pre-testing is a crucial step to identify and fix problems before the main data collection.
- Do at least one pre-test; if time permits, do two or more.
- Pre-test first by personal interview, then by the method to be used ultimately.
- Pre-test all aspects: content, wording, form, sequence, and difficulty level.
- The pre-test sample may be small (15-30) for initial testing.
- Use protocol and debriefing procedures to identify problems.
- The pre-test sample should be drawn from the same population as the ultimate sample.
- Prepare dummy tables and analyze the data.
- Make revisions if necessary.
- If more than one pre-test, each should be done on a different sample of respondents.
🔑 Definition — Protocol: a procedure where a respondent thinks aloud while completing the questionnaire, revealing any confusion or issues. 🔑 Definition — Debriefing procedure: a post-test interview where the respondent discusses their experience with the questionnaire to identify problems.
💡 Why this matters: Proper pre-testing helps catch errors in question wording, skip patterns, and overall flow, saving time and resources while improving data quality.
⭐ Key Takeaways
A student must remember that the physical appearance of a questionnaire directly impacts response rate and data accuracy, so use good quality paper, a booklet format if long, vertical response columns, and clear instructions. The final checklist covers key areas: specifying information needed, determining question content (avoiding double-barreled and threatening questions), response format, wording (using simple, unambiguous language), and question sequencing (using the funnel approach and placing sensitive questions last). Pre-coding answers and using “go to” instructions are essential for data processing ease. Finally, pre-testing the questionnaire on a small sample from the target population, using protocols and debriefing, and preparing dummy tables are critical steps to identify and fix problems before full deployment.
🧠 Quick Revision Questions
- What are five key physical appearance features of a well-produced questionnaire that can improve response rate?
- What is a double-barreled question, and why should it be avoided in questionnaire design?
- What is the funnel approach to question sequencing, and where should sensitive questions be placed?
- What is the purpose of pre-testing a questionnaire, and what two procedures can be used to identify problems during pre-testing?
- Why should vertical response columns be used instead of horizontal ones in a questionnaire?
📘 Lecture 21 — Data Analysis: Data preparation and data cleaning...contd
📖 Overview: This lecture focuses on the critical phase after data collection – data preparation and cleaning. It covers the design and use of observational forms for recording behavioral data, and delves deeply into the critical issue of non-response error in surveys. The lecture explains the sources of non-response, particularly refusals and not-at-homes, and provides a comprehensive toolkit of strategies to improve response rates and reduce bias.
🗂️ Topics Covered
The lecture begins by detailing the structure and pre-testing of observation forms for recording behaviors like customer service interactions. It then introduces the concept of non-response error and its potential to bias survey results. The core of the lecture is dedicated to methods for improving response rates, organized into two main categories: reducing refusals (through prior notification, motivation, follow-ups, incentives, and good questionnaire design) and reducing not-at-homes (primarily through callbacks).
📝 Lecture Summary
Observation Form
An observational form is simpler to design than a questionnaire because it eliminates the question-asking process and helps control non-sampling error. The researcher must be very clear about what types of observations to make and how to measure them, using a form, a recording device (e.g., video), or both.
The form specifies details using the "Five Ws and How":
- Who to be observed? (Purchaser, browser, males, couples, anyone entering the store)
- What to be observed? (Brands purchased, quantity, inquiries, influence of others)
- When to observe? (Weekdays, weekends, date, hour of purchase)
- Where to observe? (Type of store, checkout counter, specific department)
- Why to observe? (Family purchase pattern, influence of price or brand name)
- Way to observe. (Participant observer, undisguised observer, hidden camera)
Observational forms should be simple to use and should allow the observer to record behavior in detail rather than summarizing it. Like a questionnaire, an observational form must be pre-tested.
📌 Example: A portion of an observational form to evaluate bank employee service includes a checklist for "Customer Relation Skills" with items like:
- Employee noticed and greeted immediately.
- Employee speaks pleasantly and smiles.
- Employee found your name promptly.
- Employee asked you to be seated.
- Employee’s desk area was clean.
- Employee was helpful.
Each item is rated as Yes, No, or Does not apply.
Non Response Issue in Data Collection
Non-response error arises when potential respondents in the sample do not respond. This is a significant problem because if non-respondents differ from respondents on the characteristics of interest, the sample estimates will be seriously biased. While higher response rates generally imply lower non-response bias, they do not guarantee the respondents are representative of the original sample.
💡 Why this matters: A low response rate increases the probability of error, so every effort must be made to improve it.
🔑 Definition — Non-response error: The error that occurs when some potential respondents included in the sample do not respond, potentially biasing the results if they differ from those who did.
Improving the Response Rates
Improving response rates involves addressing two main sources of non-response: refusals and not-at-homes.
Refusals result from the unwillingness or inability of sampled people to participate. Strategies to reduce refusals include:
-
Prior Notification: Sending potential respondents a letter notifying them of the imminent survey. This reduces surprise and uncertainty, creating a more cooperative atmosphere.
-
Motivating the Respondents: Increasing interest and involvement.
- Foot-in-the-Door Strategy: The interviewer starts with a small request (e.g., "Will you take 5 minutes to answer 5 questions?"), to which most comply. This is followed by the large, critical request. The rationale is that initial compliance increases the chance of later compliance.
- Door-in-the-Face Strategy: The reverse strategy, starting with a large request that is expected to be refused, followed by the smaller, actual request. The lecture states that foot-in-the-door is more effective than door-in-the-face.
🔑 Definition — Foot-in-the-Door Strategy: A compliance strategy that starts with a small request to increase the likelihood of agreement with a subsequent, larger request. 📐 Formula: Small Request → (Compliance) → Critical Request 📌 Example: Asking "Will you please take five minutes to answer five questions?" and, after agreement, asking the full survey questions.
-
Follow-up: Periodically contacting non-respondents. This is very effective in mail surveys, often requiring two or three additional mailings. Follow-ups can also be done by telephone, email, or personal contact.
-
Other Facilitators: Personalization (sending letters to specific individuals) is effective.
-
Incentives: Offering monetary or non-monetary incentives.
- Prepaid Incentive: Included with the survey. Has been shown to increase response rates more than promised incentives.
- Promised Incentive: Sent only to those who complete the survey.
- Non-monetary Incentives: Premiums and rewards like pens, pencils, or offers of survey results. The amount of incentive has a positive relationship with response rate, but the cost may outweigh the value of additional information.
-
Questionnaire Design and Administration: A well-designed questionnaire and skilled administration (in telephone/personal interviews) can decrease overall refusal rates. Interviewers should not accept a "no" response without an additional plea.
Not-at-Homes: This rate can be substantially reduced by employing a series of callbacks (periodic follow-up attempts to contact non-respondents).
🔑 Definition — Not-at-Homes: The percentage of sampled individuals who are not available to participate at the time of initial contact. 📌 Example: Making a call on a weekday evening and then calling back on a weekend to reach a working person.
⭐ Key Takeaways
- Observation forms are a structured tool for recording behavior, requiring clear definition of who, what, when, where, why, and how. They must be simple, detailed, and pre-tested.
- Non-response error is a major source of bias in surveys, occurring when non-respondents differ from respondents on key variables.
- Refusals are a primary cause of non-response and can be reduced through strategies like prior notification, the foot-in-the-door technique, follow-ups, personalization, and prepaid incentives.
- Not-at-homes can be effectively minimized by employing multiple callbacks at different times.
- The goal of all these techniques is to increase the response rate, thereby decreasing the probability and magnitude of non-response bias and improving the representativeness of the sample.
🧠 Quick Revision Questions
- What are the six key elements an observation form must specify (the "Five Ws and How")?
- What is the difference between the foot-in-the-door and door-in-the-face compliance strategies for motivating respondents?
- Why is non-response error considered one of the most significant problems in survey research?
- Compare and contrast a prepaid incentive with a promised incentive. Which is generally more effective at increasing response rates?
- What is the primary method recommended for reducing the "not-at-homes" category of non-response?
📘 Lecture 22 — Descriptive and Inferential Statistics
📖 Overview: This lecture covers the structure and purpose of a research proposal, which is a written plan for a research project that serves both as a road map for the researcher and a persuasive tool for selling their services. It details the key components that must be included in a professional research proposal, from defining the problem to planning fieldwork. Understanding how to craft a comprehensive research proposal is essential for any marketing researcher seeking to secure contracts and conduct successful projects.
🗂️ Topics Covered
The lecture begins by defining a research proposal and explaining its dual purpose as a planning document and a persuasive technique. It then provides a detailed breakdown of the parts of a research proposal, starting with the research topic and executive summary, followed by the introduction, problem definition, research objectives, literature review, and research design. The final section of the proposal outline covers fieldwork, including data collection methods, personnel management, and quality control.
📝 Lecture Summary
Research Proposal
A research proposal is a written document that presents a plan for a project. Its primary purpose is to convince the client that the researcher is capable of successfully conducting the proposed research project. It serves as a planned document and a road map for the researcher. 💡 Why this matters: For professional researchers, the proposal is a key marketing tool for selling their services to clients.
Parts of a Research Proposal
- Research Topic: On the top of the proposal, write the research topic.
- Executive Summary/Overview/Abstract: A brief summary of what is given in the proposal. This is the part that busy executives will read.
- Introduction/Background: Before writing this, the researcher should meet with the manager to understand:
- What is the background to the research?
- What is the context in terms of the management problem?
- What is the environment?
- This part shows the researcher's understanding of the problem.
- Define the Problem: The researcher extracts the research problem from the introduction. The research problem is defined in one or two sentences and describes the main purpose, scope, and limits of the research.
- Research Objectives: Specific objectives or information needs must be specified clearly and concisely. These objectives should be SMART (specific, measurable, achievable, realistic, and timely).
- Literature Review: A brief review of related literature is given, referencing all books, journals, websites, and newspapers. A review of literature helps in developing:
- Theoretical framework/models
- Hypothesis
- Questionnaire
- State Research Design: This section describes the research design (descriptive, causal, or exploratory) in detail and must include:
- Nature of Data: The data is either primary or secondary.
- Sources of Data:
- Primary data sources include people, stores, brands, customers, and managers.
- Secondary data sources include books, government reports, UNO reports, ministry of agriculture/industry reports, or independent researchers, consultants, or syndicated data. They may be internal and external.
- The list of sources must be provided in the research methodology.
- Population and Sample Size:
- Population is the aggregate of all the units which have the data for the research.
- The researcher must indicate the size of the sample and the sampling techniques for selecting it.
- Instrument of Data Collection: The researcher defines which instrument will be used (questionnaire, observation form, or experimentation).
- In the case of causal research, the researcher must define the control and experimental group.
🔑 Definition — SMART: An acronym for objectives that are specific, measurable, achievable, realistic, and timely.
Field Work
This section describes fieldwork activities, including:
- How the data will be collected.
- How many people/field force will be required.
- How they will be recruited.
- How they will be trained and motivated.
- How they will be supervised.
- How the quality of research will be controlled.
- The researcher specifies the control mechanism to ensure data quality. Supervision of the field force is very important to maintain the quality of research.
⭐ Key Takeaways
A research proposal is a critical document that serves as both a planning roadmap for the researcher and a persuasive sales tool for the client. It must begin with a clear problem definition and set SMART objectives. The core of the proposal is a detailed research design that specifies the nature and sources of data, the target population, the sample size, and the data collection instrument. A comprehensive fieldwork plan is equally essential, covering everything from personnel recruitment and training to supervision and quality control. Successfully incorporating all these elements demonstrates the researcher's competence and ability to deliver a quality project.
🧠 Quick Revision Questions
- What are the two main purposes of a research proposal?
- What does the acronym SMART stand for in the context of research objectives?
- What are the two main categories for the "Nature of Data" in a research design?
- List three items that a "Sources of Data" section can include for secondary data.
- What are the key activities that must be planned for in the "Field Work" section of a proposal?