MTH302 — Final Term Summary (Lectures 23–45)

📘 Lecture 23 — Statistical Data Representation

📖 Overview: This lecture introduces the methods for organizing and presenting statistical data in understandable formats. It covers the basis for classification, types of classification, methods of presentation, and various graphic representations including pictographs, sector graphs, column/bar graphs, and line graphs.

🗂️ Topics Covered

The lecture begins with a review and overview of Module 5 on statistical data representation. It then covers the basis for classification of data (qualitative, quantitative, geographical, chronological), types of classification (one-way, two-way, three-way), methods of presentation (text, semi-tabular, tabular, graphic), and types of graphs (pictograph, sector graph, column/bar graph, line graph) with examples.

📝 Lecture Summary

STATISTICAL DATA

Information is collected by government departments, market researchers, opinion pollsters and others. This information then has to be organized and presented in a way that is easy to understand.

BASIS FOR CLASSIFICATION

There are several bases for classifying data:

1. Qualitative: Attributes such as sex, religion
2. Quantitative Characteristics: Heights, weights, incomes, etc.
3. Geographical: Regions such as provinces, divisions, etc.
4. Chronological or Temporal: By time of occurrence, also known as time series

TYPES OF CLASSIFICATION

Different types of classifications exist based on how many characteristics are considered at once:

• One-way: Classifying by one characteristic, e.g., population
• Two-way: Classifying by two characteristics at a time
• Three-way: Classifying by three characteristics at a time

METHODS OF PRESENTATION

Data can be presented using different methods:

• Text: Narrating data in words, e.g., "The majority of population of Punjab is located in rural areas."
• Semi tabular: Presenting data in rows
• Tabular: Using tables with rows and columns
• Graphic: Using charts and graphs

TYPES OF GRAPHS

Various graphic representations are available:

• Picture graph (Pictograph)
• Column Graphs
• Line Graphs
• Circle Graphs (Sector Graphs)
• Conversion Graphs
• Travel Graphs
• Histograms
• Frequency Polygon
• Cumulative Polygon or Ogive

PICTURE GRAPH or PICTOGRAPH

In a picture graph or pictograph, each value is represented by a proportional number of pictures. In the example below, one car represents 10 cars.

Example: To represent 50 cars, you would draw 5 car icons, where each icon stands for 10 cars.

SECTOR GRAPHS

Sector graphs use the division of a circle into different sectors. The full circle is 360 degrees. For each percentage, degrees are calculated and sectors plotted.

🔑 Definition — Sector Graph: A circular graph where the circle is divided into sectors proportional to the percentage of each category.

📐 Formula: Degrees for a sector = (Percentage / 100) × 360° → Plain-English meaning: To find how many degrees a category takes in the circle, multiply its percentage by 3.6.

📌 Example: If a category represents 25% of data, its sector angle = (25/100) × 360° = 90°

COLUMN AND BAR GRAPHS

The lecture presents an example showing the Proportion of households by size in the form of a Column and Bar graph. In a bar graph, rectangular bars represent data, with the length or height of each bar proportional to the value it represents.

LINE GRAPHS

Line graphs are the most commonly used graphs. A line graph plots data as points and then joins them with a line.

Example: A line graph showing the number of road accidents over the course of a year, with months on the x-axis and number of accidents on the y-axis, with data points connected by straight lines.

💡 Why this matters: Line graphs are ideal for showing trends and changes over time, making them essential for analyzing time series data in business and economics.

⭐ Key Takeaways

The most important concepts from this lecture are the different bases for classifying data (qualitative, quantitative, geographical, chronological) and the types of classification (one-way, two-way, three-way). Students must understand the methods of data presentation including textual, semi-tabular, tabular, and graphic forms. For graphs, focus on pictographs where pictures represent quantities, sector graphs that divide a circle into 360 degrees based on percentages, column/bar graphs for comparing categories, and line graphs for showing trends over time. Remember that sector graph angles are calculated by multiplying the percentage by 3.6 (360/100), and that the choice of graph depends on the type of data being presented.

🧠 Quick Revision Questions

1. What are the four main bases for classification of data mentioned in the lecture?
2. How do you calculate the angle of a sector in a sector graph if a category represents 40% of the total?
3. What is the difference between a one-way classification and a two-way classification?
4. In a pictograph where one icon represents 10 units, how many icons would you need to represent 75 units?
5. Which type of graph is most appropriate for showing changes in data over time?

📘 Lecture 24 — Statistical Representation Measures of Central Tendency Part 1

📖 Overview: This lecture introduces key concepts in descriptive statistics, focusing on how to represent data visually using line graphs and how to summarize data using measures of central tendency. It explains the mean, median, and mode, and discusses the importance of organizing data through stem-and-leaf displays and frequency distributions for effective analysis.

🗂️ Topics Covered

The lecture begins with a review of line graphs and their use in comparing trends across categories. It then defines measures of central tendency—mean, median, and mode—with examples and a comparison of their advantages and disadvantages. The lecture also covers methods for organizing numerical data, including ordered arrays, stem-and-leaf displays, and tabulating numerical data into frequency distributions, with step-by-step instructions for constructing classes, computing frequencies, and cumulative frequencies.

📝 Lecture Summary

Statistical Representation

Line graphs are presented as the most commonly used graphical tool. They are beneficial for understanding trends in data clearly. Examples illustrate their use: a line graph showing the occurrence of causes of death due to cancer in males and females reveals that after age 40, occurrence is much greater in males. Similarly, a line graph of heart diseases shows the disease is more prominent in males.

Another example compares temperature in four cities (A, B, C, and D) . The graph shows that although the general pattern is similar, city A has the lowest temperature, followed by D, B, and C. In city C, the highest temperature is close to 30 degrees, while in city A and B it is about 25, and in city D, the highest temperature is about 28 degrees.

Measures of Central Tendency

The term central tendency refers to the middle value (sometimes a typical value) of the data. Measures of central tendency are measures of the location of the middle or the center of a distribution.

Mean

Also known as the arithmetic mean, the mean is typically what is meant by the word average. It is perhaps the most common measure of central tendency. The mean of a variable is given by (the sum of all its values)/(the number of values).

🔑 Definition — Mean: the sum of all the results included in the sample divided by the number of observations. 📐 Formula: Mean = (Sum of all values) / (Number of values) 📌 Example: Find the mean of 58, 69, 73, 67, 76, 88, 91, and 74 (8 marks). Sum = 596. Mean = 596/8 = 74.5. Note that the mean is affected by extreme values.

Median

Another typical value is the median. To find the median of a number of values, first arrange the data in ascending or descending order, then locate the middle value. If there are an odd number of data points, the median is the middle value. If there are an even number of data points, the median is the mean of the two middle values.

🔑 Definition — Median: the middle value of all the numbers in the sample. 📌 Example: For the data 3, 6, 11, 14, 19, 19, 21, 24, 31 (9 values), the median is the middle value, which is 19. The median is easier to find than the mean, and unlike the mean, it is not affected by values that are unusually high or low.

Mode

The mode is the most common score in a set of scores. There may be more than one mode, or no mode at all.

🔑 Definition — Mode: the most frequently observed value of the measurements in the sample. 📌 Example: For the data set 2, 2, 1, 2, 0, 3, 2, 1, 1, 4, 1, 1, 1, 2, 2, 0, 3, 2, 1, the mode is 1.

A table compares the advantages and disadvantages of each measure:

• Mean: Quick and easy to calculate, but may not be representative of the whole sample.
• Median: Takes all numbers into account equally; fair to calculate; half of the sample (normally) lies above the median. Disadvantages: more tedious to calculate; can be affected by a few very large (or very small) numbers.
• Mode: Tedious to find for a large sample which is not in order.

Organizing Numerical Data

Numerical data can be organized in forms such as the Ordered Array, Stem-leaf Display, Tabulating and Graphing Numerical Data, Frequency Distributions (Tables, Histograms, Polygons) , and Cumulative Distributions (Tables, the Ogive) .

Stem and Leaf Display

A stem and leaf display (also called a stem and leaf plot) is particularly useful when the data is not too numerous. For example, 21 = 20 + 1 = (10 × 2) + 1. This is represented as a stem of 2 and a leaf of 1. The digit at the tenth place is taken as the stem and the digit at the units place is taken as the leaf. A stem is displayed once, and the leaf can take values from 0 to 9.

📌 Example: A stem and leaf display for the number of touchdown (TD) passes thrown by each of the 31 teams in the National Football League in the 2000 season (data: 32, 33, 33, 37, ...) is shown in the table. The stems are 3, 2, 1, and 0. 3|2337 represents the numbers 32, 33, 33, and 37. 2|001112223889 represents 12 data points. One purpose of a stem and leaf display is to clarify the shape of the distribution. By looking at the stems and the shape of the plot, you can tell that most of the teams had between 10 and 29 passing TDs, with a few having more and a few having less.

Tabulating and Graphing Univariate Categorical Data

Different ways of organizing univariate categorical data include the Summary Table and Bar and Pie Charts, the Pareto Diagram. Bivariate categorical data can be organized using Contingency Tables and Side by Side Bar charts.

Tabulating Numerical Data

It is important that data is organized in a professional manner and graphical excellence is achieved in its presentation. In some cases, it is necessary to group the values of the data into classes to summarize the data properly. The process is described below.

Step 1: Sort Raw Data in Ascending Order Data: 12, 13, 17, 21, 24, 24, 26, 27, 27, 30, 32, 35, 37, 38, 41, 43, 44, 46, 53, 58

Step 2: Find Range Range = Maximum value – Minimum Value. Thus, Range = 58 - 12 = 46.

Step 3: Select Number of Classes Select the number of classes (usually between 5 and 15). In this example, let us make 5 classes.

Step 4: Compute Class Width Class width = Range / Number of classes = 46 / 5 = 9.2. Round up 9.2 to 10. You must round up, not off. If the range divided by the number of classes gives an integer value (no remainder), then you can either add one to the number of classes or add one to the class width.

Step 5: Determine Class Boundaries (limits) Pick a suitable starting point less than or equal to the minimum value. In this example, start with 10. Continue to add the class width (10) to this lower limit to get the lower limit of other classes: 10, 20, 30, 40, 50. To find the upper limit of the first class, subtract one from the lower limit of the second class. The upper limit of the first class is 20 – 1 = 19. Rest upper limits are: 29, 39, 49.

Step 6: Compute Class Midpoints Class Midpoint = (Lower limit + Upper limit) / 2. First midpoint is (10+19)/2 = 14.5. Other midpoints are: 24.5, 34.5, 44.5, 54.5.

Step 7: Compute Class Intervals First class: Lower limit is 10, Upper limit is 19. We can write the first class interval as 10 to 19, 10 – 19, or “10 but under 20”. Other class intervals are 20–29, 30–39, 40–49, and 50–59.

Important points to remember: There should be between 5 and 15 classes. The classes must be mutually exclusive, all inclusive, and continuous. The classes must be equal in width (except for possibly the first or last class).

Frequency Distribution: Count Observations & Assign to Class Intervals Looking through the data, the frequencies are: 10–19: 3, 20–29: 6, 30–39: 5, 40–49: 4, 50–59: 2. Total frequency = 20.

Relative Frequency of a class = Frequency of the class interval / Total Frequency. For the first class, relative frequency is 3/20 = 0.15. Percent Relative Frequency is obtained by multiplying the relative frequency by 100 (e.g., 15%).

Cumulative Frequency: If we add the frequency of the second interval to the frequency of the first interval, we get the cumulative frequency for the second interval. The cumulative frequencies are: 10–19: 3 20–29: 3 + 6 = 9 30–39: 3 + 6 + 5 = 14 40–49: 3 + 6 + 5 + 4 = 18 50–59: 3 + 6 + 5 + 4 + 2 = 20

Percent Cumulative Relative Frequency is calculated like cumulative frequency, but using percent relative frequency for each class interval. The percent cumulative relative frequency for the last class interval is 100%.

⭐ Key Takeaways

A student must understand that measures of central tendency—mean, median, and mode—describe the center or typical value of a dataset, each with its own strengths and weaknesses; the mean is sensitive to extreme values, while the median is not. The ability to construct and interpret stem-and-leaf displays is crucial for visualizing small datasets and understanding their shape. For larger numerical datasets, the skill of grouping data into a frequency distribution by calculating range, determining class width, and setting class boundaries is essential. Finally, understanding absolute, relative, and cumulative frequencies (including their percentage forms) is fundamental for summarizing data in tables and for later graphical representations like histograms and ogives.

🧠 Quick Revision Questions

1. What is the primary disadvantage of using the mean as a measure of central tendency, and how does the median address this weakness?
2. For a dataset with an even number of values, such as 10, 15, 20, and 25, how is the median calculated?
3. In the process of creating a frequency distribution, what is the purpose of rounding up the class width, and what should be done if the range is exactly divisible by the number of classes?
4. What key information about a dataset is revealed by constructing a stem-and-leaf display that might not be immediately obvious from a simple list of numbers?
5. If the total frequency for a dataset is 50 and the frequency for a class interval 30–39 is 10, what is the percent relative frequency for that class?

📘 Lecture 25 — Statistical Representation Measures of Central Tendency Part 2

📖 Overview: This lecture continues the study of statistical representation and measures of central tendency. It introduces the histogram as a graphical tool for numerical data and provides a comprehensive list of central tendency measures. The lecture also explains how to calculate key measures like mean, median, and mode using Excel functions, and demonstrates the calculation of the arithmetic mean for grouped data.

🗂️ Topics Covered

The lecture begins by reviewing the histogram as a bar graph of a frequency distribution. It then presents a comprehensive list of measures of central tendency, including arithmetic mean, median, mode, geometric mean, and others. The core of the lecture focuses on using Excel functions such as AVERAGE, AVERAGEA, MEDIAN, MODE, COUNT, and FREQUENCY. Finally, it provides a step-by-step example and Excel calculation for the arithmetic mean of grouped data.

📝 Lecture Summary

Graphing Numerical Data: The Histogram

A histogram is a bar graph of a frequency distribution. The widths of the bars are proportional to the classes into which the variable has been divided, and the heights of the bars are proportional to the class frequencies.

Measures of Central Tendency

Measures of central tendency can be summarized as:

1. Arithmetic Mean a. For discrete data (Sample Mean, Population Mean) b. For grouped data
2. Geometric Mean
3. Harmonic Mean
4. Weighted Mean
5. Truncated Mean or Trimmed Mean
6. Winsorized Mean
7. Median (for grouped data, for discrete data)
8. Mode (for grouped data, for discrete data)
9. Midrange
10. Midhinge

The main measures are Arithmetic Mean, Median, and Mode. These measures are used in different situations to understand data behavior for decision making, such as determining average, median, or mode salary in an organization before salary increases.

💡 Why this matters: Without such summaries, it is not possible to compare large volumes of data.

AVERAGE

Returns the average (arithmetic mean) of the arguments.

🔑 Definition — AVERAGE: The arithmetic mean of a set of numbers.

📐 Formula: =AVERAGE(number1,number2,...) where number1, number2 are 1 to 30 numeric arguments.

Remarks: Arguments must be numbers or references containing numbers. If an array or reference contains text, logical values, or empty cells, those values are ignored; cells with the value zero are included.

📌 Example: Data entered in cells A4 to A8 with formula =AVERAGE(A4:A8) returns 11.

AVERAGEA

Calculates the average (arithmetic mean) of the values in the list of arguments. Unlike AVERAGE, text and logical values such as TRUE and FALSE are included in the calculation.

🔑 Definition — AVERAGEA: The arithmetic mean that includes text and logical values in the calculation.

📐 Formula: =AVERAGEA(value1,value2,...) where value1, value2 are 1 to 30 cells, ranges, or values.

Remarks: Array or reference arguments that contain text evaluate as 0. Arguments that contain TRUE evaluate as 1; FALSE evaluates as 0.

📌 Example: With data in A2:A6 and A7 as empty cell:

• =AVERAGEA(A2:A6) returns 5.6 (includes the text "Not Available" as 0)
• =AVERAGEA(A2:A5,A7) returns 7 (includes the empty cell as 0, but ignores it in count)

MEDIAN

Returns the median of the given numbers. The median is the number in the middle of a set of numbers; half the numbers have values greater than the median, and half have values less.

🔑 Definition — MEDIAN: The middle value in an ordered set of numbers.

📐 Formula: =MEDIAN(number1,number2,...) where number1, number2 are 1 to 30 numbers.

Remarks: If there is an even number of numbers, MEDIAN calculates the average of the two numbers in the middle. Text, logical values, or empty cells are ignored.

📌 Example: With numbers in cells A14 to A19 (1,2,3,4,5,6):

• =MEDIAN(1,2,3,4,5) returns 3
• =MEDIAN(A14:A19) returns 3.5 (average of 3 and 4, the two middle values)

MODE

Returns the most frequently occurring, or repetitive, value in an array or range of data. Like MEDIAN, MODE is a location measure.

🔑 Definition — MODE: The most frequently occurring value in a data set.

📐 Formula: =MODE(number1,number2,...) where number1, number2 are 1 to 30 arguments.

Remarks: If the data set contains no duplicate data points, MODE returns the #N/A error. No single measure of central tendency provides a complete picture of the data.

📌 Example: With data in cells A27 to A32 (values include 4 appearing most frequently), formula =MODE(A27:A32) returns 4.

COUNT Function

Counts the number of cells that contain numbers and also numbers within the list of arguments.

🔑 Definition — COUNT: Counts the number of cells containing numbers in a range or array.

📐 Formula: =COUNT(value1,value2,...) where value1, value2 are 1 to 30 arguments.

Remarks: Arguments that are numbers, dates, or text representations of numbers are counted. Empty cells, logical values, text, or error values are ignored.

📌 Example: With data in A2:A8 (Sales, 12/8/2008, empty, 19, 22.24, TRUE, #DIV/0!):

• =COUNT(A2:A8) returns 3 (counts numbers: 19, 22.24, and the date as a number)
• =COUNT(A5:A8) returns 2 (counts numbers in last 4 rows)
• =COUNT(A2:A8,2) returns 4 (adds the value 2 to the count)

FREQUENCY

Calculates how often values occur within a range of values, and then returns a vertical array of numbers.

🔑 Definition — FREQUENCY: Counts how many values fall within specified intervals (bins).

📐 Formula: =FREQUENCY(data_array,bins_array) where data_array is the set of values and bins_array is the intervals.

Remarks: FREQUENCY returns an array and must be entered as an array formula. The number of elements in the returned array is one more than the number of elements in bins_array.

📌 Example: With scores in A2:A10 and bins in B2:B5 (70, 79, 89):

• =FREQUENCY(A2:A10,B2:B5) returns: 1 score ≤ 70, 2 scores in 71-79, 4 scores in 80-89, 2 scores ≥ 90

Arithmetic Mean Grouped Data

This section demonstrates calculating the arithmetic mean of grouped data where marks (classes) and frequency are given. Class marks are the class midpoints calculated as the average of lower and higher limits.

🔑 Definition — Arithmetic Mean (Grouped Data): The weighted average using class marks as the representative value for each class.

📐 Formula: Mean = Σ(fX) / n
Where: f = frequency, X = class mark (class midpoint), n = total frequency

Steps:

1. Calculate class marks: X = (lower limit + upper limit) / 2
2. Multiply each frequency f by its class mark X to get fX
3. Sum all fX values: Σ(fX)
4. Sum all frequencies: n
5. Mean = Σ(fX) / n

📌 Example: Given marks distribution:

n = 50, Σ(fX) = 1950
Mean = 1950/50 = 39 Marks

Excel Calculation: Lower limits in A54:A60, higher limits in B54:B60, frequency in D54:D60. Class marks in F54:F60 using formula =(A54+B54)/2. fX in H54:H60 using formula =D54*F54. Total frequency in D61 using =SUM(D54:D60). Sum of fX in H61 using =SUM(H54:H60). Mean in H62 using =ROUND(H61/D61,0).

⭐ Key Takeaways

The histogram is a fundamental graphical tool for visualizing frequency distributions. While there are many measures of central tendency—including geometric mean, harmonic mean, weighted mean, trimmed mean, winsorized mean, median, mode, midrange, and midhinge—the three primary measures are arithmetic mean, median, and mode, each serving different analytical purposes. Excel provides dedicated functions for these calculations, with AVERAGE, MEDIAN, and MODE being the most essential. When dealing with grouped data, the arithmetic mean is calculated by summing the products of frequencies and class marks, then dividing by the total frequency. Understanding which measure to use in different situations is critical for accurate data analysis and decision-making.

🧠 Quick Revision Questions

1. What is the difference between the AVERAGE and AVERAGEA Excel functions?
2. How is the median calculated when a data set has an even number of values?
3. What does the MODE function return if there are no duplicate values in a data set?
4. What is a class mark, and how is it calculated for grouped data?
5. Why must the FREQUENCY function be entered as an array formula in Excel?

📘 Lecture 26 — Statistical Representation Measures of Dispersion and Skewness Part 1

📖 Overview: This lecture covers key statistical tools for data representation and analysis, including frequency distributions, graphical methods, measures of central tendency (geometric and harmonic means), and positional measures. It introduces fundamental concepts of data dispersion and skewness, which are essential for understanding how data varies and is distributed in real-world business applications.

🗂️ Topics Covered

The lecture begins with a review of the FREQUENCY function and its application in creating frequency distributions. It then covers frequency polygons, cumulative frequency distributions, and ogives. Methods for tabulating and graphing univariate data are presented, including summary tables, bar charts, pie charts, and Pareto diagrams. The lecture introduces contingency tables and side-by-side charts, followed by geometric and harmonic means, quartiles, deciles, and percentiles. It concludes with discussions on symmetrical and skewed distributions, empirical relationships, trimmed and winsorized means, and types of dispersion measures.

📝 Lecture Summary

FREQUENCY-EXAMPLE

The FREQUENCY function in Excel calculates how often values occur within a range of values and returns a vertical array of numbers. The syntax is FREQUENCY(data_array, bins_array). To use it, you enter the data in one range, the bins (upper limits) in another range, select cells one more than the number of bins, type the formula, and press CTRL+Shift+Enter to enter it as an array formula.

🔑 Definition — FREQUENCY Function: A function that counts how many values in a data set fall into specified intervals (bins).

📐 Formula: =FREQUENCY(data_array, bins_array) → Counts values less than or equal to each bin and values above the last bin.

📌 Example: Data in cells A3:A11 = {values}. Bins in B3:B5 = {70, 79, 89}. Formula = FREQUENCY(A3:A11, B3:B5). Result: ≤70 = 1, 71-79 = 2, 80-88 = 4, ≥89 = 2. The Number of result cells is one more than the number of bins.

Application of FREQUENCY Function in Frequency Distribution

To create a frequency distribution using Excel: Write data in column A. In columns C and D, write class lower and upper limits. Use class upper limits as bins. Select cells E3 to E8 (one more than number of classes). Type =FREQUENCY(A2:A21, D3:D7). Press Ctrl+Shift+Enter to fill the frequency column.

FREQUENCY POLYGONS

A frequency polygon is a line graph obtained from a frequency distribution by joining with straight lines points whose x-coordinates are the midpoints of successive class intervals and whose y-coordinates are the corresponding class frequencies.

CUMULATIVE FREQUENCY

Relative frequency can be converted into cumulative frequency by adding the current frequency to the previous total. Percent cumulative frequency is calculated by dividing the cumulative frequency by the total number of observations and multiplying by 100.

📌 Example: First interval: relative frequency = 3, cumulative frequency = 3. Second interval (20-30): relative frequency = 6, cumulative frequency = 3 + 6 = 9 (meaning 9 values are ≤ 30). Total cumulative frequency = 20. Percent cumulative frequency for first interval = 3/20 × 100 = 15%.

CUMULATIVE % POLYGON-OGIVE

An ogive is a cumulative percentage frequency polygon that starts from the first limit (not the midpoint as in relative frequency polygons). The maximum value in an ogive is always 100%. Ogives are used for determining cumulative frequencies at different values (not limits).

TABULATING AND GRAPHING UNIVARIATE DATA

Univariate data (data with one variable) can be tabulated in summary form or in graphical form using three types of charts: Bar Charts, Pie Charts, or Pareto Diagrams.

SUMMARY TABLE

A summary table is built specifically from detailed data. It contains summaries of the data and is used to speed up analysis.

📌 Example: Investor's Portfolio

BAR CHART

A bar chart displays data using rectangular bars with heights proportional to the values. It can be prepared using the Excel Chart Wizard.

PIE CHARTS

Pie charts are very useful charts to show percentage distribution. They are made with the help of the Chart Wizard and clearly show how categories like stocks and bonds stand out.

PARETO DIAGRAMS

A Pareto diagram is a cumulative distribution where the first point is the first relative frequency. Each subsequent point adds the next category's percentage. The diagram shows both relative and cumulative frequency simultaneously.

📌 Example: First category (Stocks) = 42%. Add Bonds (29%) = 71%. Add Savings (15%) = 86%. Add CD (14%) = 100%.

CONTINGENCY TABLES

A contingency table is another form of data presentation that shows the comparison of multiple categories across different groups.

📌 Example: A table comparing three investors along with their combined total investment.

SIDE BY SIDE CHARTS

Side by side charts represent the same data as a contingency table using different colors to differentiate between groups.

GEOMETRIC MEAN

The geometric mean is defined as the nth root of the product of n individual values. It is used for data that grows multiplicatively.

🔑 Definition — Geometric Mean (GM): The nth root of the product of n values.

📐 Formula: G = (x1 × x2 × x3 × ... × xn)^(1/n)

📌 Example: Find GM of 130, 140, 160. GM = (130 × 140 × 160)^(1/3) = 142.8

HARMONIC MEAN

The harmonic mean is defined as the reciprocal of the arithmetic mean of the reciprocals of the data values.

🔑 Definition — Harmonic Mean (HM): The number of observations divided by the sum of the reciprocals of the observations.

📐 Formula: HM = n / (1/x1 + 1/x2 + ... + 1/xn) = n / Σ(1/xi)

📌 Example: Find HM of 10, 8, 6. HM = 3 / (1/10 + 1/8 + 1/6) = 7.66

QUARTILES

Quartiles divide data into 4 equal parts.

🔑 Definition — Quartiles: Values that divide a data set into four equal parts.

📐 Formula (Ungrouped data):

• Q1 = (n+1)/4 position
• Q2 = 2(n+1)/4 position
• Q3 = 3(n+1)/4 position

📐 Formula (Grouped data): Qi = l + h/f[(Σf/4 × i) – cf] Where l = lower boundary, h = width of class interval, f = frequency, cf = cumulative frequency

DECILES

Deciles divide data into 10 equal parts.

🔑 Definition — Deciles: Values that divide a data set into ten equal parts.

📐 Formula (Ungrouped data):

• D1 = (n+1)/10 position
• D2 = 2(n+1)/10 position
• D9 = 9(n+1)/10 position

📐 Formula (Grouped data): Di = l + h/f[(Σf/10 × i) – cf] (for i = 1, 2, ..., 9)

PERCENTILES

Percentiles divide data into 100 equal parts.

🔑 Definition — Percentiles: Values that divide a data set into one hundred equal parts.

📐 Formula (Ungrouped data):

• P1 = (n+1)/100 position
• P2 = 2(n+1)/100 position
• P99 = 99(n+1)/100 position

📐 Formula (Grouped data): Pi = l + h/f[(Σf/100 × i) – cf] (for i = 1, 2, ..., 99)

Symmetrical Distribution

In a symmetrical distribution, the mean, median, and mode are all equal: mean = median = mode.

Positively Skewed Distribution

In a positively skewed distribution (tilted to the left), the mean is greater than the median, which is greater than the mode: mean > median > mode.

Negatively Skewed Distribution

In a negatively skewed distribution (tilted to the right), the mode is less than the median, which is less than the mean: mode < median < mean.

EMPIRICAL RELATIONSHIPS

For a moderately skewed and unimodal distribution, there is an empirical relationship: Mean – Mode = 3(Mean – Median).

📌 Example: If mode = 15 and mean = 18, find the median. Median = 1/3[mode + 2(mean)] = 1/3[15 + 2(18)] = [15 + 36]/3 = 51/3 = 17

TRIMMED MEAN

A trimmed mean (or truncated mean) is a measure of central tendency. First, sort the data. Then discard an equal number of data at both ends (most often 25 percent of the ends). The mean of the remaining data is called the trimmed mean.

🔑 Definition — Trimmed Mean: The mean calculated after removing a specified percentage of observations from both ends of a sorted data set.

WINSORIZED MEAN

The Winsorized mean involves calculating the mean after replacing given parts of data at the high and low ends with the most extreme remaining values (most often 25 percent of the ends are replaced).

🔑 Definition — Winsorized Mean: The mean calculated after replacing extreme values with the nearest remaining values in the data set.

📌 Example: Data: 9.1, 9.2, 9.3, 9.2, 9.2, 9.9 (sorted: 9.1, 9.2, 9.2, 9.2, 9.3, 9.9) Q1 position = (6+1)/4 = 1.75, Q1 ≈ 9.2 (2nd value) Q3 position = 3(6+1)/4 = 5.25, Q3 ≈ 9.3 (5th value) Trimmed Mean = (9.2 + 9.2 + 9.2 + 9.3)/4 = 9.225 Winsorized Mean = (9.2 + 9.2 + 9.2 + 9.2 + 9.3 + 9.3)/6 = 9.233

💡 Why this matters: Trimmed and Winsorized means reduce the influence of outliers while keeping most of the data, providing more robust central tendency measures.

DISPERSION OF DATA

Dispersion of data is defined as the degree to which numerical data tend to spread about an average.

🔑 Definition — Dispersion: The spread or variability of data points around a central value.

TYPES OF MEASURES OF DISPERSION

There are two types of measures of dispersion:

1. Absolute measures
2. Relative measures (coefficients)

DISPERSION OF DATA — Types of Absolute Measures

• Range
• Quartile Deviation
• Mean Deviation
• Standard Deviation or Variance

Types of Relative Measures

• Coefficient of Range
• Coefficient of Quartile Deviation
• Coefficient of Mean Deviation
• Coefficient of Variation

⭐ Key Takeaways

The FREQUENCY function in Excel is essential for creating frequency distributions by counting values in specified intervals. Geometric and harmonic means provide alternative central tendency measures for multiplicative and reciprocal data, respectively. Quartiles, deciles, and percentiles divide data into 4, 10, and 100 parts and are calculated using specific formulas for both ungrouped and grouped data. Skewness describes distribution shape, with empirical relationships linking mean, median, and mode in moderately skewed unimodal distributions. Finally, dispersion measures like range, quartile deviation, mean deviation, and standard deviation quantify data spread, with relative coefficients allowing comparisons between different data sets.

🧠 Quick Revision Questions

1. What is the syntax of the FREQUENCY function in Excel, and why must one more cell than the number of bins be selected?
2. How do you calculate the cumulative frequency and percent cumulative frequency from relative frequencies?
3. What is the difference between a trimmed mean and a Winsorized mean?
4. Write the formulas for Q1, D1, and P1 for both ungrouped and grouped data.
5. In a negatively skewed distribution, how do the mean, median, and mode relate to each other?

📘 Lecture 27 — Statistical Representation Measures of Dispersion and Skewness Part 2

📖 Overview: This lecture covers the review of measures of central tendency and introduces key measures of dispersion including range, quartiles, and quartile deviation. It explains how to determine the shape of a distribution using the 5-number summary, box-and-whisker plots, and the relationship between median, midhinge, and midrange.

🗂️ Topics Covered

The lecture reviews measures of central tendency (mean, median, mode, geometric mean, midrange) and dispersion (range, interquartile range, variance, standard deviation, coefficient of variation). It covers quartiles and their calculation, midhinge, quartile deviation, shape of distributions (symmetrical, right-skewed, left-skewed), the 5-number summary, box-and-whisker plots, and summary measures of central tendency and variation.

📝 Lecture Summary

MEASURES OF CENTRAL TENDENCY, VARIATION AND SHAPE FOR A SAMPLE

There are many different measures of central tendency. These include Mean, Median, Mode, Midrange, Quartiles, and Midhinge. Measures of dispersion include Range, Interquartile Range, Variance, Standard Deviation, and Coefficient of Variation. Distributions can be Right-skewed, Left-skewed, or Symmetrical. Additional topics include Exploratory Data Analysis, Five-Number Summary, Box-and-Whisker Plot, Proper Descriptive Summarisation, Exploring Ethical Issues, and Coefficient of Correlation.

MEANS

The most common measure of central tendency is the mean. The Arithmetic Mean represents the overall average. The Median divides data into two equal parts. The Mode is the most common value. Geometric mean is used in compounding such as investments. Harmonic mean is the mean of inverse values. Each of these has its own utility.

🔑 Definition — Mean (Arithmetic): The sum of all values divided by the number of values. 📐 Formula: Mean = Σx / n → the total of all observations divided by the sample size. 💡 Why this matters: When sample data is used to estimate population mean, the number is reduced by 1 to improve the estimate and avoid errors.

EXTREME VALUES

An important point to remember is that arithmetic mean is affected by extreme values (outliers). 📌 Example: For values 1, 3, 5, 7, and 9, the mean is 5. For values 1, 3, 6, 7, and 14, the value 14 is an outlier, and the mean becomes 6 — an increase of 1 or about 20% due to the outlier. While preparing data for mean, it is important to spot and eliminate outlier values.

THE MEDIAN

The Median is derived after ordering the array in ascending order. If the number of observations is odd, it is the middle value; otherwise, it is the average of the two middle values. It is not affected by extreme values.

THE MODE

The Mode is the value that occurs most frequently. 📌 Example: In data where 8 appears most frequently, the mode is 8. Mode is also not affected by extreme values. An important point about Mode is that there may not be a Mode at all (no value occurs frequently), or there may be more than one mode. The mode can be used for numerical or categorical data.

RANGE

Another measure of dispersion of data is the Range. It is the difference between the largest and smallest value.

🔑 Definition — Range: The difference between the largest and smallest value in a dataset.

MIDRANGE

Midrange is the average of the smallest and largest value. In other words, it is half of a range. Midrange is affected by extreme values as it is based on smallest and largest values.

📐 Formula: Midrange = (Smallest value + Largest value) / 2

QUARTILES

Quartiles are not exclusively measures of central tendency. However, they are useful for dividing data into 4 equal parts, each containing 25% of the data. There are three quartiles: 25% of data falls below the first quartile (Q1), 50% below the second quartile (Q2/median), and 75% below the third quartile (Q3).

📐 Formula: Position of ith quartile = i(n + 1) / 4, where i = 1, 2, 3 and n is the number of data points.

📌 Example: Find first, second, and third quartile of the following data: 11, 22, 17, 16, 12, 21, 16, 13, 18 Step 1: Arrange data in ascending order: 11, 12, 13, 16, 16, 17, 18, 21, 22 (n = 9) Position of Q1 = (9+1)/4 = 2.5 Q1 = 2nd value + 0.5 × (3rd value – 2nd value) = 12 + 0.5 × (13 – 12) = 12 + 0.5 × 1 = 12.5 Position of Q2 = 2 × (9+1)/4 = 5 Q2 = 5th value = 16 Position of Q3 = 3 × (9+1)/4 = 7.5 Q3 = 7th value + 0.5 × (8th value – 7th value) = 18 + 0.5 × (21 – 18) = 18 + 0.5 × 3 = 19.5

MIDHINGE

Midhinge is the average of the first and third quartiles.

📐 Formula: Midhinge = (Q1 + Q3) / 2

QUARTILE DEVIATION

Quartile Deviation (Q.D.) is half the difference between the first and third quartile.

📐 Formula: Q.D. = (Q3 – Q1) / 2

📌 Example: Find Q.D. of the following data: 14, 10, 17, 5, 9, 20, 8, 24, 22, 13 n = 10 Position of Q1 = (10+1)/4 = 2.75 Q1 = 2nd value + 0.75 × (3rd value – 2nd value) = 8 + 0.75 × (9 – 8) = 8 + 0.75 = 8.75 Position of Q3 = 3 × (10+1)/4 = 8.25 Q3 = 8th value + 0.25 × (9th value – 8th value) = 20 + 0.25 × (22 – 20) = 20 + 0.25 × 2 = 20.50 Q.D. = (20.50 – 8.75) / 2 = 5.875

SHAPE OF DISTRIBUTION

The shape of a distribution can be:

1. Symmetrical Distribution
2. Asymmetrical Distribution: a. Right-skewed or positively-skewed distribution b. Left-skewed or negatively-skewed distribution

We can find the shape of distribution using the 5-number summary.

5-NUMBER SUMMARY

The 5-number summary consists of:

• Smallest value (Xsmallest)
• 1st Quartile (Q1)
• Median (Q2)
• 3rd Quartile (Q3)
• Largest value (Xlargest)

BOX AND WHISKER PLOT

Box and whisker plot shows the 5-number summary graphically and gives a good idea about the shape of the distribution.

Symmetrical Distribution: Data is perfectly symmetrical if:

• Distance from Q1 to Median = Distance from Median to Q3
• Distance from Xsmallest to Q1 = Distance from Q3 to Xlargest
• That is: Median = Midhinge = Midrange

Right-skewed distribution: Distance from Xlargest to Q3 greatly exceeds distance from Q1 to Xsmallest

• That is: Median < Midhinge < Midrange

Left-skewed distribution: Distance from Q1 to Xsmallest greatly exceeds distance from Xlargest to Q3

• That is: Median > Midhinge > Midrange

📌 Example: Suppose there are nine homes valued at Rs. 150,0000, 140,0000, 160,0000, 150,0000, 160,0000, 170,0000, 160,0000, 150,0000, and 160,0000. One small home is built with a valuation of Rs. 20,0000. Find whether the frequency polygon is negatively skewed or positively skewed. Following sample represents annual costs (in '000 Rs) for attending 10 conferences: 13.0, 14.5, 14.9, 15.2, 15.2, 15.4, 15.6, 16.2, 17, 23.1 Find 5-number summary and shape of the distribution. n = 10 Position of Q1 = (10+1)/4 = 2.75 Q1 = 14.5 + 0.75 × (14.9 – 14.5) = 14.5 + 0.75 × 0.4 = 14.8 Position of Q3 = 3 × (10+1)/4 = 8.25 Q3 = 16.2 + 0.25 × (17 – 16.2) = 16.2 + 0.25 × 0.8 = 16.4 Median = (15.2 + 15.4)/2 = 15.3 5-number summary: Smallest = 13.0, Q1 = 14.8, Median = 15.3, Q3 = 16.4, Largest = 23.1 Midrange = (23.1 + 13.0)/2 = 18.05 Midhinge = (14.8 + 16.4)/2 = 15.6 Since Median (15.3) < Midhinge (15.6) < Midrange (18.05), the shape is right-skewed.

SUMMARY MEASURES

The summary measures include measures of central tendency and variation. In variation, there are range, Interquartile range, standard deviation, variance, and coefficient of variation.

MEASURES OF VARIATION

In measures of variation, the sample and population standard deviation and variance are the most important measures. The coefficient of variation is the ratio of standard deviation to the mean expressed as a percentage.

INTERQUARTILE RANGE

Interquartile range is the difference between the 1st and 3rd quartile.

🔑 Definition — Interquartile Range (IQR): The difference between Q3 and Q1, representing the middle 50% of data.

⭐ Key Takeaways

The arithmetic mean is affected by extreme values (outliers), while median and mode are not. Quartiles divide data into four equal parts, and quartile deviation measures half the spread between Q1 and Q3. The shape of a distribution can be determined by comparing median, midhinge, and midrange: symmetrical when all three are equal, right-skewed when median < midhinge < midrange, and left-skewed when median > midhinge > midrange. The 5-number summary (smallest, Q1, median, Q3, largest) is essential for creating box-and-whisker plots and understanding data distribution. Interquartile range and quartile deviation are robust measures of dispersion not affected by outliers.

🧠 Quick Revision Questions

1. What is the formula for finding the position of the ith quartile in an ordered dataset?
2. How does the presence of an outlier affect the arithmetic mean versus the median?
3. Calculate Q1 and Q3 for the dataset: 5, 8, 12, 15, 18, 22, 25, 28, 30.
4. If Median = 20, Midhinge = 22, and Midrange = 25, what is the shape of the distribution?
5. What is the difference between quartile deviation and interquartile range?

📘 Lecture 28 — MEASURES OF DISPERSION CORRELATION PART 1

📖 Overview: This lecture marks the beginning of Module 6 and introduces two core statistical concepts. First, it covers key measures of dispersion, including variance, standard deviation, coefficient of variation, and mean deviation, explaining how they quantify the spread of data around the central value. Second, it introduces the fundamentals of regression analysis and correlation, including the use of scatter diagrams to visualize the association between variables. These tools are essential for moving from simple description of data to understanding relationships between different data sets, which is critical for business forecasting and analysis.

🗂️ Topics Covered

This lecture reviews key measures of dispersion, including how to calculate variance and standard deviation for both raw data and grouped data, using the example of motorway fatalities. It then demonstrates how to compare variability across different data sets using the coefficient of variation (CV) and calculates the mean deviation about the mean and median. The second part of the lecture introduces regression analysis, focusing on creating a scatter diagram and interpreting positive and negative linear relationships between variables.

📝 Lecture Summary

VARIANCE

Variance is one of the most important measures of dispersion, as it gives the average of the squared deviations from the mean. For a population, the sum of squared deviations is divided by the total number of values in the population (N). For a sample, the sum is divided by the number of observations minus one (n-1).

STANDARD DEVIATION

Standard deviation is the most important and widely used measure of dispersion. It is the positive square root of the variance, which brings the measure back into the original unit of measurement.

🔑 Definition — Standard Deviation: A measure of the spread of data around the mean, calculated as the square root of the variance. 📐 Formula (Sample): s = √[ Σ(x - x̄)² / (n - 1) ] → The square root of the average squared deviation from the mean for a sample. 📌 Example: For the number of fatalities (4, 6, 2, 0, 3, 5, 8), the mean is 4. The sum of squared deviations is 42. For a sample, Variance = 42 / (7-1) = 7. Standard Deviation = √7 ≈ 2.65 fatalities.

For grouped data in a frequency distribution, each squared deviation around the mean must be multiplied by the appropriate frequency (f) before summation.

COMPARING STANDARD DEVIATIONS

In many situations, it is necessary to calculate a population standard deviation based on a sample's standard deviation. The sample SD uses n-1 for the division. When a dataset of (3, 4, 5, 6, 7, 10) is treated as a sample, the SD is 4.2426; when treated as a population, the SD is 3.9686. This shows that using a sample SD as a direct estimate for the population will overestimate the true population spread.

💡 Why this matters: Datasets with the same mean can have very different standard deviations. For example, sets A, B, and C all have a mean of 15.5 but have SDs of 3.338, 0.9258, and 4.57, respectively. Mean and SD together form a complete description of the central tendency and spread of data.

COEFFICIENT OF VARIATION

The Coefficient of Variation (CV) shows the dispersion of the standard deviation relative to the mean, expressed as a percentage. This is crucial for comparing variability between different datasets with different units or means.

📐 Formula: CV = (s / x̄) * 100 → The standard deviation divided by the mean, multiplied by 100 to get a percentage. 📌 Example: If Stock A has a CV of 10% and Stock B has a CV of 5%, there is much greater variation in the price of Stock A relative to its mean. 📌 Example (Earnings): Country 1 has mean earnings of $19.50 with an SD of $4. CV = (4/19.5) * 100 = 20.5%. Country 2 has a mean of Rs. 75 with an SD of Rs. 28. CV = (28/75) * 100 = 37.3%. This shows that Country 2 has greater variability in earnings.

MEAN DEVIATION

The mean deviation of a set of data is defined as the arithmetic mean of the absolute deviations measured either from the mean or from the median.

📐 Formula for Sample (about mean): M.D. = Σ | x - x̄ | / n → The sum of the absolute differences between each data point and the mean, divided by the number of data points. 📌 Example: For marks (45, 32, 37, 46, 39, 36, 41, 48, 36), the Mean = 40 and Median = 39. The sum of absolute deviations from the mean is 40. Mean Deviation from Mean = 40 / 9 ≈ 4.4 marks. The sum of absolute deviations from the median is 39. Mean Deviation from Median = 39 / 9 ≈ 4.3 marks. 📐 Formula for Grouped Data (about mean): M.D. = Σ f_i | x_i - x̄ | / Σ f_i → The sum of each frequency multiplied by the absolute deviation of its midpoint from the mean, divided by the total number of data points (N).

REGRESSION ANALYSIS

The primary objective of regression analysis is the development of a regression model to explain the association between two or more variables in a given population. A regression model is a mathematical equation that provides a prediction of the value of a dependent variable based on known values of one or more independent variables.

Key questions addressed in regression analysis include:

• Determining the simple linear regression equation.
• Understanding different measures of variation in regression and correlation.
• Understanding the assumptions of regression and correlation.
• Conducting residual analysis.
• Making inferences about the slope and estimating predicted values.
• Identifying pitfalls and ethical issues.

SCATTER DIAGRAM

The first step in regression analysis is to plot the values of the dependent and independent variables in the form of a scatter diagram. The pattern formed by the scatter of the points indicates whether and what degree of association exists between them. If the points appear to cluster around a straight line, there is a distinct linear correlation.

Types of Regression Models

There are two primary types of linear models: positive linear relationships and negative linear relationships.

• Positive Linear Relationship: The value of the dependent variable increases as the value of the independent variable increases.
• Negative Linear Relationship: The value of the dependent variable decreases as the value of the independent variable increases.

⭐ Key Takeaways

A student must first understand that variance and standard deviation are the primary measures of spread, with the standard deviation being the square root of the variance and expressed in the original data units. The coefficient of variation is critical for comparing the relative variability of different datasets, especially when their means are vastly different or in different units. The concept of mean deviation provides a simpler, though less statistically powerful, measure of spread by averaging absolute deviations. Crucially, the lecture marks the beginning of regression and correlation analysis, which requires plotting a scatter diagram as the first step to visually inspect a relationship, and distinguishing between positive and negative linear relationships is fundamental to interpreting the association between two variables.

🧠 Quick Revision Questions

1. What is the key difference between calculating the variance for a sample versus a population?
2. Why is the standard deviation considered a more useful measure than the variance for describing data?
3. A stock has a mean price of $50 and a standard deviation of $10. Another stock has a mean price of $200 and a standard deviation of $30. Calculate the Coefficient of Variation for each and state which stock has greater relative variability.
4. Given the dataset {10, 12, 8, 10, 15}, calculate the mean deviation about the mean (show your steps).
5. When looking at a scatter diagram of two variables, what pattern would indicate a negative linear relationship?

📘 Lecture 29 — MEASURES OF DISPERSION CORRELATION PART 2

📖 Overview: This lecture introduces correlation analysis, a statistical method used to measure the strength and direction of the relationship between two random variables. It explains the difference between correlation and regression, how to calculate the correlation coefficient (r) using both the covariance formula and a shortcut formula, and how to interpret its value. The lecture also demonstrates practical computation through a real-world example and shows how to perform correlation analysis in Excel, which is essential for identifying associations before conducting regression analysis.

🗂️ Topics Covered

The lecture reviews concepts from Lecture 28, then delves into the definition and purpose of correlation analysis, distinguishes it from regression analysis, explains the interpretation of the correlation coefficient through positive, negative, and zero correlation cases with graphical illustrations, provides the mathematical formulas for calculating r (including covariance and a shortcut formula), presents a detailed step-by-step example calculating correlation between Mathematics and Statistics marks, discusses important warnings about causation versus correlation, and finally demonstrates how to calculate correlation coefficients using Excel tools and functions.

📝 Lecture Summary

CORRELATION

Correlation is a measure of the strength or the degree of relationship between two random variables. When do we use correlation? It will be used when we wish to establish whether there is a degree of association between two variables. If this association is established, then it makes sense to proceed further with regression analysis. Regression analysis determines the constants of the regression. You cannot make any predictions with results of correlation analysis. Predictions are based on regression equations.

CORRELATION ANALYSIS

To analyze the strength of the relationship or co-variation between two variables, we use correlation analysis. Correlation analysis contributes to the understanding of economic behavior, aids in locating the critically important variables on which others depend, may reveal to the economist the connections by which disturbances spread, and suggest to them the path through which stabilizing forces may become effective.

SIMPLE LINEAR CORRELATION VERSUS SIMPLE LINEAR REGRESSION

The calculations for linear correlation analysis and regression analysis are the same. In correlation analysis, one must sample randomly both X and Y. Correlation deals with the association (importance) between variables, whereas Regression deals with prediction (intensity).

The slide shows three types of correlation for both positive and negative linear relationships. In the first figure (r = 0.9), the data points are practically in a straight line. This kind of association or correlation is near perfect. This applies to negative correlation also. The graphs where r = 0.5, the points are more scattered; there is a clear association, but this association is not very pronounced. In graphs where r = 0, there is no association between variables.

CORRELATION COEFFICIENT

For calculation of the correlation coefficient:

1. A standardized transform of the covariance (sxy) is calculated by dividing it by the product of the standard deviations of X (sx) and Y (sy).

2. It is called the population correlation coefficient and is defined as: r = sXY / sX sY

   Or r = Cov(X,Y) / √[Var(X) Var(Y)]

Where covariance of X and Y is defined as: Cov(X,Y) = Σ (X – X̄)(Y – Ȳ) / n

This formula is a bit cumbersome to apply. Therefore, we may use the following shortcut formula:

🔑 Definition — Correlation Coefficient (r): A pure number that lies between -1 and 1, measuring the strength and direction of a linear relationship between two variables.

📐 Formula (Shortcut): r = [ΣXY – (ΣX)(ΣY)/n] / √[ [ΣX² – (ΣX)²/n] [ΣY² – (ΣY)²/n] ]

→ Plain English meaning: This formula calculates the standardized measure of how X and Y vary together, adjusted for their individual variabilities.

It should be noted that r is a pure number that lies between -1 and 1 i.e. -1 < r < 1.

Case 1: Positive correlation: 0 < r < 1 In case of a positive linear relationship, r lies between 0 and 1. The closer the points are to the UPWARD-going line, the STRONGER is the positive linear relationship, and the closer r is to 1.

Case 2: No correlation: r = 0 In such a situation, X and Y are said to be uncorrelated. The points show no linear pattern.

Case 3: Negative correlation: -1 < r < 0 The points cluster around a DOWNWARD-sloping line.

💡 Why this matters: The sign of r tells you the direction of the relationship (positive or negative), while the magnitude tells you the strength (closer to 1 = stronger).

Warning

• Existence of a high correlation does not mean there is causation, which means there may be a correlation, but it does not make things happen because of that.
• There can exist spurious correlations. Correlations can arise because of the action of a third unmeasured or unknown variable. In many situations, correlation can be high without any solid foundation.

EXAMPLE

Suppose that the principal of a college wants to know if there exists any correlation between grades in Mathematics and grades in Statistics. A random sample of 9 students is selected:

A scatter diagram is plotted with Marks in Mathematics on the X-axis and Marks in Statistics on the Y-axis, showing an upward trend.

To compute the correlation coefficient, the following calculations are made:

📌 Example: Using the shortcut formula: r = [3109 – (156)(168)/9] / √[ [3024 – (156)²/9] [3294 – (168)²/9] ]

Step 1: Calculate numerator = 3109 – 2912 = 197 Step 2: Calculate denominator: [3024 – 2704] = 320 [3294 – 3136] = 158 √(320 × 158) = √50560 = 224.86

Step 3: r = 197 / 224.86 = 0.88

There exists a strong positive linear correlation between marks in Mathematics and marks in Statistics for these 9 students.

EXCEL Tools

• For summary of sample statistics, use: Tools / Data Analysis / Descriptive Statistics
• For individual sample statistics, use: Insert / Function / Statistical and select the function you need.

EXCEL Functions

• In EXCEL, use the CORREL function to calculate correlations.
• The correlation coefficient is also given on the output from TOOLS, DATA ANALYSIS, CORRELATION or REGRESSION.

Scatter Diagram Two Variables

You can develop a scatter diagram using EXCEL chart wizard. A scatter diagram of Advertisement and Sales over the years shows that you cannot always draw conclusions about the degree of association. However, a scatter diagram for sales versus advertisement shows a fairly high degree of association, with a positive and linear relationship.

CORRELATION COEFFICIENT USING EXCEL

The correlation coefficient for two streams of data was calculated using the formula Cov(x,y)/Sx.Sy. For a dataset with variables x (cells A67 to A71) and y (cells B67 to B71), calculations for x², y², xy, X̄, Ȳ, and Cov(x,y) were made in columns C, D, E, F, and G respectively. Key Excel formulas used:

• Cell A72: Sum of x (=SUM(A67:A71))
• Cell B72: Sum of y (=SUM(B67:B71))
• Cell F72: Mean of x (=A72/5)
• Cell G72: Mean of y (=B72/5)
• Cell F73: Sx (=SQRT(C72/5 – F72*F72))
• Cell G73: Sy (=SQRT(D72/5 – G72*G72))
• Cell H73: Cov(x,y) (=E72/5 – F72*G72)
• Cell H74: Correlation coefficient (=H73/(F73*G73))

CORREL function syntax: CORREL(array1, array2)

• Array1 is a cell range of values.
• Array2 is a second cell range of values.

Remarks:

• Arguments must be numbers or references containing numbers.
• Text, logical values, or empty cells are ignored.
• Arrays must have the same number of data points, or #N/A error results.
• If either array is empty or standard deviation is zero, #DIV/0! error results.

In an Excel example, with X and Y arrays in cells A79 to A83 and B79 to B83 respectively, the formula =CORREL(A79:A83, B79:B83) entered in cell D84 gives a correlation coefficient (r) of 0.8.

⭐ Key Takeaways

The correlation coefficient (r) is a pure number between -1 and 1 that measures the strength and direction of a linear relationship between two random variables, with sign indicating direction and magnitude indicating strength. You must remember the shortcut formula r = [ΣXY – (ΣX)(ΣY)/n] / √[ [ΣX² – (ΣX)²/n] [ΣY² – (ΣY)²/n] ] for manual calculation. Critically, correlation does not imply causation — a high r may result from a third unmeasured variable or be spurious. Correlation analysis determines the degree of association between variables, while regression analysis is used for prediction. Finally, you can efficiently compute r in Excel using either the CORREL function or the Data Analysis Toolpak.

🧠 Quick Revision Questions

1. What is the range of possible values for the correlation coefficient r, and what do the extreme values (-1, 0, +1) indicate?
2. Why does a high correlation coefficient (e.g., r = 0.9) not necessarily mean that one variable causes the other?
3. In the example calculating correlation between Mathematics and Statistics marks, what was the computed value of r and what does it tell us about the relationship?
4. What is the difference between correlation analysis and regression analysis?
5. What Excel function would you use to directly calculate the correlation coefficient between two arrays?

📘 Lecture 30 — Measures of Dispersion

📖 Overview: This lecture covers the process of line fitting and introduces how to use Microsoft Excel's built-in statistical analysis tools, including the Analysis ToolPak, to compute sample statistics, the slope, and the intercept of a linear regression line. Understanding these techniques is crucial for analyzing relationships between variables and making predictions from data.

🗂️ Topics Covered

The lecture begins with a review of sample statistics and instructions for using Excel to generate them via the Data Analysis ToolPak. The main focus is on fitting a straight line to data, with detailed explanations of the SLOPE and INTERCEPT functions, including their syntax, equations, and practical examples.

📝 Lecture Summary

EXCEL SUMMARY OF SAMPLE STATISTICS

To obtain a comprehensive set of descriptive statistics for a dataset, Excel provides a dedicated tool. You can access this by navigating to Tools > Data Analysis > Descriptive Statistics. This generates a summary table including mean, median, mode, standard deviation, and more. For a single, specific statistic (e.g., just the mean), you can use Insert > Function > Statistical and then choose the specific function you require.

💡 Why this matters: The Descriptive Statistics tool automates the calculation of many key measures, saving time and reducing calculation errors compared to manual computation.

EXCEL STATISTICAL ANALYSIS TOOL

Excel's Data Analysis add-in provides access to various statistical procedures, including regression analysis. To use it: first click Data Analysis on the Tools menu. If it is not visible, you need to load the Analysis ToolPak. In the Data Analysis dialog box, select the tool you need (e.g., Regression) and set the required analysis options. The Help button provides further details on each option.

LOAD THE ANALYSIS TOOLPAK

If the Data Analysis command is not on the Tools menu, you must load the Analysis ToolPak add-in. To do this: click Add-Ins on the Tools menu. In the Add-Ins available list, check the box for Analysis ToolPak, and then click OK. Follow any subsequent setup instructions from the installation program.

SLOPE

The SLOPE function returns the slope of the linear regression line that best fits a set of data points. The slope represents the rate of change of the dependent variable (y) with respect to the independent variable (x). It is calculated as the vertical distance divided by the horizontal distance between any two points on the line.

🔑 Definition — Linear Regression Line: The best-fitting straight line through a set of data points, used to model the relationship between two variables.

📐 Formula: The equation for the slope ((b)) of the regression line is:

[ b = \frac{n\sum xy - (\sum x)(\sum y)}{n\sum x^2 - (\sum x)^2} ]

• (n) = number of data points
• (x) = independent variable
• (y) = dependent variable

→ Plain-English Meaning: This formula calculates the steepness and direction of the best-fit line by measuring how much y changes for each unit change in x.

Syntax: SLOPE(known_y's, known_x's)

• known_y's: The array or cell range of numeric dependent data points.
• known_x's: The array or cell range of independent data points.

Remarks:

• Arguments must be numbers or references containing numbers. Text, logical values, or empty cells are ignored; zero values are included.
• If known_y's and known_x's are empty or have a different number of data points, SLOPE returns the #N/A error value.

📌 Example: Given known y-values in cells A4:A10 and known x-values in cells B4:B10, the formula =SLOPE(A4:A10, B4:B10) is entered in cell A11. The result displayed in cell B12 is 0.305556, representing the slope of the regression line.

INTERCEPT

The INTERCEPT function calculates the point where a line will intersect the y-axis (the y-intercept) using existing x-values and y-values. The intercept point is determined by the best-fit regression line. Use this function to find the value of the dependent variable when the independent variable is 0 (zero). For example, it can predict a metal's electrical resistance at 0°C when data points were taken at room temperature and higher.

🔑 Definition — y-Intercept: The value of y when x equals 0; the point where the regression line crosses the y-axis.

📐 Formula: The equation for the intercept ((a)) of the regression line is:

[ a = \bar{y} - b\bar{x} ]

where the slope (b) is calculated as:

[ b = \frac{n\sum xy - (\sum x)(\sum y)}{n\sum x^2 - (\sum x)^2} ]

• (\bar{y}) = mean of y-values
• (\bar{x}) = mean of x-values

→ Plain-English Meaning: The intercept is calculated by taking the mean of y and subtracting the product of the slope and the mean of x.

Syntax: INTERCEPT(known_y's, known_x's)

• known_y's: The dependent set of observations or data.
• known_x's: The independent set of observations or data.

Remarks:

• Arguments must be numbers or references containing numbers. Text, logical values, or empty cells are ignored; zero values are included.
• If known_y's and known_x's contain a different number of data points or no data points, INTERCEPT returns the #N/A error value.

📌 Example: Given y-values in cells A18:A22 and x-values in cells B18:B22, the formula =INTERCEPT(A18:A22, B18:B22) is entered in cell A24. The answer displayed in cell B25 is 0.048387, representing the y-intercept of the regression line.

⭐ Key Takeaways

Students must remember how to load and use Excel’s Analysis ToolPak for data analysis and specifically the Descriptive Statistics tool for a quick summary. The SLOPE and INTERCEPT functions are the core of line fitting, providing the coefficients (b and a) for the linear regression equation (y = a + bx). The formulas for slope and intercept are essential, as is understanding that slope measures the rate of change and intercept gives the predicted y-value when x=0. Always ensure the x and y data ranges have the same number of data points to avoid #N/A errors.

🧠 Quick Revision Questions

1. Which menu path do you use in Excel to access the Descriptive Statistics tool?
2. What does the SLOPE function calculate and what does it represent in a linear regression?
3. Write the formula for the y-intercept of a regression line, using the sample means and the slope.
4. What error value does the INTERCEPT function return if known_y's and known_x's contain a different number of data points?
5. Describe a practical scenario where you would use the INTERCEPT function to make a prediction.

📘 Lecture 31 — Line Fitting Part 2

📖 Overview: This lecture continues the study of line fitting by introducing population and sample linear regression models. It covers the mathematical representation of linear relationships, calculation of regression coefficients, and the use of EXCEL’s Regression Tool for data analysis, along with testing the significance of correlation coefficients.

🗂️ Topics Covered

The lecture reviews types of regression models including population and sample linear regression, the linear function equation with Y-intercept and slope, and the interpretation of these parameters. It provides a complete regression equation example with calculations, demonstrates EXCEL’s Data Analysis Regression Tool with step-by-step instructions, explains EXCEL output components like Multiple R, R Square, and P-value, and concludes with sampling distribution in r and significance testing using critical value tables.

📝 Lecture Summary

Objectives

This lecture reviews concepts from Lecture 30 and continues the topic of Line Fitting. The main objective is to learn about regression models and how to fit a straight line to data.

Types of Regression Models

There are different types of regression models. The simplest is the Simple Linear Regression Model, which represents a relationship between variables that can be represented by a straight line equation. To determine whether a linear relationship exists, a Scatter Diagram is developed first.

In linear regression, two types of models are considered. The Population Linear Regression represents the linear relationship between the variables of the entire population (all data). It is customary to carry out sample surveys and determine linear relationships between two variables based on sample data. Such regression analysis is called Sample Linear Regression.

Relationship between Variables

The relationship between variables is described by a Linear Function. The change of one variable causes the other variable to change. The relationship describes the dependency of one variable on the other.

If the relationship between the variables is exactly linear, the mathematical equation describing the linear relation is written as:

Y = a + bX

Where:

• Y represents the dependent variable
• X represents the independent variable
• a represents the Y-intercept (the value of Y when X is equal to zero)
• b represents the slope of the line (the value of tan θ, where θ represents the angle between the line and the horizontal axis)

Interpretation of ‘a’ and ‘b’

A very important point is that MANY lines can be drawn through the same scatter diagram.

In contrast to exact relationships, some situations involve non-exact linear relationships. For this, an unknown random error variable is added:

Yᵢ = a + bXᵢ + eᵢ

The distance of the points from the regression line (obtained by inserting values of X into the equation) is the random error. The intercept is shown on the Y-axis.

For the sample regression equation, the intercept is denoted as B₀, the slope as B₁, and the random error as e₁. These different notations distinguish between population regression and sample regression.

Regression Equation Example

Problem: Compute the least square regression equation of Y on X for the following data:

Solution:

The estimated regression line of Y on X is:

Ŷ = a + bX

From the previous lecture, the equation for the slope of the regression line is:

b = [n∑XY - (∑X)(∑Y)] / [n∑X² - (∑X)²]

And the equation for the intercept is:

a = Ȳ - bX̄

From the given data:

X̄ = ∑X/n = 102/9 = 11.33

Ȳ = ∑Y/n = 302/9 = 33.56

b = [n∑XY - (∑X)(∑Y)] / [n∑X² - (∑X)²] = 2.831

a = Ȳ - bX̄ = 33.56 - (2.831)(11.83) = 1.47

Hence, the desired estimated regression line is:

Ŷ = 1.47 + 2.831X

🔑 Definition — Least Squares Regression Line: The line that minimizes the sum of the squared vertical distances between the observed data points and the line itself.

📐 Formula: Ŷ = a + bX → The predicted value of the dependent variable equals the Y-intercept plus the slope multiplied by the independent variable.

📌 Example: For X = 10, Ŷ = 1.47 + 2.831(10) = 29.78. For X = 17, Ŷ = 1.47 + 2.831(17) = 49.60.

EXCEL Regression Tool

Regression Analysis can be carried out easily using EXCEL’s Regression Tool. The process involves:

1. Going to the Tools menu and selecting the Data Analysis menu
2. Selecting the Regression analysis tool and clicking OK
3. In the Regression dialog box, specifying the Input Y Range and Input X Range
4. Optionally specifying labels, confidence level, and output range
5. Clicking OK to generate the SUMMARY OUTPUT

The EXCEL Regression Tool generates detailed output including:

Multiple R — The Correlation Coefficient R Square — The Coefficient of determination Standard Error of Mean (STEM) — Standard deviation of population/sample size T-Statistic — (sample slope – population slope) / Standard error

RSQ Function

There is a separate function RSQ in EXCEL to calculate the coefficient of determination (square of r). The r-squared value can be interpreted as the proportion of the variance in y attributable to the variance in x.

Syntax: RSQ(known_y’s, known_x’s)

Example: =RSQ(A2:A8,B2:B8) returns 0.05795

P-Value

In the EXCEL Regression Tool, the P-value is defined as the probability of not getting a sample slope as high as the calculated value. The smaller the value, the more significant the result. In the example, P-value = 0.000133, meaning the slope is very significantly different from zero.

💡 Why this matters: A small P-value indicates that X and Y are strongly associated, and the relationship is statistically significant.

Sampling Distribution in r

It is possible to construct a sampling distribution for r similar to those for sampling distributions for means and percentages. Tables give minimum values of r (ignoring sign) for a given sample size to demonstrate a significant non-zero correlation at various significance levels.

Note: v = degrees of freedom = n - 2 in all these calculations.

Sampling Distribution in r — Example 1

Problem: Sample size n = 5. Null hypothesis: r = 0. Calculated coefficient = 0.8. Test significance at 5% confidence level.

Solution: Look in the table at row with v = n - 2 = 3 and column headed by 0.05.

The tabulated value from the Pearson Product-Moment Correlation Coefficient Table of Critical Values = 0.878.

Sample value of 0.8 is less than 0.878.

Conclusion: Correlation is not significantly different from zero at 5% level. Variables are not strongly associated.

Sampling Distribution in r — Example 2

Problem: Sample size n = 5. Null hypothesis: r = 0. Calculated coefficient = -0.95. Test significance at 5% confidence level.

Solution: Look at row with v = 3 and column headed by 0.05. Tabulated value = 0.878.

Sample value of 0.95 (ignoring sign) is greater than 0.878.

Conclusion: Correlation is significantly different from zero at 5% level. Variables are strongly associated.

⭐ Key Takeaways

The estimated regression line follows the form Ŷ = a + bX, where the slope b measures the change in Y per unit change in X and the intercept a is the value of Y when X is zero. The least squares method minimizes error by calculating b using the formula [n∑XY - (∑X)(∑Y)] / [n∑X² - (∑X)²] and a using Ȳ - bX̄. EXCEL’s Regression Tool provides key outputs including Multiple R (correlation coefficient), R Square (coefficient of determination), and P-value (significance measure). For testing whether a correlation is significant, compare the calculated r value (ignoring sign) to the critical value from the table at degrees of freedom n-2; if the calculated r exceeds the tabulated value, the correlation is significantly different from zero.

🧠 Quick Revision Questions

1. What is the formula for the slope b in least squares regression, and what do ∑XY, ∑X, ∑Y, and n represent?
2. In the regression equation Ŷ = 1.47 + 2.831X, what is the predicted value of Y when X = 10?
3. How do you interpret the R Square value in EXCEL regression output?
4. For a sample size of n = 7, what is the degrees of freedom (v) when testing significance of correlation?
5. If the calculated correlation coefficient is 0.6 and the tabulated critical value at 5% level is 0.754, what conclusion can you draw?

📘 Lecture 32 — Time Series and Exponential Smoothing Part 1

📖 Overview: This lecture begins with a review of simple linear regression, including calculation and interpretation of the regression equation using a store sales example. It then introduces time series analysis, focusing on graphical examination of trends and seasonal variations, and explains the moving averages method for extracting trends from data with repeating patterns.

🗂️ Topics Covered

The lecture reviews simple linear regression with a complete worked example using store square footage and sales data, including scatter diagram preparation and regression equation calculation using both manual formulas and Excel’s Regression Tool. It then covers time series concepts including examination of graph trends, extraction of trend from data, moving averages calculation, and analysis of seasonal variations by comparing actual values to trend values.

📝 Lecture Summary

SIMPLE LINEAR REGRESSION EQUATION. EXAMPLE

The lecture reviews regression analysis using data from 7 stores showing square footage (X) and annual sales (Y). A scatter diagram prepared using Excel Chart Wizard shows a clear positive linear relationship between area and sales, confirming that regression analysis is appropriate.

The estimated regression line is: Ŷ = a + bX

From the given data, calculations yield:

• ΣX = 16452, ΣY = 35913, ΣXY = 104841549, ΣX² = 52413218
• X̄ = 16452/7 = 2350.29
• Ȳ = 35913/7 = 5130.429

🔑 Definition — Slope (b): The change in Y for a one-unit change in X 📐 Formula: b = [nΣXY – (ΣX)(ΣY)] / [nΣX² – (ΣX)²] → b = 1.4866 This means for every increase of 1 sq. ft., sales increase by 1.4866 units.

🔑 Definition — Intercept (a): The value of Y when X equals zero 📐 Formula: a = Ȳ – bX̄ → a = 5130.43 – (1.4866)(2350.29) = 1636.489

📌 Example: The estimated regression line is Ŷ = 1636.489 + 1.4866X Using Excel’s Regression Tool confirms these results. The interpretation is that for every increase of 1 sq. ft., there is a sale of 1.487 units or 1407 Rs (since each unit was equal to 1,000). This equation can now be used to estimate sales for stores of other sizes.

💡 Why this matters: The regression equation enables prediction of sales based on store size, which is valuable for business planning and investment decisions.

CHART WIZARD

The lecture demonstrates using Excel’s Chart Wizard through 4 steps to create various graphs. The process involves selecting data, choosing chart type (Column Graph), entering chart title and axis labels, and selecting output location.

📌 Example: A column graph was created to visualize sales data. Additionally, a side-by-side chart and a line graph were prepared, with the line graph clearly showing seasonal variations in sales values.

EXAMINATION OF GRAPH TREND

The graph reveals several components of time series data:

• Trend: General upward or downward steady behavior of figures
• Seasonal Variations: Variations that repeat regularly over short term (less than a year)
• Random Effect: Variations due to unpredictable situations
• Cyclical Variations: Alternation of upward and downward movement

EXTRACTING THE TREND FROM DATA

Given data: 170, 140, 230, 176, 152, 233, 182, 161, 242

First step: Plot figures on graph with horizontal axis as period 1 and vertical axis as period 2.

Conclusion: There is a marked pattern that repeats itself, and a well-established method exists to extract trend with strong repeating patterns.

MOVING AVERAGES

Moving averages is a method to extract trend from data with seasonal patterns. For sales data across morning, afternoon, and evening for 3 days:

📌 Example: First Average (Day 1) = (170 + 140 + 230)/3 = 180 Next Average (Morning, dropping 170, adding 176) = (140 + 230 + 176)/3 = 182 Alternative method: Last average + (176 – 170)/3 = 180 + 2 = 182

⚠️ Caution: The alternative mental arithmetic method can lead to errors. It is recommended to use Excel worksheets for accurate calculations.

The moving averages were plotted, showing that seasonal variation disappears and a clear trend of increase in sales emerges. This demonstrates that moving averages can be used for forecasting purposes.

💡 Why this matters: Moving averages smooth out short-term fluctuations to reveal underlying trends, making them valuable for forecasting.

ANALYSING SEASONAL VARIATIONS

To find how much each period differs from trend: Seasonal Variation = Actual – Trend

📌 Example: Day 1, Afternoon Actual = 180, Trend = 140 Seasonal Variation = 140 – 180 = -40

Similarly, other seasonal variations can be calculated for each period.

⭐ Key Takeaways

The regression equation Ŷ = 1636.489 + 1.4866X allows prediction of annual sales from store square footage, with each additional square foot corresponding to 1.4866 units (or 1407 Rs) in sales. Time series data consists of four components: trend, seasonal variations (repeating within a year), cyclical variations (longer-term up/down movements), and random effects. Moving averages effectively remove seasonal variations to reveal the underlying trend, as demonstrated with the three-period moving average example. Seasonal variations are calculated as the difference between actual values and trend values, with negative values indicating periods below trend. Excel’s Chart Wizard and Regression Tool are powerful for automating these analyses.

🧠 Quick Revision Questions

1. Using the regression equation Ŷ = 1636.489 + 1.4866X, what would be the predicted sales for a store with 2000 square feet?
2. What are the four components of a time series, and how do seasonal variations differ from cyclical variations?
3. If the first three values in a moving average calculation are 170, 140, and 230, what is the first moving average, and what value is added/dropped to calculate the next moving average?
4. How is seasonal variation calculated, and what does a negative seasonal variation indicate?
5. What advantage does using Excel worksheets provide over mental arithmetic when calculating moving averages?

📘 Lecture 33 — Time Series and Exponential Smoothing Part 2

📖 Overview: This lecture continues the study of time series analysis, focusing on extracting trend, seasonal variations, and random variations from moving averages. It demonstrates how to forecast future values by combining trend estimates with seasonal adjustments, and introduces the concept of exponential smoothing for unpredictable data patterns.

🗂️ Topics Covered

The lecture reviews trend calculation as the difference between moving average and actual data, followed by extracting seasonal variations by averaging these differences for each time period. It then covers extracting random variations, forecasting using trend plus seasonal adjustment, and handling seasonal variations with centred moving averages. Finally, it addresses forecasting in unpredictable situations and introduces the basic concept of exponential smoothing.

📝 Lecture Summary

TREND

As discussed briefly in the handout for lecture 32, the trend is given by the moving average minus the actual data. Look at the slide shown below. The average of the morning, afternoon and evening of the first day is 180. This value is written in cell I179, which is the middle value for first day. The next moving average is written in cell I180. This means that the last moving average will be written in cell I185 as the moving average of the morning, afternoon and evening of 3rd day will be written against the middle value in cell F185. Now that all the moving averages have been worked out we can calculate the trend as difference of moving average and actual value.

The actual trend figures are now written as shown in the slide below with M for morning, A for afternoon and E for evening. The titles Day 1, day 2 and Day 3 were written on the left hand side of the table. Further Total for each column was calculated. The total was divided by the non-zero values in the column. For example, in column M, there are 2 non-zero values. Hence, the total 20 was divided by 2 to obtain the average -10. Similarly, the averages in column A and E were calculated. This data is the seasonal variation and can now be used for estimating trend and random variations.

💡 Why this matters: The seasonal variation values are constant adjustments that will be added to or subtracted from trend values to make forecasts.

EXTRACTING RANDOM VARIATIONS

Day 1 Afternoon:

• Trend = 180
• Seasonal variation = 36
• Trend – variation = 180 – 36 = 144
• Actual value = 140
• Random variation = 140 – 144 = -4

Conclusion: Expected = Trend + Seasonal. Random = Actual – Expected.

FORECAST FOR DAY 4

= Trend for afternoon of day 4 + Seasonal adjustment for afternoon period.

Trend = 180 to 195 (6 intervals) = 15/6 = 2.5 per period

• Figure for evening of day 3 = 195 + 2.5 = 197.5
• Morning of day 4 = 197.5 + 2.5 = 200
• Afternoon of day 4 = 200 + 2.5 = 202.5

After adjustment of seasonal variation = -36 = 202.5 – 36 = 166.5 or 166

📌 Example: The trend increases by 2.5 per period. Starting from 195 in the evening of day 3, after 3 periods we reach afternoon of day 4 at 202.5. Subtracting the seasonal adjustment of 36 gives a final forecast of 166.

SEASONAL VARIATIONS

Seasonal Variations are regarded as constant amount added to or subtracted from the trends. This is a reasonable assumption as seasonal peaks and troughs are roughly of constant size. In practice Seasonal variations will not be constant. These will themselves vary as trend increases or decreases. Peaks and troughs can become less pronounced. Seasonal variations as well as the trend are shown in the graph below. You can see that the trend clearly shows a downward slide in values.

In the following slide, the actual values are for 4 quarters per year. Here there is no middle value per year. The moving averages were therefore summarised against the 3rd quarter. As this does not reflect the correct position, the average of the first two moving averages was calculated and written as centred moving average in column H. The first centred moving average is the average of 141 and 138 or 139.5. This is used as the trend and the value Actual-Trend is the difference of Actual – Centred Moving Average. Here also the last row does not have a value as the moving average was shifted one position upwards.

The data from the previous slide was summarised as in the following slide using the approach described earlier. It may be seen that the average seasonal variation for Spring, Summer, Autumn and Winter is -8, -88.8, 29.5 and 65.3 respectively.

The expected value now is the sum of centred moving average and random variation. The random variation is the difference between the Actual and Expected value. This gives us a complete table with all the values.

FORECASTING APPLE PIE SALES

Sale steadily declined from 139.0 to 130.5. Over 4 quarters, the sales declined by = 139.0 – 130.5 = 8.5. Trend in Spring 1995 was 133.5. We can assume annual decrease as on the basis of decline over the last 4 quarters = 8.5. Trend in 1996 = trend in 1995 less decline = 133.5 – 8.5 = 125. Seasonal variation as already worked out = -8. Hence: Final forecast = 125 – 8 = 117.

📌 Example: To forecast Apple Pie sales for Spring 1996, start with the 1995 Spring trend of 133.5, subtract the annual decline of 8.5 to get 125, then subtract the Spring seasonal variation of 8 to get 117.

FORECASTING IN UNPREDICTABLE SITUATIONS

Two methods were studied above. Each one has certain features. If there is steady increase in data and repeated seasonal variations, there are many cases that do not conform to these patterns. There may not be a trend. There may not be a short term pattern. Figures may hover around an average mark. How to forecast under such conditions? Data for sales over a period of 8 weeks is summarized and plotted in the slide below. You may see that the values hover around an average value without any particular pattern. This problem requires a different solution.

FORECAST

Let us assume that the forecast for week 2 is the same as the actual data for week 1, that is 4500.

The Actual sale was 4000. Thus, the Forecast is 500 too high.

Another approach would be to incorporate the proportion of error in the estimate as follows:

🔑 Definition — Exponential Smoothing: new forecast = old forecast + proportion of error α. Or new forecast = old forecast + α × (old actual – old forecast).

This method is called Exponential Smoothing. We shall learn more about this method in lecture 34.

📐 Formula: new forecast = old forecast + α × (old actual – old forecast) → The new forecast adjusts the old forecast by adding a fraction (α) of the forecasting error from the previous period.

⭐ Key Takeaways

The lecture systematically demonstrates how to decompose a time series into trend, seasonal, and random components by first computing moving averages to establish the trend, then averaging the differences between actual values and moving averages to find seasonal variations. Forecasts are made by projecting the trend forward using the average per-period change and then adding the seasonal adjustment for the relevant period. For data without clear trends or patterns, simple forecasting methods like using the previous period's actual value as the forecast are unreliable, leading to the introduction of exponential smoothing where the new forecast is the old forecast plus a proportion of the error. The key formulas and steps for computing centred moving averages when there is no natural middle point are also essential.

🧠 Quick Revision Questions

1. How is the trend value calculated from a moving average and actual data?
2. What is the formula for extracting random variation from a time series?
3. How do you forecast a future value when you have the projected trend and the seasonal variation?
4. What is a centred moving average and when is it necessary to use one?
5. What is the basic formula for exponential smoothing and what does the proportion of error (α) represent?

📘 Lecture 34 — FACTORIALS, PERMUTATIONS AND COMBINATIONS

📖 Overview: This lecture covers the review of exponential smoothing from Lecture 33, introduces the concept of factorials, and explains permutations and combinations. Understanding these concepts is essential for probability calculations, counting problems, and statistical analysis.

🗂️ Topics Covered

The lecture begins with a review of exponential smoothing, including the forecast formula, alpha values, Mean Square Error (MSE), and the Excel Exponential Smoothing Tool. It then introduces factorials with definitions and examples, followed by the fundamental counting principle (multiplication rule). Finally, permutations are covered in detail, including the formula nPr, permutations of n objects taken r at a time, permutations with repeated objects, and the Excel PERMUT function.

📝 Lecture Summary

Review Lecture 33 - Exponential Smoothing

The lecture begins by revisiting exponential smoothing from Lecture 33. Using α = 0.3, the forecast for week 3 is calculated as: Forecast week 3 = week 2 forecast + α × (week 2 actual sale – week 2 forecast) = 4500 – 0.3 × 500 = 4350. The overestimate is reduced by 30% of the error margin of 500. This method is called Exponential Smoothing and α is the Smoothing Constant.

The general rule for obtaining a forecast is: Let A = Actual and F = Forecast. Then: F(t) = F(t-1) + α(A(t-1) – F(t-1)) = αA(t-1) + (1-α)F(t-1). By substituting F(t-1) = αA(t-2) + (1-α)F(t-2), we get F3 = α[A(t-1) + (1-α)A(t-2)] + (1-α)²F(t-2). Continuing this substitution yields: F(t) = α[A(t-1) + (1-α)A(t-2) + (1-α)²A(t-3)] + (1-α)F(t-3).

💡 Why this matters: Exponential smoothing gives more weight to recent observations and less weight to older ones, making it a powerful forecasting tool.

The accepted criterion for evaluating forecasts is Mean Square Error (MSE). MSE is found by squaring all errors, including the present one, and dividing by the number of periods included. A sign of a good forecast is when MSE stabilizes. Generally, alpha between 0.1 and 0.3 performs best.

Excel Exponential Smoothing Tool

The Exponential Smoothing Tool in Excel can be used to perform this analysis. The dialog box includes:

• Input Range: The cell reference for the data (a single column or row with 4+ cells).
• Damping factor: The exponential smoothing constant (default is 0.3). Values of 0.2 to 0.3 are reasonable smoothing constants, indicating the current forecast should be adjusted 20-30% for error in the prior forecast. Larger constants yield faster response but can produce erratic projections; smaller constants can result in long lags.
• Labels: Select if the first row/column contains labels.
• Output Range: Reference for the upper-left cell of the output table.
• Chart Output: Select to generate an embedded chart for actual and forecast values.
• Standard Errors: Select to include a column with standard error values.

Factorials

Factorials are defined for natural numbers (1, 2, 3,...). For example, Five Factorial is: 5! = 5·4·3·2·1 = 1·2·3·4·5 = 120. Similarly, Ten Factorial = 1·2·3·4·5·6·7·8·9·10 = 3,628,800.

In general: n! = n(n-1)(n-2)...3·2·1 or n! = n(n-1)!.

🔑 Definition — Factorial: The product of all positive integers from 1 to n, denoted by n!.

📐 Formula: n! = n(n-1)(n-2)! or n! = n(n-1)! Example 1: 8!/5! = 8·7·6·5!/5! = 8·7·6 = 336 Example 2: 12!/9! = 12·11·10·9!/9! = 12·11·10 = 1320 Example 3: 10!8!/9!5! = (10·9!)(8·7·6·5!)/(9!5!) = 10·8·7·6 = 3360

Ways (Fundamental Counting Principle)

If operation A can be performed in m ways and operation B in n ways, then the two operations can be performed together in m·n ways.

Example: A coin can be tossed in 2 ways. A die can be thrown in 6 ways. A coin and a die together can be thrown in 2·6 = 12 ways.

Permutations

An arrangement of all or some of a set of objects in a definite order is called a permutation.

🔑 Definition — Permutation (nPr): The number of ways to arrange r objects selected from n distinct objects where order matters.

📐 Formula: nPr = n!/(n-r)!

Example 1: There are 4 objects A, B, C, D. Permutations of 2 objects A & B: AB, BA. Permutations of 3 objects A, B, C: ABC, ACB, BCA, BAC, CAB, CBA.

Example 2: Number of permutations of 3 objects taken 2 at a time = 3P2 = 3!/(3-2)! = 3·2 = 6 = AB, BA, AC, CA, BC, CB.

Example 3 - Movie Problem: You have 6 movies showing at 2:00, 4:00, and 6:00 pm. How many ways can you watch 3 different movies? P(6, 3) = 6!/(6-3)! = 6!/3! = 6·5·4·3!/3! = 120 ways.

Example 4 - Lottery: Suppose there are 100 numbers (00 to 99), you choose 5 numbers in specific order without replacement. Number of ways: P(100,5) = 100!/(100-5)! = 9,034,502,400 ways. Your chance of winning is 1 in 9,034,502,400.

Example 5 - Spy Problem: A spy has 8 cards, needs 5 in correct order. Number of permutations: P(8,5) = 8!/3! = 6720. Chance of correct sequence: 1/6720 = 0.00015 = 0.015%.

Permutations of n Objects with Repetitions

Number of n permutations of n different objects taken n at a time: nPn = n!/(n-n)! = n!/0! = n!/1 = n!

For permutations of n objects where n₁ are alike of one kind, n₂ are alike of another kind, and nₖ are alike:

📐 Formula: n!/(n₁!n₂!...nₖ!)

Example: How many permutations can be formed from the word STATISTICS? S=3, A=1, T=3, I=2, C=1 nPr = 10!/(3!1!3!2!1!) = 10·9·8·7·6·5·4·3!/(3!3!2!) = 50,400 permutations.

Excel PERMUT Function

The Excel PERMUT function returns the number of permutations for a given number of objects selected from number objects.

Syntax: PERMUT(number, number_chosen)

• Number: An integer describing the number of objects
• Number_chosen: An integer describing the number of objects in each permutation

Equation: P(n, r) = n!/(n-r)!

Example: For a lottery with 3 numbers from 0-99 (100 possibilities): PERMUT(100, 3) = 100!/(100-3)! = 970,200 possible permutations.

⭐ Key Takeaways

In exponential smoothing, the forecast is updated by adding α multiplied by the error (difference between actual and forecast) to the previous forecast, with α (smoothing constant) typically between 0.1 and 0.3. Factorials (n!) are products of all positive integers from 1 to n, and n! = n(n-1)!. The fundamental counting principle states that if operation A has m ways and B has n ways, then both together have m·n ways. Permutations (nPr) are arrangements where order matters, calculated as n!/(n-r)!, and permutations with repeated objects use the formula n!/(n₁!n₂!...nₖ!). The Excel PERMUT function can calculate permutations automatically.

🧠 Quick Revision Questions

1. Calculate the exponential smoothing forecast for week 3 if week 2 forecast is 4500, actual sale is 5000, and α = 0.3.
2. What is the value of 5! and how is it calculated?
3. If you have 8 books and want to arrange 3 on a shelf, how many different arrangements are possible?
4. How many permutations can be formed from the word "MISSISSIPPI"?
5. In Excel, which function calculates permutations, and what is its formula?

📘 Lecture 35 — COMBINATIONS ELEMENTARY PROBABILITY PART 1

📖 Overview: This lecture introduces combinations as arrangements where order does not matter, contrasting them with permutations through clear examples. It then transitions into elementary probability, covering foundational concepts like sample space, events, and the key rules (OR rule and AND rule) for calculating probabilities, with applications to business decision-making.

🗂️ Topics Covered

The lecture begins by reviewing combinations, their formula, and the critical difference from permutations, illustrated with examples like team selection and ball picking. It then covers important combinatorial results and their application in binomial expansion. The second half introduces fundamental probability concepts: sample space, events, theoretical and empirical probability, the OR rule for mutually exclusive events, the AND rule for joint events, and the concept of exhaustive events, all demonstrated with practical business and manufacturing examples.

📝 Lecture Summary

COMBINATIONS

Combinations are arrangements of objects where the order in which they are arranged does not matter. The number of combinations of n objects taken r at a time is given by a specific formula.

🔑 Definition — Combination: An arrangement of objects without caring for the order in which they are arranged.

📐 Formula: $nCr = \frac{n!}{r!(n-r)!}$ where n is the total number of objects and r is the number of objects selected at a time.

📌 Example: Number of combinations of 3 different objects A, B, C taken two at a time = $3!/2!(3-2)! = 6/2 = 3$. These combinations are: AB, AC, and BC.

COMBINATIONS EXAMPLES

Example 3: In how many ways a team of 11 players be chosen from a total of 15 players?

• $n=15, r=11$
• $15C11 = \frac{15!}{11!(15-11)!} = \frac{15!}{11!(4!)} = \frac{15.14.13.12.11!}{11!(4.3.2.1)} = \frac{15.14.13.12}{24} = 1365$ Ways

Example 4: There are 5 white balls and 4 black balls. In how many ways can we select 3 white and 2 black balls?

• $5C3 \times 4C2 = \frac{5!}{3!(5-3)!} \times \frac{4!}{2!(4-2)!} = \frac{5!}{3!2!} \times \frac{4!}{2!2!} = 10 \times 6 = 60$ ways

Example 5: If a committee of 3 people is to be selected from among 5 married couples so that the committee does not include two people who are married to each other, how many such committees are possible?

• Solution:
  • Total ways of picking 3 out of 10 people = $10C3 = 120$
  • Ways with a married couple: A set can have any of the five married couples (5 ways) x The third person can be any one of the remaining eight (8 ways) = $5 \times 8 = 40$
  • Number of combinations without any married couples = $120 - 40 = 80$

RESULTS OF SOME COMBINATIONS

These are important for simplifying calculations, especially in Binomial Expansion.

• $nC0 = nCn = 1$ (e.g., $4C0 = 4C4 = 1$)
• $nC1 = nCn-1 = n$ (e.g., $4C1 = 4C3 = 4$)
• $nCr = nCn-r$ (e.g., $5C2 = 5C3$)

BINOMIAL EXPANSION

An expression consisting of two terms joined by + or – sign is called a Binomial Expression. The right-hand side of expanded binomials are called Binomial Expansions.

🔑 Definition — Binomial Expansion: The expansion of a binomial expression (like $(x+y)^n$) where the coefficients can be written in combinatorial notation.

📌 Example: $(x+y)^5 = 5C0.x^5 + 5C1x^4y + 5C2x^3y^2 + 5C3x^2y^3 + 5C4xy^4 + 5C5y^5$ which simplifies to $x^5 + 5x^4y + 10x^3y^2 + 10x^2y^3 + 5xy^4 + y^5$.

Calculation of Binomial Expansion Coefficients:

• Coefficient of first and last term is always 1.
• Coefficient of any other term = (coefficient of previous term) * (power of x from previous term) / number of that term.
• 📌 Example:
  • First term = $x^5$, Last term = $y^5$
  • Second coefficient = $5/1 = 5$
  • Third coefficient = $5*4/2 = 10$
  • Fourth coefficient = $10*3/3 = 10$
  • Fifth coefficient = $10*2/4 = 5$

PROJECT DEVELOPMENT MANAGER’S PROBLEM

This problem introduces a business context where probability is needed.

• A toy manufacturer has two choices: abandon or risk new development.
• There is a 40% chance of a TV series (leading to 12,000 unit sales).
• Without the series, demand may be 2,000 units.
• A rival has a 50% chance of bringing a similar toy, which would reduce sales to 8,000 units.
• The question is how to tie these probabilities to financial results.

Sample space, Event

The set of collection of all possible outcomes of an experiment is called the sample space. Each possible outcome of an experiment is called an event. An event is a subset of the sample space.

📌 Example: All six faces of a die make a sample space. Rolling the dice and getting the number 1 is an event.

Probability

Probability is the numerical measure of the chance that an uncertain event will occur. The probability that event A will occur is usually denoted by p(A).

🔑 Definition — Probability: For any event A, $0 \le p(A) \le 1$. $p(A) = 1$ means certain, $p(A) = 0$ means impossible.

PROBABILITY EXAMPLE 1

How can we make assessment of chances? Look at a simple example: A worker out of 600 gets a prize by lottery. What is the chance of any one individual, say Rashid, being selected?

• Solution: Chance = $1/600$. This is an a’ priori method of finding probability as we can assess the probability before the event occurred.
• $p(\text{Rashid is selected}) = 1/600$

PROBABILITY EXAMPLE 2

When all outcomes are equally likely, a’ priori probability is defined as:

• $p(\text{event}) = \frac{\text{Number of ways that event can occur}}{\text{Total number of possible outcomes}}$
• 📌 Example: If out of 600 persons 250 are women, then $p(\text{woman}) = 250/600$.

PROBABILITY - EMPIRICAL APPROACH

In many situations, there is no prior knowledge to calculate probabilities. This is the experimental or empirical approach.

📐 Formula: $p(\text{event}) = \frac{\text{Number of times event occurs}}{\text{Total number of experiments}}$

💡 Why this matters: Larger the number of experiments, more accurate the estimate. Experimental probability approaches theoretical probability as the number of experiments becomes very large.

OR RULE

This rule calculates the probability of either event A or event B (or both) happening.

Condition for Or Rule: A and B must be mutually exclusive (cannot happen at the same time).

📐 Formula: $p(A \text{ or } B) = p(A) + p(B)$

📌 Example: If a dice is thrown, what is the chance of getting an even number or a number divisible by 3?

• $p(\text{even}) = 3/6$
• $p(\text{div by 3}) = 2/6$
• $p(\text{even or div by 3}) = 3/6 + 2/6 = 5/6$... but the number 6 is not mutually exclusive (it is both even and divisible by 3).
• Correct answer: The events {2,4,6} and {3,6} share the element {6}. The correct union is {2,3,4,6} = $4/6$.

AND RULE

This rule calculates the probability of both event A and event B happening.

📐 Formula: $p(A \text{ and } B) = p(A) \times p(B)$

📌 Example: In a factory, 40% workforce are women. 25% females are in management grade. 30% males are in management grade. What is the probability that a worker selected is a woman from management grade?

• Solution: Assume total workforce = 100.
• $p(\text{woman}) = 0.4$
• $p(\text{management} | \text{woman}) = 0.25$
• $p(\text{woman and Management grade}) = p(\text{woman}) \times p(\text{management} | \text{woman}) = 0.4 \times 0.25 = 0.1$ or 10%

SET OF MUTUALLY EXCLUSIVE EVENTS

To cover all possibilities between mutually exclusive events, add up all their probabilities. The probabilities of all these events together add up to 1.

📐 Formula: $p(A) + p(B) + p(C) + ... + p(N) = 1$

EXHAUSTIVE EVENTS

If A happens or A does not happen, then A and “not A” are Exhaustive Events.

📐 Formula: $p(A \text{ happens}) + p(A \text{ does not happen}) = 1$

📌 Example: $p(\text{you pass}) = 0.9$, then $p(\text{you fail}) = 1 - 0.9 = 0.1$.

EXAMPLE1 - EXHAUSTIVE EVENTS

A production line uses 3 machines. The chance that the 1st machine breaks down in any week is $1/10$, the 2nd is $1/20$, and the 3rd is $1/40$. What is the chance that at least one machine breaks down in any week?

• Solution: $p(\text{at least one not working}) + p(\text{all three working}) = 1$
• $p(\text{at least one not working}) = 1 - p(\text{all three working})$
• $p(\text{all three working}) = p(1\text{st working}) \times p(2\text{nd working}) \times p(3\text{rd working})$
• $p(1\text{st working}) = 1 - 1/10 = 9/10$
• $p(2\text{nd working}) = 19/20$
• $p(3\text{rd working}) = 39/40$
• $p(\text{all working}) = 9/10 \times 19/20 \times 39/40 = 6669/8000$
• $p(\text{at least 1 not working}) = 1 - 6669/8000 = \mathbf{1331/8000}$

APPLICATION OF RULES

A firm has the following rules: When a worker comes late there is a $1/4$ chance he is caught. First time he is given a warning. Second time he is dismissed. What is the probability that a worker who is late three times is not dismissed?

• Solution: Using the AND Rule to find probabilities of each branch:

  • $p(\text{1C and 2C})$ (Dismissed) = $1/4 \times 1/4 = 1/16 = 4/64$
  • $p(\text{1C and 2NC and 3C})$ (Dismissed) = $1/4 \times 3/4 \times 1/4 = 3/64$
  • $p(\text{1NC and 2C and 3C})$ (Dismissed) = $3/4 \times 1/4 \times 1/4 = 3/64$
  • $p(\text{1C and 2NC and 3NC})$ (Not Dismissed) = $1/4 \times 3/4 \times 3/4 = 9/64$
  • $p(\text{1NC and 2C and 3NC})$ (Not Dismissed) = $3/4 \times 1/4 \times 3/4 = 9/64$
  • $p(\text{1NC and 2NC and 3C})$ (Not Dismissed) = $3/4 \times 3/4 \times 1/4 = 9/64$
  • $p(\text{1NC and 2NC and 3NC})$ (Not Dismissed) = $3/4 \times 3/4 \times 3/4 = 27/64$

• Using the OR Rule for all "Not Dismissed" scenarios:

  • $p(\text{not dismissed}) = 9/64 + 9/64 + 9/64 + 27/64 = \mathbf{54/64}$

• $p(\text{caught})$ using OR Rule:

  • $p(\text{caught}) = 4/64 + 3/64 + 3/64 = \mathbf{10/64}$

• Using Exhaustive events to verify:

  • $p(\text{not caught}) = 1 - p(\text{caught}) = 1 - 10/64 = \mathbf{54/64}$ (Matches!)

⭐ Key Takeaways

The fundamental distinction between combinations (order doesn't matter, formula $nCr = n!/(r!(n-r)!)$) and permutations (order matters) is critical for solving selection problems. The lecture establishes that probability is always between 0 and 1, and can be found theoretically (a priori) or empirically. The two most important operational rules are the OR rule ($p(A \text{ or } B) = p(A) + p(B)$) which requires events to be mutually exclusive, and the AND rule ($p(A \text{ and } B) = p(A) \times p(B)$). Finally, the concept of exhaustive events ($p(A) + p(\text{not }A) = 1$) provides a powerful tool for simplifying complex probability problems, as demonstrated in the machine breakdown and worker dismissal examples.

🧠 Quick Revision Questions

1. A committee of 4 is to be formed from 8 people. How many different committees are possible? How does this differ from a permutation problem?
2. What is the condition for using the OR rule $p(A \text{ or } B) = p(A) + p(B)$? What happens if this condition is not met?
3. If the probability of rain on a given day is 0.3, what is the probability it does not rain? Which rule of probability does this illustrate?
4. A bag contains 3 red and 5 blue marbles. What is the probability of drawing a red marble and then, without replacement, a blue marble? Which probability rule is used here?
5. Explain the difference between a priori probability (like drawing a card from a deck) and empirical probability (like finding the chance a machine will fail based on past data).

📘 Lecture 36 — Elementary Probability Part 2

📖 Overview: This lecture continues the study of elementary probability concepts introduced in Lecture 35. It reviews fundamental probability rules including the OR Rule for mutually exclusive events and the AND Rule for simultaneous events, and explores how to handle sets of mutually exclusive and exhaustive events through worked examples.

🗂️ Topics Covered

The lecture begins with a review of basic probability concepts and the PERMUT function. It then revisits the OR Rule with an example involving dice outcomes, followed by a review of the AND Rule with a workforce management example. The final section covers sets of mutually exclusive (exhaustive) events, using a production line example with three machines to demonstrate how to calculate probabilities of complementary events.

📝 Lecture Summary

PROBABILITY CONCEPTS REVIEW

Probability is about making assessments of chances. The simplest example was the probability of Rashid getting the lottery when he was one of 600 people. The probability of the event was 1/600.

PERMUT EXAMPLE

The function PERMUT can be used for calculations of permutations. This function was introduced in Lecture 35.

OR RULE REVIEW

When two events are mutually exclusive, the probability of either one of those occurring is the sum of individual probabilities. This is the OR Rule. This is a very extensively used rule. A and B must be mutually exclusive.

🔑 Definition — OR Rule: The probability that event A or event B occurs (when A and B are mutually exclusive) equals the sum of their individual probabilities.

📐 Formula: p(A or B) = p(A) + p(B)

📌 Example: If a dice is thrown, what is the chance of getting an odd number or a number divisible by three?

• P(odd) = 3/6
• P(divisible by 3) = 2/6
• P(odd or divisible by 3) = 3/6 + 2/6 = 5/6
• Note: The number 6 is not mutually exclusive (needs checking), hence correct answer = 5/6.

AND RULE REVIEW

The AND Rule requires that the events occur simultaneously.

📌 Example: 60% of the workforce are men. 25% of females are in management grade. 30% of males are in management grade. What is the probability that a worker selected is a man from management grade?

• Total workforce = 100
• p(man) = 0.6
• p(management) = 0.3
• p(man & management grade) = p(man) × p(management)
• = 0.6 × 0.3 = 0.18 or 18%

SET OF MUTUALLY EXCLUSIVE EVENTS REVIEW

Mutually exclusive events between them cover all possibilities. These are also called exhaustive events. Probabilities of all these events together add up to 1. Exhaustive events are events that happen or do not happen.

📐 Formula: p(it does not rain) = 1 - p(it rains)

• Example: p(it rains) = 0.9, then p(it does not rain) = 1 - 0.9 = 0.1

📌 Example — Three Machines Problem: A production line uses 3 machines.

• Chance that 1st machine breaks down in any week = 1/10
• Chance for 2nd machine = 1/20
• Chance of 3rd machine = 1/40
• Question: What is the chance that at least one machine breaks down in any week?

Solution Approach:

• The probability that one or two or three machines are not working (at least one not working) AND that all three are working are exhaustive events that add up to 1.
• P(at least one not working) + p(all three working) = 1

Step 1 — Calculate probability of each machine working:

• p(1st working) = 1 - p(1st not working) = 1 - 1/10 = 9/10
• p(2nd working) = 1 - 1/20 = 19/20
• p(3rd working) = 1 - 1/40 = 39/40

Step 2 — Calculate probability all three are working (AND Rule):

• p(all three working) = p(1st working) × p(2nd working) × p(3rd working)
• = 9/10 × 19/20 × 39/40 = 6669/8000

Step 3 — Calculate probability at least one is not working:

• P(at least one not working) = 1 - p(all three working)
• = 1 - 6669/8000 = 1331/8000

💡 Why this matters: This example demonstrates how to handle complex probability problems by first finding the probability of the complementary event (all machines working) and then subtracting from 1.

⭐ Key Takeaways

The OR Rule is used for mutually exclusive events where the probability of either event occurring is the sum of individual probabilities, as demonstrated with the dice example. The AND Rule applies when events must occur simultaneously, requiring multiplication of their probabilities. The most critical concept for this lecture is the method of solving "at least one" problems by first finding the probability of the complementary event (all events working/occurring) and subtracting from 1, as shown in the three machines example. Understanding that exhaustive events (like a machine working or not working) always have probabilities that sum to 1 is fundamental to probability calculations. Finally, the PERMUT function offers a computational tool for permutation calculations.

🧠 Quick Revision Questions

1. What is the OR Rule formula, and what condition must be met for its application?
2. In the dice example (odd number OR divisible by three), what was the probability and why was 5/6 the correct answer?
3. In the workforce example, what was the probability that a randomly selected worker was a man from management grade, and how was it computed?
4. In the three machines problem, what was the probability that all three machines are working during a week?
5. What was the probability that at least one machine breaks down in any week for the three machines, and what is the key insight for solving such problems?

📘 Lecture 37 — Patterns of Probability: Binomial, Poisson and Normal Distributions Part 1

📖 Overview: This lecture reviews elementary probability concepts from previous sessions and introduces the foundation for understanding probability patterns, specifically the Binomial distribution. It covers multiple worked examples including conditional probability, expected value calculations, and sets up the conditions for binomial probability situations.

🗂️ Topics Covered

The lecture begins with a review of Module 7 structure and continues with detailed worked examples: Example 1 examines a worker's probability of being dismissed for lateness with multiple sequential events; Example 2 covers competing firms bidding for contracts with mutually exclusive events; Example 3 demonstrates conditional probability using workforce demographics; Example 4 calculates expected value from pie sales data; and finally, the lecture introduces binomial probability conditions and cumulative binomial probability tables using a biscuit factory production problem.

📝 Lecture Summary

Review Lecture 36

The lecture reviews elementary probability concepts covered in Handouts 35 and 36. Material concerning the employee who is warned for being late and dismissed if late twice is discussed in detail.

EXAMPLE 1

A firm has rules: when a worker comes late, there is a ¼ chance of being caught. First time: warning. Second time: dismissal.

What is the probability that a worker late three times is not dismissed?

Solution: Options are developed through sequential stages:

• First time: Caught (1C) or Not Caught (1NC)
• Second time: Caught (2C) or Not Caught (2NC)
• Third time: Caught (3C) or Not Caught (3NC)

Combinations up to 2nd stage: 1C&2C, 1C&2NC, 1NC&2C, 1NC&2NC

Combinations up to 3rd stage: 1C&2C&3C, 1C&2NC&3C, 1C&2NC&3NC, 1NC&2C&3C, 1NC&2C&3NC, 1NC&2NC&3C, 1NC&2NC&3NC

The probability of being caught = ¼, probability of not being caught = 1 - ¼ = ¾

Probabilities:

• 1C & 2C = 1/4 × 1/4 = 1/16 = 4/64 (Dismissed 1)
• 1C & 2NC & 3C = 1/4 × 3/4 × 1/4 = 3/64 (Dismissed 2)
• 1C & 2NC & 3NC = 1/4 × 3/4 × 3/4 = 9/64 (Not dismissed 1)
• 1NC & 2C & 3C = 3/4 × 1/4 × 1/4 = 3/64 (Dismissed 3)
• 1NC & 2C & 3NC = 3/4 × 1/4 × 3/4 = 9/64 (Not dismissed 2)
• 1NC & 2NC & 3C = 3/4 × 3/4 × 1/4 = 9/64 (Not dismissed 3)
• 1NC & 2NC & 3NC = 3/4 × 3/4 × 3/4 = 27/64 (Not dismissed 4)

p(caught): These are mutually exclusive events. All dismissal situations considered: p(caught) = p(dismissed 1) + p(dismissed 2) + p(dismissed 3) = 4/64 + 3/64 + 3/64 = 10/64

p(not caught): As an exhaustive event: p(not caught) = 1 - p(caught) = 1 - 10/64 = 54/64

EXAMPLE 2

Two firms compete for contracts. A has probability ¾ of obtaining one contract, B has probability ¼.

What is the probability that when they bid for two contracts, firm A will obtain either the first or second contract?

Solution: Wrong approach: P(A gets first or A gets second) = ¾ + ¾ = 6/4 — Probability cannot exceed 1! This ignored the mutually exclusive restriction.

Correct approach: We want probability that A gains the first or second or both. We are not interested in B getting both contracts. p(B gets first) × p(B gets both) = ¼ × ¼ = 1/16 p(A gets one or both) = 1 - 1/16 = 15/16

Alternative Method: Split "A gets first or second or both" into 3 mutually exclusive parts:

• A gets first but not second = ¾ × ¼ = 3/16
• A does not get first but gets second = ¼ × ¾ = 3/16
• A gets both = ¾ × ¾ = 9/16

P(A gets first or second or both) = 3/16 + 3/16 + 9/16 = 15/16 ✓

EXAMPLE 3

In a factory, 40% workforce is female. 25% of females belong to management cadre. 30% of males are from management cadre.

If a management grade worker is selected, what is the probability that it is a female?

Solution: First, draw up a table:

Calculations:

• Total male = 100 - 40 = 60
• Management female = 0.25 × 40 = 10
• Non-Management female = 40 - 10 = 30
• Management male = 0.3 × 60 = 18
• Non-Management male = 60 - 18 = 42
• Management total = 18 + 10 = 28
• Non-Management total = 42 + 30 = 72

Final table:

p(management grade worker is female) = 10/28

💡 Why this matters: This is a classic conditional probability problem — the condition is "given management grade," so the denominator is the management total (28), not the overall total (100).

EXAMPLE 4

A pie vendor collected data over sale of pies:

Mean/day = 203000/100 = 2030 Rs.

Selling price per pie was Rs. 35. The mean sale per day is calculated by multiplying income from each quantity by % days (which serves as probability), summing, and dividing by number of days.

EXPECTED VALUE

📐 Formula: EMV = Σ (probability of outcome × financial result of outcome)

Example: In an insurance company:

• 80% of policies have no claim = 0 Rs.
• 15% of policies have claim = 5000 Rs.
• 5% of policies have claim = 50000 Rs.

What is the expected value of claim per policy?

EMV = 0.8 × 0 + 0.15 × 5000 + 0.05 × 50000 = 0 + 750 + 2500 = 3250 Rs.

💡 Why this matters: This expected monetary value represents the average claim amount per policy that the insurance company must anticipate — critical for setting premium prices.

TYPICAL PRODUCTION PROBLEM

In a biscuit factory, the packing machine breaks 1 biscuit out of twenty (p = 1/20 = 0.05).

What proportion of boxes will contain more than 3 broken biscuits?

This is a typical Binomial probability situation! The individual biscuit is either broken or not — two possible outcomes.

Conditions for Binomial Situation

1. Either/or situation (two possible outcomes)
2. Number of trials (n) is known and fixed
3. Probability of success on each trial (p) is known and fixed

CUMULATIVE BINOMIAL PROBABILITIES

The Cumulative Probability table gives the probability of r or more successes in n trials, with probability p of success in one trial.

In the table:

• Total number of trials n = 1 to 10
• Number of successes r = 1 to 10
• Probability p = 0.05, 0.1, 0.2, 0.25, 0.3, 0.35, 0.4, 0.45, 0.5

⭐ Key Takeaways

1. For sequential probability problems with dismissal rules, systematically list all possible combinations of outcomes (caught/not caught) across each time period, calculate each path's probability by multiplying along branches, and sum probabilities for the condition of interest — remembering that once dismissal occurs, the process stops.
2. When calculating "A or B" probabilities, ensure events are mutually exclusive; otherwise, simply adding probabilities can produce values exceeding 1, which is impossible — the complement method (1 minus probability of the undesired event) often provides a cleaner solution.
3. In conditional probability problems (e.g., "given management grade"), the denominator is always the condition subgroup total, not the overall population total — create a contingency table to organize the given and calculated values systematically.
4. Expected Monetary Value (EMV) is calculated by multiplying each outcome's probability by its financial result and summing all products — this represents the long-run average outcome per trial or policy.
5. A Binomial probability situation requires exactly three conditions: a binary either/or outcome, a fixed number of trials (n), and a constant probability of success (p) for each trial — cumulative binomial probability tables provide quick answers for "r or more successes" problems.

🧠 Quick Revision Questions

1. In Example 1, why is the combination 1C&2C terminated at the second stage, and how does this affect the probability calculation for the third late occurrence?
2. In Example 2, why does simply adding ¾ + ¾ = 6/4 give an incorrect answer, and what is the correct complement-based approach?
3. In Example 3, when calculating the probability that a management grade worker is female, why is the denominator 28 rather than 100?
4. Using the EMV formula, if an insurance company has 70% no claims, 20% claims of Rs. 3000, and 10% claims of Rs. 20000, what is the expected value of claim per policy?
5. What are the three essential conditions that must be satisfied for a situation to qualify as a Binomial probability problem?

📘 Lecture 38 — Patterns of Probability: Binomial, Poisson and Normal Distributions PART 2

📖 Overview: This lecture continues the study of probability distributions, focusing on cumulative binomial probabilities and advanced binomial calculations. It also introduces the negative binomial distribution and Excel functions like BINOMDIST, NEGBINOMDIST, and CRITBINOM, which are essential for solving real-world probability problems in quality control, medicine, and communications.

🗂️ Topics Covered

The lecture covers cumulative binomial probabilities and their calculation using tables and formulas. It explains the BINOMDIST function in Excel with syntax and examples for problems like medical acceptance rates, weather probability, and transmission errors. The negative binomial distribution is introduced with properties and formula, along with the NEGBINOMDIST function for scenarios like finding qualified candidates. Finally, the CRITBINOM function is explained for quality assurance applications.

📝 Lecture Summary

Cumulative Binomial Probabilities

Cumulative binomial probability refers to the probability that the binomial random variable falls within a specified range, such as being greater than or equal to a stated lower limit and less than or equal to a stated upper limit. For example, the probability of obtaining 45 or fewer heads in 100 coin tosses is the sum of all individual binomial probabilities from 0 to 45 successes. This is not a single probability but the sum of multiple binomial probabilities. 💡 Why this matters: Cumulative probabilities allow us to answer "at most" or "at least" questions, which are common in real-world decision making.

🔑 Definition — Cumulative Binomial Probability: The probability that the binomial random variable falls within a specified range, calculated as the sum of individual binomial probabilities for all values in that range.

📐 Formula: ( P(x \leq c) = \sum_{x=0}^{c} \binom{n}{x} P^x (1-P)^{n-x} ) → The sum of binomial probabilities from 0 up to c successes.

📌 Example: The probability that a student is accepted to a prestigious college is 0.3. If 5 students from the same school apply, what is the probability that at most 2 are accepted?

• n = 5, p = 0.3, we need P(x ≤ 2)
• Compute: P(x=0) + P(x=1) + P(x=2) using the binomial formula
• Result: b(x ≤ 2; 5, 0.3) = 0.837

BINOMDIST

BINOMDIST returns the individual term binomial distribution probability. Use BINOMDIST in problems with a fixed number of tests or trials, when the outcomes of any trial are only success or failure, when trials are independent, and when the probability of success is constant throughout the experiment. For example, BINOMDIST can calculate the probability that two of the next three babies born are male.

🔑 Definition — BINOMDIST: An Excel function that returns the binomial distribution probability, either as the probability mass function (exact number of successes) or cumulative distribution function (at most number_s successes).

📐 Syntax: BINOMDIST(number_s, trials, probability_s, cumulative)

• number_s: number of successes in trials
• trials: number of independent trials
• probability_s: probability of success on each trial
• cumulative: TRUE returns cumulative distribution function (at most number_s successes); FALSE returns probability mass function (exact number_s successes)

📌 Example 1: The probability of wet days is 60%. What is the probability of 5 or more wet days in 7 days?

• p(wet) = 0.6 is beyond table values (max 0.5)
• Convert to p(dry) = 1 - 0.6 = 0.4
• P(5 or more wet days) = P(2 or less dry days)
• Convert using complement: P(2 or less dry days) = 1 - P(3 or more dry days)
• Using BINOMDIST with n=7, r=3, p=0.4, cumulative=TRUE
• Answer: 0.4199

📌 Example 2: In a transmission where 8 bit message is transmitted electronically, there is 10% probability of one bit being transmitted erroneously. What is the chance that entire message is transmitted correctly?

• We need P(0 errors) in 8 trials, p(error)=0.1
• Using formula: P(x=0) = C(8,0) × 0.1⁰ × 0.9⁸ = 1 × 1 × 0.430
• Answer: 0.430

📌 Example 3: A surgery is successful for 75% patients. What is the probability of its success in at least 7 cases out of randomly selected 9 patients?

• p(success)=0.75 is outside the table (max 0.5)
• Invert: p(failure)=1-0.75=0.25
• "Success at least 7" means "Failure 2 or less"
• P(x≥7; n=9; p=0.75) = 1 - P(x≤6; n=9; p=0.75) = 1 - 0.3995 = 0.6005 = 60%

Negative Binomial Distribution

A negative binomial experiment is a statistical experiment with the following properties: The experiment consists of x repeated trials; each trial has two outcomes (success/failure); the probability of success P is constant; trials are independent; and the experiment continues until r successes are observed, where r is specified in advance.

🔑 Definition — Negative Binomial Distribution: A probability distribution that models the number of trials needed to achieve a fixed number of successes, where trials are independent and the probability of success is constant.

📐 Formula: ( b^*(x; r, P) = \binom{x-1}{r-1} \times P^r \times (1-P)^{x-r} )

• x = total number of trials
• r = number of successes (fixed)
• P = probability of success on each trial

📌 Example: Bob is a high school basketball player with 70% free throw shooting. What is the probability that Bob makes his first free throw on his fifth shot?

• This is a geometric distribution (special case of negative binomial with r=1)
• P = 0.70, x = 5, r = 1
• b*(5; 1, 0.7) = C(4,0) × 0.7¹ × 0.3⁴
• b*(5; 1, 0.7) = 0.00567

NEGBINOMDIST

NEGBINOMDIST returns the negative binomial distribution. It returns the probability that there will be number_f failures before the number_s-th success, when the constant probability of a success is probability_s. This function is similar to the binomial distribution, except that the number of successes is fixed, and the number of trials is variable.

🔑 Definition — NEGBINOMDIST: An Excel function that returns the probability of a given number of failures before a specified number of successes occurs.

📐 Syntax: NEGBINOMDIST(number_f, number_s, probability_s)

• number_f: the number of failures
• number_s: the threshold number of successes
• probability_s: the probability of a success

📐 Formula: ( \binom{x+r-1}{r-1} \times p^r \times (1-p)^x ) where x is number_f, r is number_s, and p is probability_s.

📌 Example: You need to find 10 people with excellent reflexes, and you know the probability that a candidate has these qualifications is 0.3. NEGBINOMDIST calculates the probability that you will interview a certain number of unqualified candidates before finding all 10 qualified candidates.

CRITBINOM

CRITBINOM returns the smallest value for which the cumulative binomial distribution is greater than or equal to a criterion value. Use this function for quality assurance applications, such as determining the greatest number of defective parts that are allowed to come off an assembly line run without rejecting the entire lot.

🔑 Definition — CRITBINOM: An Excel function that returns the smallest value for which the cumulative binomial distribution meets or exceeds a specified criterion (alpha).

📐 Syntax: CRITBINOM(trials, probability_s, alpha)

• trials: number of Bernoulli trials
• probability_s: probability of success on each trial
• alpha: criterion value

📌 Example: With 6 Bernoulli trials, probability of success 0.5, and criterion value 0.75:

• CRITBINOM(6, 0.5, 0.75) returns 4
• This means the smallest number of successes for which the cumulative probability is at least 0.75 is 4

⭐ Key Takeaways

Students must remember that cumulative binomial probabilities sum individual probabilities for ranges like "at most" or "at least" a certain number of successes, and these can be calculated using formulas or tables. The BINOMDIST function is essential for Excel-based calculations, where setting cumulative to TRUE gives the cumulative probability and FALSE gives the exact binomial probability. When probability values exceed table limits (0.5), the problem must be converted by switching success to failure (using p = 1 - original p). The negative binomial distribution differs from the binomial in that it fixes the number of successes and varies the number of trials. Finally, CRITBINOM is specifically designed for quality control to find the critical threshold number of successes.

🧠 Quick Revision Questions

1. What is the difference between the binomial distribution and the negative binomial distribution?
2. How do you calculate cumulative binomial probability when the probability of success is greater than 0.5?
3. In the BINOMDIST function, what does setting the cumulative parameter to TRUE return?
4. What is the formula for the negative binomial distribution, and what does each variable represent?
5. In what real-world application would you use the CRITBINOM function?

📘 Lecture 39 — PATTERNS OF PROBABILITY: BINOMIAL, POISSON AND NORMAL DISTRIBUTIONS PART 3

📖 Overview: This lecture continues the exploration of probability distributions, covering practical applications of expected value and decision-making tools. It introduces the Poisson distribution for modeling rare events and demonstrates how to use decision tables and decision trees to make optimal business choices under uncertainty.

🗂️ Topics Covered

The lecture covers CRITBINOM example review, expected value calculation for lottery decisions, construction and use of decision tables for inventory optimization, decision tree analysis for manufacturing investment under uncertainty, and a comprehensive introduction to the Poisson distribution including its characteristics, formula, probability tables, and multiple worked examples for absences, breakdowns, and quality control scenarios.

📝 Lecture Summary

CRITBINOM EXAMPLE

The example shown under CRITBINOM in Handout 38 is reviewed as foundational material for understanding binomial cumulative distributions.

EXPECTED VALUE EXAMPLE

A lottery has 100 Rs. Payout on average 20 turns. The question is whether it is worthwhile to buy the lottery if the ticket price is 10 Rs.

Expected win per turn = p(winning) × gain per win + p(losing) × loss if you lose = 1/20 × (100 – 10) + 19/20 × (-10) = 90/20 – 190/20 = 4.5 – 9.5 = –5 Rs.

So on an average you stand to lose 5 Rs.

💡 Why this matters: This demonstrates that a negative expected value means the game is unfavorable — a fundamental concept for evaluating any gambling or investment opportunity.

DECISION TABLES

A bakery problem is presented with the following data:

Given:

• Price per pie = Rs. 15
• Refund on return = Rs. 5
• Sale price = Rs. 25
• Profit per pie = Rs. 25 – 15 = Rs. 10
• Loss on each return = Rs. 15 – 5 = Rs. 10

To solve this problem, a decision table is set up. The values in the first column are number of pies to be purchased. Figures in columns are the sale with % share of sale within brackets. If the number of pies bought is less than the number that can be sold, the number of pies sold remains constant. If the number of pies bought exceeds the number of pies sold then the remaining are returned, meaning a loss.

Decision Table:

Expected profit for 30 pies: = 0.1 × 200 + 0.2 × 300 + 0.25 × 300 + 0.2 × 300 + 0.15 × 300 + 0.1 × 300 = 20 + 60 + 75 + 60 + 45 + 30 = 290 Rs.

Best Profit: The best profit is for 35 Pies = Rs. 310

DECISION TREE TOY MANUFACTURING CASE

The problem of a manufacturer intending to start manufacturing a new toy under conditions that a TV series may or may not appear, and that a rival may or may not sell a similar toy.

Decision Tree Structure: 1A – Abandon 1B – Go ahead → 2A: Series appears (60%) → 3A: Rival markets (50%) → 3B: No Rival (50%) → 2B: No series (40%)

Given data:

• Production: Series, no rival = 12000 units; Series, rival = 8000 units; No series = 2000 units
• Investment = Rs. 500,000
• Profit per unit = Rs. 200
• Loss if abandon = Rs. 500,000

Calculations:

• Profit if rival markets, series appears = 8000 × 200 – 500000 = 1,600,000 – 500,000 = 1,100,000 Rs.
• Profit if no rivals = 12000 × 200 – 500000 = 2,400,000 – 500,000 = 1,900,000 Rs.
• Profit/Loss if no series = 2000 × 200 – 500000 = 400,000 – 500,000 = –100,000 Rs.

EMV calculations:

• EMV (Series) = Rival markets and no rivals = 0.5 × 1,100,000 + 0.5 × 1,900,000 = 1,500,000
• EMV (Overall) = 0.6 × 1,500,000 + 0.4 × (–100,000) = 900,000 – 40,000 = 860,000 Rs.

Conclusion: It is clear that in spite of the uncertainty, there is a likelihood of a reasonable profit. Hence the conclusion is: Go ahead

THE POISSON DISTRIBUTION

The Poisson distribution is most commonly used to model the number of random occurrences of some phenomenon in a specified unit of space or time.

Examples:

• The number of phone calls received by a telephone operator in a 10-minute period
• The number of flaws in a bolt of fabric
• The number of typos per page made by a secretary

Characteristics:

• Either/or situation
• No data on trials
• No data on successes
• Average or mean value of successes or failures known
• Mean number of successes per unit, m, known and fixed
• p, chance, unknown but small (event is unusual)

🔑 Definition — Poisson Distribution: A discrete probability distribution that expresses the probability of a given number of events occurring in a fixed interval of time or space if these events occur with a known constant mean rate and independently of the time since the last event.

📐 Formula: $$P(X = x) = \frac{e^{-\mu} \mu^x}{x!}, \quad x = 0,1,2,...$$

where μ is the average number of occurrences in the specified interval.

For the Poisson distribution: E(X) = μ, Var(X) = μ

📌 Example 1: The number of false fire alarms in a suburb of Houston averages 2.1 per day. The probability that 4 false alarms will occur on a given day is:

$$P(X = 4) = \frac{e^{-2.1} \times 2.1^4}{4!} = 0.0992$$

THE POISSON TABLES OF PROBABILITIES

Poisson tables give cumulative probability of r or more successes. Knowledge of m is required. The table gives the probability that r or more random events are contained in an interval when the average number of events per interval is m.

📌 Example 2: Attendance in a factory shows 7 absences on average. What is the probability that on a given day there will be more than 8 people absent?

Method 1: P(X > 8) = 1 – P(X ≤ 8) = 1 – [P(x=0) + P(x=1) + P(x=2) + P(x=3) + P(x=4) + P(x=5) + P(x=6) + P(x=7) + P(x=8)]

= 1 – [0.0009 + 0.0064 + 0.0223 + 0.0521 + 0.0912 + 0.1277 + 0.149 + 0.149 + 0.1304] = 1 – 0.7291 = 0.2709

Method 2: P(X > 8) = 1 – P(X ≤ 8) = 1 – 0.7291 = 0.2709

p(9 or more successes) = 0.2709

📌 Example 3: An automatic production line breaks down every 2 hours. Special production requires uninterrupted operation for 8 hours. What is the probability that this can be achieved?

μ = 8/2 = 4 x = 0 (no breakdown)

$$P(x=0) = \frac{e^{-4} \times 4^0}{0!} = 0.0183 = 1.83%$$

From Table: 1.83%

📌 Example 4: An automatic packing machine produces on average one in 100 underweight bags. What is the probability that 500 bags contain less than three underweight bags?

m = 1 × 500/100 = 5

p(x < 3, μ = 5) = p(x ≤ 2, μ = 5) = 0.1247 = 12.47%

⭐ Key Takeaways

The most critical points from this lecture are: Expected value is the fundamental concept for evaluating any probabilistic business decision — negative expected value means the decision is unfavorable. Decision tables allow comparing multiple purchasing/production quantities by calculating the Expected Monetary Value (EMV) for each option using weighted averages of possible outcomes. Decision trees model sequential decisions under uncertainty by applying the AND rule (multiplying probabilities along branches) and calculating EMV at each chance node. The Poisson distribution is essential for modeling rare events where we know the average rate (μ) but not the number of trials, with the key properties that E(X) = μ and Var(X) = μ. Poisson tables provide cumulative probabilities for "r or more" successes, saving calculation time for complex problems.

🧠 Quick Revision Questions

1. What is the expected value of the lottery with 100 Rs. payout on average every 20 turns and ticket price of 10 Rs.?
2. In the pie decision table, what is the optimal number of pies to purchase and what is the resulting EMV?
3. What are the four key characteristics of a Poisson distribution situation?
4. In the factory absence example with μ=7, what is the probability of more than 8 absences on a given day?
5. For an automatic packing machine with 1% defect rate, what is the probability that 500 bags contain less than 3 underweight bags?

📘 Lecture 40 — PATTERNS OF PROBABILITY: BINOMIAL, POISSON AND NORMAL DISTRIBUTIONS PART 4

📖 Overview: This lecture concludes the series on probability distributions by reviewing the Poisson distribution in Excel and introducing the Normal distribution for continuous data. It explains how to use the normal curve to find probabilities for real-world measurements (like candy bag weights) by calculating z-scores and using standard normal tables.

🗂️ Topics Covered

The lecture begins with the Excel POISSON worksheet function’s syntax and examples for cumulative and exact probabilities. It then contrasts discrete distributions (Binomial/Poisson) with continuous distributions, using underweight candy boxes to introduce the normal distribution. Key topics include the standard normal distribution, reading areas under the normal curve from tables, calculating z-values for standardization, and solving four worked examples for proportions and percentages of bags above, below, or between specified weights.

📝 Lecture Summary

POISSON WORKSHEET FUNCTION

The Poisson distribution predicts the number of events over a specific time (e.g., cars arriving at a toll plaza in 1 minute). The Excel function POISSON(x, mean, cumulative) returns either the exact probability mass function or the cumulative probability.

🔑 Definition — Poisson distribution: A discrete probability distribution that models the count of events occurring in a fixed interval of time or space, given a known average rate (mean).

📐 Formula: For cumulative = FALSE (exact probability of exactly x events): POISSON(x, mean, FALSE)

For cumulative = TRUE (probability of 0 to x events inclusive): POISSON(x, mean, TRUE)

Remarks: x is truncated if not integer; if x or mean is nonnumeric, returns #VALUE!; if x ≤ 0 or mean ≤ 0, returns #NUM!.

📌 Example (Cumulative = TRUE): Returns the probability of “at most x” events (e.g., at most 2 cars).
📌 Example (Cumulative = FALSE): Returns the probability of “exactly x” events (e.g., exactly 2 cars).

THE PATTERN

In Binomial and Poisson distributions, situations are either/or, and the number of times can be counted — they are discrete probability distributions. In the Candy problem with underweight boxes, we measure weight — a continuous measurement — requiring a different treatment.

FREQUENCY BY WEIGHT

The frequency distribution of sample bag weights shows a distinct symmetrical shape, which is the shape of a Normal Distribution. A Standard Normal Distribution has mean = 0 and standard deviations 1, 2, 3, etc. marked on the x-axis.

NORMAL DISTRIBUTION

The blue curve is a typical Normal Distribution. A standard normal distribution has mean = 0 and standard deviation = 1. The Y-axis gives probability values; the X-axis gives z (measurement) values. Each point on the curve corresponds to the probability p that a measurement will yield a particular z value.

• Probability is a number from 0 to 1; percentage probabilities multiply p by 100.
• Area under the curve must be one.
• Probability is essentially zero for any value z greater than 3 standard deviations away from the mean on either side.
• Mean gives the peak of the curve; Standard deviation gives the spread.

📌 Weight distribution case: Mean = 510 g; StDev = 2.5 g.
Question: What proportion of bags weighs more than 515 g?
Answer: The proportion is given by the area under the curve to the right of 515 g.

💡 Why this matters: The normal distribution is the foundation for many statistical tests and quality control applications in business and industry.

AREA UNDER THE STANDARD NORMAL CURVE

The normal distribution table gives the area under one tail only. The z-value ranges between 0 and 4 in the first column, and between 0 and 0.09 in the other columns.

📌 Example: Find area under one tail for z-value of 2.05.

• Look in column 1: find 2.0.
• Look in column 0.05: go to intersection of 2.0 and 0.05.
• Probability = 0.4798 (at the intersection, corresponding to z = 2.5).

Since probability from the center of the curve to the right is 0.5 and to the left is 0.5, to find probability for z ≥ 2.5, subtract the table value from 0.5: 0.5 − 0.4798 = 0.0202 = 2.02%

CALCULATING Z-VALUES

z = (Value x – Mean) / StDev
The process of calculating z from x is called Standardization. z indicates how many standard deviations the point is from the mean.

📌 Example 1: Find proportion of bags with weight in excess of 515 g.
Mean = 510 g, StDev = 2.5 g
z = (515 – 510) / 2.5 = 2
From tables: probability corresponding to z = 2 is 0.4772
Proportion = 0.5 – 0.4772 = 0.0228

📌 Example 2: What percentage of bags weigh less than 507.5 g?
Mean = 510 g, StDev = 2.5 g
z = (507.5 – 510) / 2.5 = –1
Look at z = +1: table probability = 0.3413
Percentage = 0.5 – 0.3413 = 0.1587 = 15.87%

📌 Example 3: Probability that a bag weighs less than 512 g?
z = (512 – 510) / 2.5 = 0.8
Table probability for z = 0.8 = 0.2881
Since 512 > mean, area = 0.5 + 0.2881 = 0.7881 = 78.81%

📌 Example 4: Percentage of bags weighing between 512 g and 515 g?
z₁ = (512 – 510) / 2.5 = 0.8
Area to right of 512 = 0.5 – 0.2881 = 0.2119
z₂ = (515 – 510) / 2.5 = 2
Area to right of 515 = 0.5 – 0.4772 = 0.0228
Required area = 0.2119 – 0.0228 = 0.1891 = 18.91%

⭐ Key Takeaways

The Poisson distribution in Excel handles discrete event counts with a simple function, while the normal distribution applies to continuous measurements like weight. For the normal distribution, you must standardize raw measurements into z-scores using the formula z = (x – mean)/StDev. The standard normal table gives area under one tail (from the mean out to a given z); you add or subtract from 0.5 depending on whether your value is above or below the mean. For intervals between two values, compute the areas to the right of each z and subtract the larger from the smaller. These techniques are essential for making probability statements about any normally distributed business data.

🧠 Quick Revision Questions

1. What does the cumulative argument in the POISSON function control?
2. How is the standard normal distribution defined?
3. What is the total area under any normal probability distribution curve?
4. How do you calculate the probability that a value is less than the mean using z-scores?
5. In the candy bag example, what was the z-score for 515 g, and what proportion of bags weigh more than that?

📘 Lecture 41 — Estimating From Samples: Inference Part 1

📖 Overview: This lecture introduces the concept of statistical inference by examining how we estimate population characteristics from sample data. It covers the practical application of normal distribution functions in Excel (NORMDIST, NORMSDIST, NORMINV, NORMSINV) and establishes the foundation for understanding sampling distributions and standard error, which are critical for making reliable inferences about populations.

🗂️ Topics Covered

The lecture begins with a review of Excel functions for normal distribution calculations (NORMDIST, NORMSDIST, NORMINV, NORMSINV), then introduces the concept of sampling variations through practical examples involving defective components and household surveys. It explains how to construct a sampling distribution of percentages, calculates its mean, and introduces the Standard Error of Percentages (STEP) as a measure of sampling error. The lecture concludes that for large samples (n>30), the sampling distribution approximates a normal distribution.

📝 Lecture Summary

NORMDIST

This Excel function returns the normal distribution for a specified mean and standard deviation. It is widely used in statistics, including hypothesis testing.

Syntax: NORMDIST(x, mean, standard_dev, cumulative)

• X: The value for which you want the distribution
• Mean: Arithmetic mean of the distribution
• Standard_dev: Standard deviation of the distribution
• Cumulative: Logical value — TRUE returns cumulative distribution function; FALSE returns probability mass function

Remarks:

• If mean or standard_dev is nonnumeric, NORMDIST returns the #VALUE! error
• If standard_dev ≤ 0, NORMDIST returns the #NUM! error
• If mean = 0, standard_dev = 1, and cumulative = TRUE, NORMDIST returns the standard normal distribution (NORMSDIST)

🔑 Definition — Equation for normal density function (cumulative = FALSE): The formula is the standard normal density equation (not explicitly written in text, but referenced). When cumulative = TRUE, the formula is the integral from negative infinity to x of that equation.

📌 Example: x = 42, Arithmetic mean = 40, Standard deviation = 1.5, Cumulative distribution = 0.9

NORMSDIST

Returns the standard normal cumulative distribution function. The distribution has a mean of 0 and a standard deviation of 1. Use this function instead of a table of standard normal curve areas.

Syntax: NORMSDIST(z)

• z: The value for which you want the distribution

Remarks: If z is nonnumeric, NORMSDIST returns the #VALUE! error.

🔑 Definition — Equation for standard normal density function: The equation is the standard normal density function formula (referenced in text).

📌 Example: Input z = 1.333333, Output cumulative probability = 0.908789

NORMINV

Returns the inverse of the normal cumulative distribution for a specified mean and standard deviation.

Syntax: NORMINV(probability, mean, standard_dev)

• Probability: A probability corresponding to the normal distribution
• Mean: Arithmetic mean of the distribution
• Standard_dev: Standard deviation of the distribution

Remarks:

• If any argument is nonnumeric, NORMINV returns #VALUE! error
• If probability < 0 or > 1, returns #NUM! error
• If standard_dev ≤ 0, returns #NUM! error
• If mean = 0 and standard_dev = 1, uses standard normal distribution (NORMSINV)
• Uses iterative technique, accurate to within ± 3x10^-7; if no convergence after 100 iterations, returns #N/A error

📌 Example: Given probability value, arithmetic mean, and standard deviation, the answer is the x-value.

NORMSINV

Returns the inverse of the standard normal cumulative distribution. The distribution has a mean of 0 and standard deviation of 1.

Syntax: NORMSINV(probability)

• Probability: A probability corresponding to the normal distribution

Remarks:

• If probability is nonnumeric, returns #VALUE! error
• If probability < 0 or > 1, returns #NUM! error
• Uses iterative technique, accurate to within ± 3x10^-7; if no convergence after 100 iterations, returns #N/A error

📌 Example: Input is the z-value, corresponding cumulative distribution is calculated.

SAMPLING VARIATIONS

Electronic components are dispatched in boxes of 500. Customers agreed to a defect rate of 2%. One customer found 25 faulty components (5%) in a box. The question is whether this box was representative of production as a whole. The box represents a sample from the whole output. Sampling variations are expected. The key question: If the overall proportion of defective items has not increased, how likely is it that a box of 500 with 25 defective components will occur?

SAMPLING VARIATIONS EXAMPLE 1

In a residential colony section, there are 6 households (A, B, C, D, E, F). A survey determines the percentage of households that use corn flakes (cf) for breakfast. Households A, B, C, and D use corn flakes; E and F do not. Random samples of 3 households are taken.

All possible samples of size 3 and their percentage of cf users:

Out of 20 samples:

• 4 contain 100% cf users
• 12 contain 67% cf users
• 4 contain 33% cf users

Probability distribution:

• Probability of 100% cf users: 4/20 = 0.2
• Probability of 67% cf users: 12/20 = 0.6
• Probability of 33% cf users: 4/20 = 0.2

This is called a Sampling Distribution.

💡 Why this matters: This illustrates that even when the true population percentage is fixed, different samples produce different percentages. This variability is natural and quantifiable.

SAMPLING DISTRIBUTION

The sampling distribution of percentages is the distribution obtained by taking all possible samples of fixed size n from a population, noting the percentage in each sample with a certain characteristic, and classifying these into percentages.

Mean of the Sampling Distribution Using the above data: Mean = (100% × 0.2) + (67% × 0.6) + (33% × 0.2) = 67%

The mean of the sampling distribution is the true percentage for the population as a whole. You must make allowance for variability in samples.

Conditions for Sample Selection:

• Number of items in the sample, n, is fixed and known in advance
• Each item either has or has not the desired characteristic
• The probability of selecting an item with the characteristic remains constant and is known to be P percent

If n is large (>30), then the distribution can be approximated to a normal distribution.

STANDARD ERROR OF PERCENTAGES

The standard deviation of the sampling distribution tells us how the sample values differ from the mean P. It gives us an idea of the error we might make if we were to use a sample value instead of the population value. For this reason, it is called the Standard Error of Percentages or STEP.

🔑 Definition — STEP: The sampling distribution of percentages in samples of n items (n>30) taken at random from an infinite population in which P percent of items have characteristic X will be:

• A Normal Distribution
• With mean P%
• And standard deviation (STEP) = √[P(100-P)/n] %

The mean and standard deviation of the sampling distribution of percentages will also be percentages.

⭐ Key Takeaways

The most critical concepts from this lecture are: (1) NORMDIST, NORMSDIST, NORMINV, and NORMSINV are Excel functions for working with normal distributions — the first two find probabilities from x or z values, while the last two find x or z values from probabilities; (2) sampling variation is natural and expected — different samples from the same population will yield different percentages; (3) the sampling distribution of percentages is constructed by taking all possible samples of a fixed size and recording the percentage with a characteristic; (4) the mean of the sampling distribution equals the true population percentage, making it an unbiased estimator; (5) the Standard Error of Percentages (STEP) = √[P(100-P)/n] % measures the typical error when using a sample percentage to estimate the population percentage, and for n>30, the sampling distribution approximates a normal distribution.

🧠 Quick Revision Questions

1. What is the difference between NORMDIST and NORMINV in terms of what they calculate?
2. In the household survey example with 6 households, what was the mean of the sampling distribution and what does it represent?
3. What are the three conditions required for sample selection when constructing a sampling distribution of percentages?
4. What does the Standard Error of Percentages (STEP) measure, and why is it important for inference?
5. Under what condition can the sampling distribution of percentages be approximated by a normal distribution, and what are its parameters (mean and standard deviation)?

📘 Lecture 42 — Estimating from Samples: Inference Part 2

📖 Overview: This lecture continues the study of statistical inference by focusing on estimating population parameters from sample data. It covers how to calculate the probability of sample outcomes, construct confidence intervals for population percentages, determine required sample sizes, and understand the distribution of sample means, providing essential tools for making data-driven decisions.

🗂️ Topics Covered

The lecture begins with a review example calculating the probability of a sample containing a certain number of women. It then introduces the applications of the Standard Error of Percentage (STEP), explains the process of calculating 95% and 99% confidence limits for population percentages, and shows how to determine the necessary sample size for a desired accuracy. Finally, it covers the distribution of sample means, introducing the Standard Error of the Mean (STEM) and an example probability calculation.

📝 Lecture Summary

Review of Lecture 41

A factory has 25% women workers. We need to find the probability that a random sample of 80 workers contains 25 or more women.

The Standard Error of Percentage (STEP) is calculated as the standard deviation of the sampling distribution of percentages. Its formula is used to find the z-score for the sample percentage.

• Mean = P = 25%
• n = 80
• STEP = [P(100-P)/n]^(1/2) % = [25(75)/80]^(1/2) % = 4.84%
• % women in sample = (25/80) x 100% = 31.25%
• z = (31.25 - 25) / 4.84 = 1.29

Looking up z = 1.29 in the normal distribution table gives a probability of 0.4015 (the area between the mean and z). Since we want the probability of 25 or more women (the area to the right of z), we calculate:

p(sample contains 25 or more women) = 0.5 - 0.4015 = 0.0985 or about 10%.

📌 Example: In a factory, 25% of the workforce is women. The probability that a random sample of 80 workers contains 25 or more women is approximately 10%.

Applications of STEP

Important issues addressed by using STEP include:

• Determining the probability that a specific sample will arise.
• Estimating the population percentage P from the information obtained from a single sample.
• Calculating the required sample size to estimate a population percentage with a given degree of accuracy.

Confidence Limits

A market researcher selects a random sample of 400 consumers. 280 (70%) are purchasers of the company’s product. The goal is to conclude the percentage of all consumers buying the product.

The 95% confidence limits are commonly used. In a normal sampling distribution, 2.5% (rejection region) corresponds to a z-value of 1.96 on either side of the sample percentage (70%). The acceptance region is 0.5 - 0.025 = 0.475, for which z = 1.96.

The sample percentage (70%) is used as an approximation for the population percentage P.

• STEP = [70(100-70)/400]^1/2 = 2.29%
• Confidence Limits: Estimate for population percentage = 70 +/- 1.96 × STEP
  • = 70 +/- 1.96 × 2.29
  • = 65.515% and 74.49%
• A common approximation is to round 1.96 to 2. Therefore, the 95% confidence interval is P +/- 2 × STEP.

📌 Example: A sample of 60 students contains 12 (20%) left-handed students. The 95% confidence interval for the percentage of all left-handed students is: Range = 20 +/- 2 × STEP Range = 20 +/- 2 × [20 × (100-20) / 60]^1/2 = 9.67% and 30.33%

Estimating Process Summary:

1. Identify the sample size n and the sample percentage P.
2. Calculate STEP using these values.
3. The 95% confidence interval is approximately P +/- 2 × STEP.

99% Confidence

For 99% confidence limits, the z-value is 2.58. At a 99% confidence level, there is a 1% chance of error (level of significance), with 0.5% rejection region on each side of the curve. The acceptance region is 0.5 - 0.005 = 0.495, for which z = 2.58.

Finding a Sample Size

To satisfy 95% confidence, we can set a desired margin of error. For example, to ensure the estimate is within 5% of the true answer:

• 2 × STEP = 5
• STEP = 2.5
• Assuming a pilot survey value of P = 30%:
  • STEP = [30 × 70 / n]^1/2 = 2.5
  • Solving for n gives n = 336.

📌 Example: To be 95% confident that an estimate of a population percentage is within 5% of the true value, a sample of 336 persons must be interviewed.

Distribution of Sample Means

The standard deviation of the Sampling Distribution of means is called the Standard Error of the Mean (STEM).

📐 Formula: STEM = s.d / √n

• s.d denotes the standard deviation of the population.
• n is the size of the sample.

📌 Example: What is the probability that a random sample of 64 children from a population with mean IQ = 100 and StDev = 15 will have a sample mean IQ below 95?

• s = 15; n = 64; population mean = 100
• STEM = 15 / √64 = 15 / 8 = 1.875
• z = (100 - 95) / 1.875 = 2.67
• This gives a probability of 0.0038. The chance that the average IQ of the sample is below 95 is very small.

⭐ Key Takeaways

1. The Standard Error of Percentage (STEP) quantifies the variability of sample percentages and is used to calculate z-scores for probabilities and confidence intervals for population percentages.
2. The 95% confidence interval for a population percentage is approximately P ± 2 × STEP, where P is the sample percentage. This is a core method for estimation.
3. To achieve a desired margin of error (e.g., 5%) with 95% confidence, you can calculate the required sample size using the formula derived from the confidence interval equation.
4. The Standard Error of the Mean (STEM) measures the variability of sample means and is calculated as the population standard deviation divided by the square root of the sample size.
5. Understanding the difference between STEP (for percentages/proportions) and STEM (for means) is critical, as each is used in different types of inference problems.

🧠 Quick Revision Questions

1. What is the formula for the Standard Error of Percentage (STEP)?
2. What z-value is used for a 99% confidence interval?
3. If a sample of 400 consumers shows 70% are purchasers, calculate the 95% confidence interval for the population percentage.
4. What is the formula for the Standard Error of the Mean (STEM)?
5. A sample mean is 95, while the population mean is 100. The STEM is 1.875. Calculate the z-score for the sample mean.

📘 Lecture 43 — Hypothesis Testing: Chi-Square Distribution Part 1

📖 Overview: This lecture introduces hypothesis testing using the normal approximation to the binomial distribution. It explains how to test whether a sample differs significantly from a known population proportion, using the Null Hypothesis framework. The lecture also covers the Finite Population Correction Factor and reviews sampling error concepts.

🗂️ Topics Covered

The lecture begins with a review of sampling error using an example of tins of beans, then revisits the problem of faulty components. It introduces the Finite Population Correction Factor and presents the Training Manager's Problem as a case study for hypothesis testing. The core concepts of Null Hypothesis, STEP calculation, confidence intervals, and the procedure for carrying out hypothesis tests are explained with worked examples. The lecture concludes with further points about error types in hypothesis testing.

📝 Lecture Summary

Review Lecture 42

Example 1 — Confidence Interval for Population Mean An inspector took a sample of 100 tins of beans. The sample weight is 225 g. Standard deviation is 5 g. Calculate with 95% confidence the range of the population mean.

Since the population standard deviation is not known, use the sample standard deviation as an approximation.

📐 Formula: STEM = s.d / √n = 5 / √100 = 5 / 10 = 0.5

📌 Example: 95% confidence interval = 225 ± 2 × 0.5 = from 224 to 226 g.

Problem of Faulty Components Revisited

A box of 500 components may have 25 or 5% faulty components. Overall faulty items = 2%. P = 2%; n = 500

📐 Formula: STEP = √[P(100 – P)/n] = √[(2 × 98)/500] = √0.392 = 0.626

To find the probability that the sample percentage is 5% or over: z = (5 – 2)/STEP = 3/0.626 = 4.79

Area against z = 4.79 is negligible. The chance of such a sample is very small.

Finite Population Correction Factor

If the population is very large compared to the sample, multiply STEM and STEP by the:

📐 Formula: Finite Population Correction Factor = √[1 – (n/N)]

Where:

• N = Size of the population
• n = Size of the sample
• n must be less than 0.1N (sample is less than 10% of population)

🔑 Definition — Finite Population Correction Factor: A multiplier applied to standard errors when the sample size exceeds 10% of the population size, correcting for the reduced variability when sampling without replacement from a finite population.

💡 Why this matters: Without this correction, you would overestimate the standard error for large samples relative to population size, leading to wider confidence intervals than necessary.

Training Manager's Problem

A new refresher course for training of workers was completed. The Training Manager would like to assess the effect of retraining if any.

Particular questions:

• Is quality of product better than produced before retraining?
• Has the speed of machines increased?
• Do some classes of workers respond better to retraining than others?

The Training Manager hopes to:

• Compare the new position with established standard deviation
• Test a theory or hypothesis about the course

Case Study Before the course: Worker X produced 4% rejects. After the course: Out of 400 items, 14 were defective = 3.5%. An improvement?

The 3.5% figure may not demonstrate overall improvement. It does not follow that every single sample of 400 items contains exactly 4% rejects. To draw a sound conclusion, sampling variations must be taken into account.

We do not begin by assuming what we are trying to prove — we use the Null Hypothesis. We must begin with the assumption that there is no change at all.

🔑 Definition — Null Hypothesis: The initial assumption that there is no change or no difference; that the observed results are due to chance or sampling variation alone. It is the hypothesis we try to disprove.

Implication of Null Hypothesis: That the sample of 400 items taken after the course was drawn from a population in which the percentage of reject items is still 4%.

Null Hypothesis Example Data: P = 4%; n = 400

📐 Formula: STEP = √[P(100 – P)/n] = √[4(100 – 4)/400] = √[4 × 96/400] = √0.96 = 0.98%

At 95% confidence limit: Range = 4 ± 2 × 0.98 = 2.04 to 5.96%

📌 Example: The sample with 3.5% rejects falls inside the interval 2.04% to 5.96%. Conclusion: The sample is not inconsistent with the Null Hypothesis. There were no grounds for rejecting the Null Hypothesis.

Another Example Before the course: 5% rejects After the course: 2.5% rejects (10 out of 400)

P = 5 STEP = √[5(100 – 5)/400] = √[5 × 95/400] = √1.1875 = 1.09

Range at 95% Confidence Limits: = 5 ± 2 × 1.09 = 2.82% to 7.18%

📌 Example: The sample with 2.5% rejects falls outside the interval 2.82% to 7.18%. Conclusion: Doubt about Null Hypothesis most of the time. The Null Hypothesis should be rejected.

Procedure for Carrying Out Hypothesis Test

1. Formulate the Null Hypothesis
2. Calculate STEP and P ± 2 × STEP (the 95% confidence interval)
3. Compare the sample % with this interval to see whether it is inside or outside

Decision Rule:

• If the sample falls outside the interval: reject the Null Hypothesis (sample differs significantly from the population %)
• If the sample falls inside the interval: do not reject the Null Hypothesis (sample does not differ significantly from the population % at 5% level)

How the Rule Works

The bigger the difference between the sample and population percentages, the less likely it is that the population percentages will be applicable.

• When the difference is so big that the sample falls outside the 95% interval, then the population percentages cannot be applied. The Null Hypothesis must be rejected.
• If the sample belongs to the majority and it falls within the 95% interval, then there are no grounds for doubting the Null Hypothesis.

Further Points About Hypothesis Testing

• 99% interval requires 2.58 × STEP. The interval becomes wider. It is less likely to conclude that something is significant.
• Two types of errors can occur:

🔑 Definition — Type 1 Error: We might conclude there is a significant difference when there is none. The chance of this error equals the significance level (5% when using 95% confidence interval).

🔑 Definition — Type 2 Error: We might decide that there is no significant difference when there is one.

💡 Why this matters: The choice between 95% and 99% confidence levels involves a trade-off between these two error types. A wider interval (99%) reduces Type 1 error but increases Type 2 error.

⭐ Key Takeaways

The Null Hypothesis is the assumption of no change, and hypothesis testing determines whether sample evidence is strong enough to reject it. The test involves calculating STEP using the formula √[P(100–P)/n], constructing a 95% confidence interval around the population proportion (P ± 2×STEP), and checking whether the sample proportion falls inside or outside this interval. If the sample falls outside, we reject the Null Hypothesis (significant difference exists); if inside, we do not reject it. The Finite Population Correction Factor √[1–(n/N)] must be applied when the sample exceeds 10% of the population. Two types of errors exist: Type 1 (false positive — concluding significance when none exists, risk = 5% at 95% confidence) and Type 2 (false negative — missing a real difference).

🧠 Quick Revision Questions

1. What is the Null Hypothesis, and why must we begin a hypothesis test with this assumption?
2. Calculate STEP for a population with 8% defective items and a sample of 200 items.
3. If a sample of 300 items has 12% defectives and the population has 10% defectives, does this reject or fail to reject the Null Hypothesis at the 95% confidence level?
4. When must the Finite Population Correction Factor be applied, and what is its formula?
5. What is the difference between Type 1 Error and Type 2 Error in hypothesis testing?

📘 Lecture 44 — Hypothesis Testing: Chi-Square Distribution Part 2

📖 Overview: This lecture continues the study of hypothesis testing, building on concepts from Lecture 43. It covers detailed mechanics of one-tailed and two-tailed tests, introduces hypothesis testing for means and small samples using the t-distribution, and explains how to test differences between two sample means and more than one proportion using the Chi-Square distribution.

🗂️ Topics Covered

The lecture covers further points about hypothesis testing including one-tailed and two-tailed tests, hypothesis testing about means with worked examples, alternative hypothesis testing using z-values, a summary of the hypothesis testing process, testing hypotheses about small samples, the Student’s t-distribution, a summary of when to use z-tests vs. t-tests, testing differences between two sample means, testing more than one proportion using Chi-Square, and the use of Excel’s CHITEST function.

📝 Lecture Summary

Further Points About Hypothesis Testing

This section continues from Handout 43 and explains that we cannot draw conclusions about the direction of a difference without specifying a tail. Two possibilities are demonstrated: a one-tailed test and a two-tailed test.

🔑 Definition — One-tailed test: A test where the alternative hypothesis specifies a direction (greater than or less than). 📐 Formula:

• Range (one-tailed 5%): ( \text{Population proportion} - 1.64 \times \text{STEP} )
• Range (two-tailed 5%): ( \text{Population proportion} \pm 1.96 \times \text{STEP} ) 📌 Example (One-tailed): Null Hypothesis: ( P \ge 4% ) vs. ( P > 4% ). STEP = 0.98%. Range = ( 4 - 1.64 \times 0.98 = 2.39% ). New figure = 3.5%. Since 3.5% > 2.39%, there is no reason to conclude improvement. 📌 Example (Two-tailed): Same null. Range = ( 4 \pm 1.96 \times 0.98 = 2.08% ) to 5.92%. New figure = 3.5%. Since 3.5% falls within the range, no reason to conclude change.

Hypotheses About Means

This revisits the retraining course problem. Before the course: worker took 2.5 minutes per item, Standard Deviation = 0.5 min. After the course: sample of 64 items, mean = 2.58 min. Null hypothesis: no change.

🔑 Definition — STEM: Standard Error of the Mean = ( \frac{\text{population s.d.}}{\sqrt{n}} ) 📐 Formula: STEM = ( 0.5 / \sqrt{64} = 0.0625 ) 📌 Example: Range = ( 2.5 \pm 2 \times 0.0625 = 2.375 ) to 2.625 min. Sample mean (2.58) falls within this range. Conclusion: No grounds for rejecting the null hypothesis at 5% significance level.

Alternative Hypothesis Testing Using Z-Value

When testing proportion, we can compute a sample z-value and compare it with the critical z-value from the standard normal distribution.

📐 Formula: ( z = \frac{\text{sample percentage} - \text{population mean}}{\text{STEP}} ) 📌 Example: ( z = (3.5 - 4)/0.98 = -0.51 ). Compare with critical z ≈ 1.96 (5% two-tailed). Since 0.51 < 1.96, the probability of getting this sample by chance is greater than 5%. Sample is consistent with null hypothesis; do not reject.

Process Summary

This outlines the six-step hypothesis testing procedure:

1. State Null Hypothesis (1-tailed or 2-tailed)
2. Decide significance level and find critical value of z
3. Calculate sample z = (sample value – population value) ÷ STEP or STEM
4. Compare sample z with critical z
5. If sample z is smaller, do not reject Null Hypothesis
6. If sample z is greater, reject Null Hypothesis

Testing Hypotheses About Small Samples

Large sample means are normally distributed regardless of the underlying distribution, but this does not apply to small samples. For small samples, hypothesis testing requires that the underlying distribution is normal. If we only know the sample Standard Deviation and must approximate the population s.d., we use Student’s t-distribution.

Student’s t-Distribution

Student’s t-distribution is very similar to the normal distribution but is wider, reflecting greater uncertainty. As sample size n increases, the t-distribution approximates the normal distribution.

🔑 Definition — t-distribution: A family of distributions used when sample size is small and population standard deviation is unknown; depends on degrees of freedom (v = n – 1). 📐 Formula: STEM = ( \frac{\text{sample s.d.}}{\sqrt{n}} ) (using n – 1 divisor for s.d. calculation) 📌 Example: Population mean training time = 10 days. Sample of 8 women: mean = 9 days, sample s.d. = 2 days. STEM = ( 2/\sqrt{8} = 0.71 ). Null: no difference. t = ( (9 - 10)/0.71 = -1.41 ). v = 7. Critical t at 5% (2-tailed) = 2.365. Since 1.41 < 2.365, do not reject null hypothesis.

Summary - I

If underlying population is normal and we know the Standard Deviation, then distribution of sample means is normal with STEM = population s.d./√n, and we can use a z-test.

Summary - II

If underlying population is unknown but sample is large, then distribution of sample means is approximately normal with STEM = population s.d./√n, and we can use a z-test.

Summary - III

If underlying population is normal but we do not know its s.d. and sample is small, we use sample s.d. with n – 1 divisor. Distribution of sample means follows a t-distribution with n – 1 degrees of freedom, and we can use a t-test.

Summary - IV

If underlying population is not normal and we have a small sample, none of the hypothesis testing procedures can be safely used.

Testing Difference Between Two Sample Means

This section tests whether there is a significant difference between the mean wages of two groups: 30 production workers (mean = Rs. 120, s.d. = 10) and 50 maintenance workers (mean = Rs. 130, s.d. = 12).

🔑 Definition — STEDM: Standard Error of Difference in Sample Means 📐 Formula:

• ( s = \sqrt{\frac{n_1 s_1^2 + n_2 s_2^2}{n_1 + n_2}} )
• STEDM = ( s \times \sqrt{\frac{1}{n_1} + \frac{1}{n_2}} ) 💡 Why this matters: This allows testing whether two independent samples come from populations with the same mean. 📌 Example: ( s = \sqrt{(30 \times 100 + 50 \times 144)/(80)} = 11.29 ). STEDM = ( 11.29 \times \sqrt{1/30 + 1/50} = 2.60 ). ( z = (120 - 130)/2.60 = -3.85 ). This is well outside the critical z for 5% significance. Null hypothesis (no difference) is rejected.

Procedure Summary

1. State Null Hypothesis and decide significance level
2. Identify information and decide standard error and distribution needed
3. Calculate standard error
4. Calculate z or t = difference ÷ standard error
5. Compare with critical value; if greater, reject null hypothesis

More Than One Proportion

When analyzing improvement across age groups, we can test if the observed frequencies differ from expected frequencies under the assumption of uniform improvement.

🔑 Definition — Chi-squared (χ²): A statistic measuring the disagreement between observed and expected frequencies: ( \chi^2 = \sum \frac{(O - E)^2}{E} ) 📐 Formula: Degrees of freedom, v = (r – 1) × (c – 1), where r = rows, c = columns 📌 Example: Data:

• Under 35: 17 improved (14 expected), 4 did not (7 expected)
• 35-50: 17 improved (16 expected), 7 did not (8 expected)
• Over 50: 6 improved (10 expected), 9 did not (5 expected) Calculations: O – E = [3, 1, -4, -3, -1, 4]; (O-E)² = [9, 1, 16, 9, 1, 16]; (O-E)²/E = [0.643, 0.0625, 1.6, 1.286, 0.125, 3.2]; Total χ² = 6.92. v = (3-1)(2-1) = 2. Critical χ² at 5% = 5.991. Since 6.92 > 5.991, null hypothesis (uniform improvement) is rejected.

Chi-Squared Summary

1. Formulate null hypothesis (no association)
2. Calculate expected frequencies
3. Calculate χ²
4. Calculate degrees of freedom = (rows – 1) × (columns – 1); find critical χ²
5. Compare; if sample χ² is smaller, don’t reject null; if larger, reject null

CHITEST in Excel

The CHITEST function returns the test for independence. It returns the probability from the chi-squared distribution for the statistic and appropriate degrees of freedom.

🔑 Definition — CHITEST: Returns ( P(X > \chi^2) ), where ( \chi^2 = \sum \frac{(A_{ij} - E_{ij})^2}{E_{ij}} ), with degrees of freedom df = (r – 1)(c – 1). 📌 Example: For data with two groups, the probability for chi-squared = 16.16957 with 2 degrees of freedom was 0.000308, which is negligible, indicating strong evidence against the null hypothesis.

⭐ Key Takeaways

The most critical concepts from this lecture are: the distinction between one-tailed and two-tailed tests and how to compute ranges and z-values accordingly; the correct selection of z-test versus t-test based on sample size and knowledge of population standard deviation; the formula and interpretation of the Student’s t-distribution for small samples; the computation and meaning of the Standard Error of Difference in Means (STEDM) for comparing two samples; and the Chi-Square test for independence, including calculation of expected frequencies, χ² statistic, and degrees of freedom, along with the critical value comparison to determine whether to reject the null hypothesis.

🧠 Quick Revision Questions

1. What is the difference between a one-tailed and a two-tailed hypothesis test, and how does this affect the critical value used?
2. Under what conditions should a t-test be used instead of a z-test for hypothesis testing about means?
3. How is the Standard Error of Difference in Means (STEDM) calculated when comparing two independent samples?
4. What is the formula for the Chi-Square statistic, and how are degrees of freedom determined for a contingency table?
5. In a Chi-Square test, if the calculated χ² = 6.92 and the critical value at 5% with v = 2 is 5.991, what conclusion should be drawn?

📘 Lecture 45 — Planning Production Levels: Linear Programming

📖 Overview: This lecture introduces Linear Programming (LP) as a mathematical method for optimizing resource allocation under constraints. It covers the core components of LP models, their assumptions, and demonstrates how to formulate and solve production planning problems using graphical analysis.

🗂️ Topics Covered

The lecture reviews the components of a linear programming model including decision variables, objective functions, and constraints. It presents the methodology for formulating LP problems, discusses the importance and assumptions of LP, and works through a detailed production problem example involving two doll models. The dentist practice allocation problem is introduced as another application. Graphical analysis is explained step-by-step for finding feasible regions and optimal solutions, including the concepts of extreme points and multiple optimal solutions.

📝 Lecture Summary

INTRODUCTION TO LINEAR PROGRAMMING

A Linear Programming model seeks to maximize or minimize a linear function, subject to a set of linear constraints. The linear model consists of: a set of decision variables (xⱼ), an objective function (Σcⱼxⱼ), and a set of constraints (Σaᵢⱼxⱼ ≤ bᵢ).

THE FORMAT FOR AN LP MODEL

Maximize or minimize Σcⱼxⱼ = c₁x₁ + c₂x₂ + ... + cₙxₙ Subject to: aᵢⱼxⱼ ≤ bᵢ, for i = 1,...,m Non-negativity conditions: all xⱼ ≥ 0, j = 1,...,n

Here n is the number of decision variables and m is the number of constraints (there is no relation between n and m).

THE METHODOLOGY OF LINEAR PROGRAMMING

1. Define decision variables
2. Hand-write objective
3. Formulate math model of objective function
4. Hand-write each constraint
5. Formulate math model for each constraint
6. Add non-negativity conditions

THE IMPORTANCE OF LINEAR PROGRAMMING

Many real world problems lend themselves to linear programming modeling and can be approximated by linear models. There are well-known successful applications in: Operations, Marketing, Finance (investment), Advertising, and Agriculture. The output from linear programming packages provides useful “what if” analysis.

ASSUMPTIONS OF THE LINEAR PROGRAMMING MODEL

1. The parameter values are known with certainty
2. The objective function and constraints exhibit constant returns to scale
3. There are no interactions between the decision variables (the additivity assumption)
4. The Continuity assumption: Variables can take on any value within a given feasible range

💡 Why this matters: These assumptions form the foundation of LP. Violating them means the LP model may not accurately represent the real problem.

A PRODUCTION PROBLEM – A PROTOTYPE EXAMPLE

A company manufactures two toy doll models: Doll A and Doll B. Resources are limited to: 1000 kg of special plastic, 40 hours of production time per week. Marketing requirement: Total production cannot exceed 700 dozens, and the number of dozens of Model A cannot exceed the number of dozens of Model B by more than 350.

Decisions variables: X₁ = Weekly production level of Model A (in dozens) X₂ = Weekly production level of Model B (in dozens)

Objective Function: Maximize 800X₁ + 500X₂ (Weekly profit)

Subject to: 2X₁ + 1X₂ ≤ 1000 (Plastic) 3X₁ + 4X₂ ≤ 2400 (Production Time) X₁ + X₂ ≤ 700 (Total production) X₁ - X₂ ≤ 350 (Mix) Xⱼ ≥ 0, j = 1,2 (Nonnegativity)

ANOTHER EXAMPLE

A dentist is faced with deciding how best to split his practice between general dentistry and pedodontics (children’s dental care). The dentist employs three assistants and uses two operatories.

Each pedodontic service requires: .75 hours of operatory time, 1.5 hours of an assistant’s time, and .25 hours of the dentist’s time.

A general dentistry service requires: .75 hours of an operatory, 1 hour of an assistant’s time, and .5 hours of the dentist’s time.

Net profit: Rs. 1000 for each pedodontic service and Rs. 750 for each general dental service.

Time each day: eight hours of dentist’s, 16 hours of operatory time, and 24 hours of assistants’ time.

THE GRAPHICAL ANALYSIS OF LINEAR PROGRAMMING

Using a graphical presentation, we can represent all the constraints, the objective function, and the three types of feasible points.

GRAPHICAL ANALYSIS – THE FEASIBLE REGION: The feasible region is defined using non-negativity constraints. Each constraint is represented by a straight line, and the feasible region is the intersection area where all constraints are satisfied.

THE SEARCH FOR AN OPTIMAL SOLUTION

Constraints intersect to form a point that represents the optimal solution. The procedure is to start with a point representing a certain profit level (e.g., Rs. 200,000), then move the objective function line upwards (for maximization) until the last point on the feasible region is reached.

SUMMARY OF THE OPTIMAL SOLUTION

Model A = 320 dozen Model B = 360 dozen Profit = Rs. 436,000

This solution utilizes all the plastic and all the production hours. Total production is only 680 (not 700).

EXTREME POINTS AND OPTIMAL SOLUTIONS

If a linear programming problem has an optimal solution, an extreme point is optimal. The optimal solution will always occur at a corner point of the feasible region.

MULTIPLE OPTIMAL SOLUTIONS

There may be more than one optimal solution when the objective function is parallel to one of the constraints. If a weighted average of different optimal solutions is obtained, it is also an optimal solution.

⭐ Key Takeaways

Linear Programming is a powerful optimization tool for allocating limited resources under constraints. The decision variables (X₁, X₂) represent quantities to decide, the objective function maximizes or minimizes a linear expression (e.g., profit), and constraints represent resource limits (e.g., ≤) or other restrictions. The graphical method identifies the feasible region defined by all constraints, and the optimal solution lies at an extreme point (corner) of this region. The prototype production example demonstrates transforming a business problem into a mathematical model and solving it to find optimal production levels (320 dozen of Model A, 360 dozen of Model B) yielding maximum profit of Rs. 436,000.

🧠 Quick Revision Questions

1. What are the three core components of any Linear Programming model?
2. In the prototype production problem, what do the coefficients 800 and 500 represent in the objective function?
3. What does the constraint X₁ - X₂ ≤ 350 represent in the doll production problem?
4. Why must the optimal solution always occur at an extreme point of the feasible region?
5. Under what condition can there be multiple optimal solutions in a Linear Programming problem?