π Lecture 23 β Data Representation
π Overview: This lecture introduces the fundamental techniques for summarizing and describing qualitative data, both in univariate and bivariate situations. It covers tabulation methods and various graphical representations, explaining how to choose the appropriate chart based on the nature of the data. Understanding these methods is crucial for effectively communicating data insights without losing essential information.
ποΈ Topics Covered
The lecture begins by outlining two broad categories of data: qualitative and quantitative. It then focuses on qualitative data, starting with univariate frequency tables and the pie chart. Next, it covers the simple bar chart for time-series or ordered data. The discussion expands to bivariate frequency tables for two qualitative variables, followed by the component bar chart for comparing totals and their parts, and finally the multiple bar chart for comparing two distinct but related variables.
π Lecture Summary
Data Representation
The lecture begins by reiterating the two main categories of data: qualitative and quantitative. For summarizing and describing these types of data, a variety of methods exist, as outlined in a tree-diagram.
π Definition β Qualitative Data: Data that can be classified into non-numerical categories, such as "Urdu Medium" or "English Medium". π Definition β Quantitative Data: Numerical data that can be either discrete or continuous.
π‘ Why this matters: The first step in any data analysis is correctly identifying the data type, as this determines which summarization and visualization techniques are valid and appropriate to use.
Univariate Frequency Table
Summarizing a single qualitative variable begins by counting the number of observations in each category. This creates a univariate frequency table.
π Example: In a survey of 1200 first-year students about their medium of schooling (Urdu or English), the results are:
- 719 students from Urdu medium schools
- 481 students from English medium schools
This raw count is the frequency (f). To make the data more useful, proportions or percentages are calculated.
- Urdu: 719 / 1200 = 0.599 β 60%
- English: 481 / 1200 = 0.401 β 40%
Pie Chart
A pie chart is a circular diagram divided into sectors, where the size of each sector is proportional to its category's frequency. The angle for each sector is determined by dividing the cell frequency by the total frequency and multiplying by 360Β°.
π Formula: Sector Angle = (Category Frequency / Total Frequency) Γ 360Β°
π Example: For the student survey:
- Urdu Sector Angle: (719 / 1200) Γ 360Β° = 215.7Β°
- English Sector Angle: (481 / 1200) Γ 360Β° = 144.3Β°
This creates a visual representation where the circle is cut into two sectors representing the two mediums of schooling.
Simple Bar Chart
A simple bar chart consists of horizontal or vertical bars of equal width, with lengths proportional to the values they represent. It is useful for comparing distinct categories or values over time.
π Definition β Simple Bar Chart: A chart with bars of equal width where the length of each bar is proportional to the value it represents. When values do not relate to time, they should be arranged in ascending or descending order before charting.
π Example: The turnover of a company for the years 1965 to 1969 is shown below:
| Years | Turnover (Rupees) |
|---|---|
| 1965 | 35,000 |
| 1966 | 42,000 |
| 1967 | 43,500 |
| 1968 | 48,000 |
| 1969 | 48,500 |
In the bar chart, the x-axis represents the year, and the y-axis has a scale for turnover. A vertical bar is drawn against each year, with a height corresponding to the turnover figure.
Bivariate Frequency Table
When summarizing two qualitative variables simultaneously, a bivariate frequency table is constructed. This table has a "boxhead" (top row) and a "stub" (first column).
π Definition β Bivariate Frequency Table: A table used to summarize the frequencies of two or more categorical variables simultaneously.
π Example: Revisiting the student survey, if we also record the sex of each student, we get a bivariate situation. The table categorizes students into four groups: Male/Urdu, Female/Urdu, Male/English, and Female/English.
| Sex / Med. | Male | Female | Total |
|---|---|---|---|
| Urdu | 202 | 517 | 719 |
| English | 350 | 131 | 481 |
| Total | 552 | 648 | 1200 |
Component Bar Chart
A component bar chart (or subdivided bar chart) is used to display the totals of different groups and their components. Each bar represents a total, and is subdivided into parts representing the components that make up that total.
π Definition β Component Bar Chart: A bar chart where each bar is divided into parts, usually stacked on top of each other, to show how a whole is broken down into its constituent components.
π Example: For the bivariate student data, two bars are drawn: one for "Male" and one for "Female". Each bar is subdivided into two parts:
- The lower part represents students from English medium schools.
- The upper part represents students from Urdu medium schools. This allows for a quick comparison of both the total number of male vs. female students and the composition of their schooling medium.
π‘ Why this matters: The component bar chart is ideal when the components (e.g., Urdu and English students) logically add up to the total for each group (e.g., total male students).
Multiple Bar Chart
A multiple bar chart consists of sets of grouped bars, where each bar in a group represents a different variable. The bars are shaded or coloured differently to aid identification.
π Definition β Multiple Bar Chart: A bar chart that uses two or more sets of bars to compare two or more distinct variables across the same categories (e.g., years).
π Example: Comparing imports and exports of Pakistan from 1970-71 to 1974-75.
| Years | Imports (Crores Rs.) | Exports (Crores Rs.) |
|---|---|---|
| 1970-71 | 370 | 200 |
| 1971-72 | 350 | 337 |
| 1972-73 | 840 | 855 |
| 1973-74 | 1438 | 1016 |
| 1974-75 | 2092 | 1029 |
In the chart, for each year, one bar represents the value of imports and an adjacent bar represents the value of exports. This provides a clear visual comparison of the two variables over time. The basic difference is that in a component bar chart, the parts add up to a total, whereas in a multiple bar chart, they do not.
π‘ Why this matters: The multiple bar chart is excellent for comparing two or more separate but related trends, like imports vs. exports, or sales of product A vs. product B.
β Key Takeaways
The most critical exam points from this lecture are the distinction between a pie chart and a bar chart for univariate data, and the crucial difference between a component bar chart and a multiple bar chart for bivariate data. You must know that a component bar chart is for data where categories add up to a total (like parts of a whole), whereas a multiple bar chart compares separate, non-additive variables (like imports and exports). Also, remember that a simple bar chart is used for a single variable, and its values should be ordered if they are not time-based. Finally, the sector angle formula for a pie chart is (frequency / total) * 360Β°.
π§ Quick Revision Questions
- What is the first step in summarizing a univariate qualitative dataset?
- Explain the key difference between a component bar chart and a multiple bar chart, using an example for each.
- In a pie chart, how is the sector angle for a category calculated?
- When constructing a simple bar chart for data that does not relate to time, what arrangement should the values be in?
- A survey records a student's "favorite subject" (Math, Science, English) and their "grade level" (9, 10, 11). Which type of chart would best represent this bivariate data?
π Lecture 24 β The Central Tendency of a Data Set
π Overview: This lecture continues the discussion on measures of central tendency, focusing on the mode, its properties, and special cases like non-modal and bi-modal distributions. It then introduces the arithmetic mean as the most widely used average, covering its calculation for both ungrouped and grouped data, along with the concept of grouping error. Finally, the lecture explains the weighted arithmetic mean and the median, illustrating their applications and advantages in various scenarios.
ποΈ Topics Covered
The lecture revisits the formula for calculating the mode in a grouped frequency distribution and its desirable properties. It then introduces and defines the arithmetic mean, demonstrating its computation for raw data and grouped data using the class-mark method, while discussing the grouping error. The concept of the weighted arithmetic mean is introduced with a practical example, followed by a detailed explanation of the median, including its calculation for raw data and discrete frequency distributions.
π Lecture Summary
The Mode
The lecture begins by revising the mode calculation from the previous lecture, using the example of EPA mileage ratings. The formula for the mode in a grouped frequency distribution is:
Mode:
XΜ = l + [(f_m - f_1) / (f_m - f_1) + (f_m - f_2)] * h
Where:
- l = lower class boundary of the modal class
- f_m = frequency of the modal class
- f_1 = frequency of the class preceding the modal class
- f_2 = frequency of the class following the modal class
- h = length of class interval of the modal class
For the EPA mileage data, the modal class is 36.0 β 38.9 with a frequency of 14.
XΜ = 35.95 + [(14 - 4) / (14 - 4) + (14 - 8)] * 3
XΜ = 35.95 + [10 / 16] * 3
XΜ = 35.95 + 1.875 = 37.825
The mode lies in the middle of the frequency distribution, qualifying it as a measure of central tendency.
π Definition β Mode: The value that occurs most frequently in a data set.
Desirable Properties of the Mode:
- The mode is easily understood and ascertained for discrete frequency distributions.
- It is not affected by a few very high or low values.
When to use the Mode: The mode is valuable for inventory problems. For example, a clothing store manager would use the modal hat size to stock the greatest quantity, as this is the size sold most often. π‘ Why this matters: The mode is a practical average for business decisions where the most common item is needed.
Special Cases:
- No Mode: A simple series may have no mode if no value occurs more than once.
- Bi-modal Distribution: A frequency distribution with two modes is called bi-modal.
The Arithmetic Mean
The arithmetic mean is the statistician's term for the average. It is the most widely used and easiest measure of central tendency to calculate.
π Definition β Arithmetic Mean: A value obtained by dividing the sum of all observations by their number.
For Ungrouped Data:
XΜ = Ξ£X / n
Formula: XΜ = (Sum of all observations) / (Number of observations)
π Example: A news agent's weekly receipts are: Β£9.90, Β£7.75, Β£19.50, Β£32.75, Β£63.75, Β£75.50, Β£50.70.
XΜ = Β£259.85 / 7 = Β£37.12
Interpretation: The mean, Β£37.12, represents the amount that would have been obtained each day if the same amount were obtained every day.
For Grouped Data (Frequency Distribution): When data is grouped into a frequency distribution, the identity of individual observations is lost. Therefore, the observations in each class are assumed to be identical with the class midpoint (Xi).
Class-Mark (Midpoint): The midpoint of each class, obtained by adding the sum of the two limits of the class and dividing by 2.
Formula: XΜ = Ξ£fX / Ξ£f = Ξ£fX / n
π Example: Using the EPA mileage ratings:
| Class (Mileage Rating) | Class-mark (X) | Frequency (f) | fX |
|---|---|---|---|
| 30.0 β 32.9 | 31.45 | 2 | 62.9 |
| 33.0 β 35.9 | 34.45 | 4 | 137.8 |
| 36.0 β 38.9 | 37.45 | 14 | 524.3 |
| 39.0 β 41.9 | 40.45 | 8 | 323.6 |
| 42.0 β 44.9 | 43.45 | 2 | 86.9 |
| Total | 30 | 1135.5 |
XΜ = 1135.5 / 30 = 37.85
Interpretation: The average mileage rating of the 30 cars is 37.85 miles per gallon.
π Definition β Grouping Error: The error introduced by the assumption that all values falling in a class are equal to the mid-point of the class interval.
The mean from a frequency distribution is an approximation. The true mean from the raw data is 37.82, while the grouped mean is 37.85, showing the error is usually small and never serious for the arithmetic mean.
Desirable Properties of the Arithmetic Mean:
- Best understood average in statistics.
- Relatively easy to calculate.
- Takes into account every value in the series.
Limitation: The mean can be distorted by a few very high or very low values.
π Example: Number of floors in buildings: 5, 4, 3, 4, 5, 4, 3, 4, 5, 20, 5, 6, 32, 8, 27. The mean is 9, but 12 out of 15 buildings have 6 floors or less. The skyscrapers have a disproportionate effect on the mean.
The Weighted Arithmetic Mean
The weighted mean is used when data values cannot be regarded as having equal weightage.
Formula: XΜ_w = Ξ£W_i X_i / Ξ£W_i
π Example: Absenteeism in a high school:
| Category | % Absent (X_i) | Students Enrolled (W_i) | W_i X_i |
|---|---|---|---|
| Freshman | 15 | 100 | 1500 |
| Sophomore | 5 | 80 | 400 |
| Junior | 10 | 70 | 700 |
| Senior | 2 | 50 | 100 |
| Total | 300 | 2700 |
XΜ_w = 2700 / 300 = 9
The weighted mean correctly shows that 9% of students are absent, unlike the simple average of 8%.
π Definition β Weighted Mean: A mean calculated by assigning a weight to each value, based on its relative importance.
The Median
The median is the middle value of a series when arranged in order of magnitude. It divides the data into two equal halves.
π Definition β Median: A value which divides a set of data into two halves, one half comprising of observations greater than and the other half smaller than it. It is the value at or below which 50% of the data lie.
For Ungrouped Data with an Odd Number of Observations: π Example: Number of floors: 3, 3, 4, 4, 4, 4, 5, 5, 5, 5, 6, 8, 20, 27, 32. The median is the 8th value (middle of 15), which is 5. This is more representative than the mean (9).
For Ungrouped Data with an Even Number of Observations:
The median is the arithmetic mean of the two middle values.
π Example: Passengers on a bus: 4, 9, 14, 18, 23, 47.
Median = (14 + 18) / 2 = 16 passengers
For a Discrete Frequency Distribution: To find the median, construct a column of cumulative frequencies. Find the total number of observations (n). The median is the value of the observation at the (n/2)th position. If n is even, the median is the value at the (n/2)th and (n/2 + 1)th position.
π Example: Number of pupils per class:
| Pupils (X) | Classes (f) | Cumulative Freq (cf) |
|---|---|---|
| 23 | 1 | 1 |
| 24 | 0 | 1 |
| 25 | 1 | 2 |
| 26 | 3 | 5 |
| 27 | 6 | 11 |
| 28 | 9 | 20 |
| 29 | 8 | 28 |
| 30 | 10 | 38 |
| 31 | 7 | 45 |
n = 45. The median is the 23rd class. 20 classes have up to 28 pupils, and 28 classes have up to 29 pupils. Thus, the 23rd class has 29 pupils.
β Key Takeaways
- The mode is the most frequent value, useful for inventory and business decisions but can be non-existent or bi-modal. The arithmetic mean is the sum divided by the number of observations, taking all values into account but susceptible to outliers. The median is the middle value, making it robust to extreme values.
- For grouped data, the class-mark (midpoint) is used to approximate the arithmetic mean, introducing a small grouping error which is usually negligible.
- The weighted arithmetic mean is crucial when data points have different levels of importance, assigning weights to each value for a correct overall average.
- The median is the preferred measure of central tendency for skewed distributions or when outliers are present, as it accurately represents the central location without being distorted.
- For an even number of raw data points, the median is the average of the two middle values. For a discrete frequency distribution, it is found by locating the middle value using cumulative frequencies.
π§ Quick Revision Questions
- What is the formula for the mode in a grouped frequency distribution, and what does each symbol represent?
- Explain the difference between the arithmetic mean and the weighted arithmetic mean, providing a scenario where the weighted mean is necessary.
- How is the median calculated for a dataset with an even number of observations, and why is it often preferred over the mean for data with extreme values?
- What is "grouping error" and why is it generally not a serious issue when calculating the arithmetic mean from grouped data?
- In a discrete frequency distribution of class sizes, with 45 total classes, how would you determine that the median number of pupils per class is 29?
π Lecture 25 β Median, Empirical Relation, Quartiles
π Overview: This lecture extends the concept of the median to frequency distributions of continuous variables and open-ended distributions. It introduces the empirical relation between the mean, median, and mode, and then explores the broader family of quantilesβincluding quartiles, deciles, and percentilesβwhich allow us to partition data into equal parts. Finally, it demonstrates the graphic location of these measures using an ogive, providing a quick visual method for analysis.
ποΈ Topics Covered
The lecture begins with the formula for the median in a continuous frequency distribution, illustrated with the EPA mileage ratings example. It then addresses the special case of open-ended frequency distributions. The empirical relation between the mean, median, and mode is introduced for moderately skewed, unimodal distributions. The concept of quantiles is formally defined, with formulas for quartiles, deciles, and percentiles. The lecture concludes with the method for the graphic location of these quantiles using a cumulative frequency polygon (ogive).
π Lecture Summary
Median in Case of a Frequency Distribution of a Continuous Variable
For a frequency distribution, the median is calculated using a specific interpolation formula. This formula assumes that observations within the median class are evenly distributed between its class boundaries.
π Definition β Median Class: The class interval for which the cumulative frequency is just in excess of n/2.
π Formula: $$\tilde{X} = l + \frac{h}{f}\left(\frac{n}{2} - c\right)$$ β This formula gives the median value by starting at the lower boundary of the median class (l) and adding a fraction of the class interval size (h), proportional to how far into the class the median falls. f is the frequency of the median class, n is the total number of observations, and c is the cumulative frequency of the class before the median class.
π Example: For the EPA mileage ratings data:
- n = 30, n/2 = 15. The median class is 36.0 β 38.9 (class boundaries 35.95 β 38.95).
- l = 35.95, h = 3, f = 14, c = 6.
- Applying the formula: $\tilde{X} = 35.95 + \frac{3}{14}(15 - 6) = 35.95 + 1.93 = 37.88 \approx 37.9$ miles per gallon.
- This means half of the cars have mileage less than or up to 37.88 mpg. π‘ Why this matters: The median is preferable to the mean when data contains extreme values, as it is not pulled by outliers.
Median in Case of an Open-Ended Frequency Distribution
An open-ended frequency distribution has classes like "Less than 2000" or "5000 and above". One major advantage of the median in such cases is that, unless the median itself falls into an open-ended class, there is no need to estimate the missing boundary.
π Example: The distribution of workers' wages:
| Monthly Income (Rupees) | No. of Workers |
|---|---|
| Less than 2000/- | 100 |
| 2000/- to 2999/- | 300 |
| 3000/- to 3999/- | 500 |
| 4000/- to 4999/- | 250 |
| 5000/- and above | 50 |
| Total | 1200 |
| Here, the median will fall in the third class (3000-3999/-), so the open boundaries of the first and last classes do not affect its calculation. |
Empirical Relation Between Mean, Median and Mode
This is an observational relationship that holds for unimodal distributions of moderate skewness. In such distributions, the median is sandwiched between the mean and the mode. The key observation is that the distance between the mode and the median is roughly twice the distance between the median and the mean.
π Definition β Empirical Relation: An approximate relationship based on observation, not a rigid mathematical law.
π Formula: Mode = 3 Median β 2 Mean β This is derived from the relationship: Median β Mode = 2 (Mean β Median), which simplifies to the formula above.
π‘ Why this matters: In a perfectly symmetrical distribution, the mean, median, and mode are all equal. This empirical relation quantifies how they separate in a skewed distribution. It does not hold for J-shaped or extremely skewed distributions.
Quartiles, Deciles & Percentiles
These are collectively known as quantiles (or fractiles) and are used to partition a frequency distribution into equal parts, allowing for a more detailed analysis of data position. The median is the second quartile, the 5th decile, and the 50th percentile.
π Definition β Quartiles: The three values ((Q_1, Q_2, Q_3)) that divide the total area under a frequency polygon into four equal parts (25% each). π Definition β Deciles: The nine values ((D_1) to (D_9)) that divide the total area into ten equal parts. π Definition β Percentiles: The 99 values ((P_1) to (P_{99})) that divide the total area into 100 equal parts.
π Formula (General Quantile Formula): $$Q_k = l + \frac{h}{f}\left(\frac{kn}{100} - c\right)$$ β This is a general formula where k is the desired percentile (e.g., k = 25 for (Q_1), k = 50 for median). For deciles, (\frac{kn}{100}) is replaced by (\frac{kn}{10}), and for quartiles, by (\frac{kn}{4}).
π Example: Company Aβs yearly sales are at the 90th percentile. This means 90% of all companies have less sales than Company A, and only 10% have more sales. This shows how percentiles provide a relative quantitative location for a measurement within a data set. π‘ Why this matters: Percentile ranking is a powerful tool for comparison, but it is only practically valuable for large data sets.
Graphic Location of Quantiles
Quantiles can be located graphically using a cumulative frequency polygon (ogive).
π Example (EPA Mileage Ratings):
- Plot the Ogive: Draw the cumulative frequency polygon for the data.
- Locate Median:
- Calculate n/2 = 15.
- Draw a horizontal line from 15 on the y-axis to the ogive.
- From the point of intersection, draw a vertical line down to the x-axis.
- Read the value on the x-axis, which is approximately 37.9, matching the calculated median.
- Locate Quartiles:
- For (Q_1): draw a horizontal line from n/4 on the y-axis.
- For (Q_3): draw a horizontal line from 3n/4 on the y-axis.
- Locate Deciles & Percentiles: The same process is followed, drawing horizontal lines from the corresponding fraction of n (e.g., n/10, 2n/100).
β Key Takeaways
You must remember the median formula for grouped data and the empirical relation (Mode = 3 Median β 2 Mean) for moderately skewed distributions. The general formula for all quantiles (quartiles, deciles, percentiles) follows the same structure as the median, only changing the fraction of n. The graphic location of any quantile is always done by drawing a horizontal line from the appropriate cumulative value on the y-axis to the ogive, then dropping a vertical line to the x-axis. Remember that median, Q2, D5, and P50 are all the same measure, just different names.
π§ Quick Revision Questions
- What are the four components ((l, h, f, c)) of the median formula for a continuous frequency distribution?
- Write down the empirical relation between the mean, median, and mode for a moderately skewed distribution.
- What is the difference between a quartile, a decile, and a percentile?
- Which quantile is equivalent to the 40th percentile and the 4th decile?
- Describe the process for graphically locating the 3rd quartile ((Q_3)) from a cumulative frequency polygon (ogive).
π Lecture 26 β Geometric mean, Harmonic mean & relationship between them
π Overview: This lecture introduces two additional measures of central tendency β the geometric mean and harmonic mean β explaining their computation for raw and grouped data. It clarifies when each measure is appropriate, establishes the mathematical relationship between the arithmetic, geometric, and harmonic means, and briefly covers two other measures: mid-range and mid-quartile range.
ποΈ Topics Covered
The lecture covers the geometric mean for raw and grouped data, its use in averaging relative changes, and a detailed example involving firm turnover. It then presents the harmonic mean, its application with a speed-distance-time example, and rules for selecting the appropriate average. Finally, the relationship between the three means is stated, followed by the mid-range and mid-quartile range as other measures of central tendency.
π Lecture Summary
GEOMETRIC MEAN:
The geometric mean (G) of a set of n positive values X1, X2,β¦, Xn is defined as the positive nth root of their product. The formula is G = (X1ΓX2Γβ¦ΓXn)^(1/n), where all Xi > 0. For large n, computation becomes cumbersome due to root extraction, so logarithms simplify the process: log G = (βlog X)/n, thus G = antilog( (βlog X)/n ).
π Definition β Geometric Mean: the positive nth root of the product of n positive values. π Formula: log G = (βlog X)/n β G is the antilog of the average of the logs of all X values. π Example: Find GM of the numbers: 45, 32, 37, 46, 39, 36, 41, 48, 36. Step 1: Compute log of each value (base 10): 1.6532, 1.5052, 1.5682, 1.6628, 1.5911, 1.5563, 1.6128, 1.6812, 1.5563. Step 2: Sum of logs = 14.3870. n = 9. Step 3: log G = 14.3870/9 = 1.5986. Step 4: G = antilog(1.5986) = 39.68.
GEOMETRIC MEAN FOR GROUPED DATA:
For a frequency distribution with k classes, midpoints X1,β¦,Xk, and frequencies f1,β¦,fk (βf = n), the geometric mean formula becomes G = (X1^f1 Γ X2^f2 Γ β¦ Γ Xk^fk)^(1/n). In log terms: log G = (β f log X)/n, so G = antilog( (β f log X)/n ).
π Formula: log G = (β f log X)/n β the weighted average of logarithms, weighted by frequency. π Example: EPA mileage ratings data (30 cars). Class marks (X): 31.45, 34.45, 37.45, 40.45, 43.45. Their logs: 1.4976, 1.5372, 1.5735, 1.6069, 1.6380. Frequencies: 2, 4, 14, 8, 2. f log X values: 2.9952, 6.1488, 22.0290, 12.8552, 3.2760. β f log X = 47.3042. n = 30. log G = 47.3042/30 = 1.5768. G = antilog(1.5768) = 37.74 mph.
WHEN TO USE THE GEOMETRIC MEAN:
When relative changes in some variable quantity are averaged, the geometric mean is preferred over the arithmetic mean.
π Example: Firmβs turnover (year, turnover, percent of previous year): 1958: Β£2000; 1959: Β£2500 (125%); 1960: Β£5000 (200%); 1961: Β£7500 (150%); 1962: Β£10500 (140%). Arithmetic mean of percentages = (125+200+150+140)/4 = 153.75%. Using this, the computed 1962 turnover is Β£11,176 β incorrect. Geometric mean = (125Γ200Γ150Γ140)^(1/4) = 151.37%. Using this, the computed 1962 turnover is exactly Β£10,500 β correct. Interpretation: On average, each yearβs turnover is 51.37% higher than the previous year. π‘ Why this matters: The arithmetic mean overestimates average growth rates because it ignores the multiplicative nature of successive percentage changes. The geometric mean correctly averages ratios.
HARMONIC MEAN:
The harmonic mean (HM) is defined as the reciprocal of the arithmetic mean of the reciprocals of the values. For raw data: HM = n / β(1/X). For grouped data (with midpoints X and frequencies f): HM = n / β(f/X).
π Definition β Harmonic Mean: reciprocal of the arithmetic mean of the reciprocals of the data values. π Formula (raw data): HM = n / β(1/X) β average of reciprocals, then take reciprocal. π Example: Car travels 10 intervals of 10 miles each at varying speeds (30,35,40,40,45,40,50,55,55,30 mph). Find average speed. Arithmetic mean of speeds = 42 mph. But average speed = total distance (100 miles) / total time. Total time = sum of (10/speed) for each interval = 10/30+10/35+10/40+10/40+10/45+10/40+10/50+10/55+10/55+10/30 = 2.4881 hours. True average speed = 100/2.4881 = 40.2 mph. Harmonic mean: HM = n/β(1/X) = 10/(0.0333+0.0286+β¦+0.0333) = 10/0.2488 = 40.2 mph. Correct result.
RULES FOR SELECTING THE APPROPRIATE AVERAGE:
- When values are given as x per y where x is constant and y is variable, the Harmonic Mean is appropriate.
- When values are given as x per y where y is constant and x is variable, the Arithmetic Mean is appropriate.
- When relative changes in a variable are to be averaged, the Geometric Mean is appropriate.
π Example (Rule 2): Marks out of 20 for 10 students (13,11,9,9,6,5,19,17,12,9). Denominator (20) is constant, numerator varies. Arithmetic mean = 110/10 = 11. This is correct.
RELATION BETWEEN ARITHMETIC, GEOMETRIC AND HARMONIC MEANS:
For any set of positive values: Arithmetic Mean β₯ Geometric Mean β₯ Harmonic Mean. Equality holds only when all values are equal.
SOME OTHER MEASURES OF CENTRAL TENDENCY:
Mid-Range: If x0 is the smallest observation and xm is the largest, then mid-range = (x0 + xm)/2. It represents a value roughly in the middle of the dataset by averaging extremes.
Mid-Quartile Range (Mid-Hinge): If Q1 is the first quartile and Q3 is the third quartile, then mid-quartile range = (Q1 + Q3)/2. It averages the upper and lower quartiles.
π Definition β Mid-Range: arithmetic mean of the smallest and largest observations. π Definition β Mid-Quartile Range: arithmetic mean of the first and third quartiles; also called mid-hinge.
β Key Takeaways
The geometric mean is essential when averaging ratios or percentage changes because it correctly captures multiplicative growth, while the harmonic mean is necessary when averaging rates where the numerator is fixed (like constant distance with variable speed). Arithmetic mean overestimates average growth rates, so the choice of measure critically affects results. The relationship A.M. β₯ G.M. β₯ H.M. always holds for positive data, and the mid-range and mid-quartile range offer simpler alternatives for a quick center estimate. Students must apply the three rules to select the correct average in any problem.
π§ Quick Revision Questions
- Why does computing the geometric mean of raw data use logarithms, and what is the formula?
- A firmβs annual profits are 120%, 150%, 110%, and 130% of the previous year. Which average correctly computes the average annual growth? Show the calculation.
- If you have a speed of 60 km/h for the first 50 km and 40 km/h for the next 50 km, what is the correct average speed? Which mean gives it?
- State the relationship between arithmetic, geometric, and harmonic means for positive unequal values.
- Define the mid-range and mid-quartile range. When might they be used instead of the arithmetic mean?
π Lecture 27 β Measures of Dispersion
π Overview: This lecture introduces the concept of dispersion as a measure of variability in data, distinguishing it from measures of central tendency. It covers absolute and relative measures, specifically the range and quartile deviation, along with their coefficients, and explains why measuring spread is critical for data analysis.
ποΈ Topics Covered
The lecture begins with the concept of dispersion and why it is needed alongside averages, using examples of age and class-size distributions to illustrate that identical means can hide very different spreads. It then defines absolute versus relative measures, followed by detailed explanations of the range and its coefficient of dispersion, and the quartile deviation and its coefficient of quartile deviation, including their calculations, graphical representations, advantages, and disadvantages. The lecture concludes by introducing the mean deviation and standard deviation as measures based on all data values.
π Lecture Summary
Concept of dispersion
Just as variable series differ in their location (average), they also differ in the amount of variability they exhibit. We need a measure of variability or dispersion to accompany the relevant measure of position or βaverageβ, as identical averages can come from entirely different distributions.
π Definition β Dispersion: The amount of variability or spread present in a set of data.
π‘ Why this matters: Two datasets can have the same mean but very different distributions, so dispersion measures are essential for a complete description.
Absolute and relative measures of dispersion
There are two types of measurements of dispersion: absolute and relative. An absolute measure of dispersion measures dispersion in the same units as the data. A relative measure of dispersion is expressed as a ratio, coefficient, or percentage and is independent of units.
π Definition β Absolute measure of dispersion: A measure that is expressed in the same units as the original data (e.g., rupees, meters, kilograms).
π Definition β Relative measure of dispersion: A measure that is expressed as a ratio, coefficient, or percentage, making it unitless and useful for comparing datasets of different natures.
Range
The range is defined as the difference between the two extreme values of a dataset, i.e., R = Xm β X0 where Xm is the highest value and X0 the lowest.
π Formula: Range = Xm β X0 β The highest value minus the lowest value in the dataset.
Coefficient of dispersion
The coefficient of dispersion is the relative measure of the range, defined as half the range divided by the mid-range.
π Formula: Coefficient of Dispersion = (Xm β X0) / (Xm + X0)
This is a pure (dimensionless) number used for comparison purposes. For example, if the coefficient is 0.6 for one dataset and 0.4 for another, there is greater dispersion in the first.
Quartile deviation
The quartile deviation (Q.D.) is defined as half of the difference between the third and first quartiles.
π Formula: Q.D. = (Qβ β Qβ) / 2
It is also known as the semi-interquartile range. The range βMedian Β± Q.D.β contains approximately 50% of the data.
π Example: For Company X: Qβ = 60 shares, Median = 185 shares, Qβ = 270 shares. Q.D. = (270 β 60) / 2 = 105 shares. For Company Y: Qβ = 165 shares, Median = 185 shares, Qβ = 210 shares. Q.D. = (210 β 165) / 2 = 22 shares. This indicates greater concentration of shareholders about the median in Company Y compared to Company X.
Coefficient of quartile deviation
The coefficient of quartile deviation is the relative measure of the quartile deviation, defined as the quartile deviation divided by the mid-quartile range.
π Formula: Coefficient of Quartile Deviation = (Qβ β Qβ) / (Qβ + Qβ)
This is a pure number used for comparing variation in two or more sets of data.
β Key Takeaways
The range is the simplest measure of dispersion but is unreliable because it only considers the two extreme values, ignoring all intermediate data. The quartile deviation is superior to the range as it is not affected by extreme values and, together with the median, describes the spread of the middle 50% of data. Both the range and quartile deviation are associated with specific averages: the range with the mid-range and the quartile deviation with the median. Relative measures like the coefficient of dispersion and coefficient of quartile deviation are unitless and essential for comparing variability between different datasets. The mean deviation and standard deviation were introduced as the next measures that use all data values, overcoming the limitation of the range and quartile deviation.
π§ Quick Revision Questions
- Why is a measure of dispersion needed even when the mean of two datasets is identical?
- What is the difference between an absolute and a relative measure of dispersion?
- Calculate the range for the dataset: 17, 18, 18, 19, 18, 19, 19, 18, 17, 18, 18.
- If Qβ = 25 and Qβ = 75, what is the quartile deviation, and what approximate percentage of data lies between the median minus this value and the median plus this value?
- How is the coefficient of quartile deviation calculated, and why is it useful?
π Lecture 28 β Mean Deviation, Standard Deviation and Variance & Coefficient of variation
π Overview: This lecture introduces key measures of dispersion that involve every data value in a dataset. Unlike the range and quartile deviation, the mean deviation and standard deviation consider all observations and are essential for understanding the spread of data around the arithmetic mean, with the standard deviation being the most important measure in statistics.
ποΈ Topics Covered
The lecture covers the mean deviation as a measure of dispersion (for raw data and grouped data), moving to the standard deviation and variance, including their definitions, formulas, and short-cut computation methods. It also addresses relative measures of dispersion including the coefficient of mean deviation, coefficient of standard deviation, and the coefficient of variation.
π Lecture Summary
Mean Deviation
The mean deviation is a measure of dispersion based on the absolute deviations of values from their mean. For raw data, the formula is:
M.D. = Ξ£|dα΅’| / n
For the fatalities dataset (4, 6, 2, 0, 3, 5, 8), the mean is 4. The absolute deviations are 0, 2, 2, 4, 1, 1, 4. Their sum is 14, so M.D. = 14/7 = 2.
π Definition β Mean Deviation: the average of the absolute deviations of observations from their arithmetic mean.
π Formula (raw data): M.D. = Ξ£|xα΅’ - xΜ| / n β the average absolute distance from the mean
π Formula (grouped data): M.D. = Ξ£fα΅’|xα΅’ - xΜ| / n = Ξ£fα΅’|dα΅’| / n
The mean deviation is also called the mean absolute deviation. While quick and simple, it involves "artificiality" by ignoring algebraic signs of deviations. π‘ Why this matters: Ignoring signs prevents further theoretical development and mathematical applications.
Co-efficient of Mean Deviation
The coefficient of mean deviation is a relative measure obtained by dividing the mean deviation by the average used. When using the mean: Coefficient of M.D. = M.D. / Mean. When using the median: Mean deviation = Ξ£|xα΅’ - xΜ| / n and Coefficient of M.D. = M.D. / Median. The median is preferred when the dataset contains very high or very low values.
Standard Deviation and Variance
The standard deviation overcomes the mathematical limitation of the mean deviation by squaring deviations instead of taking absolute values. The variance is the average of the squared deviations:
Variance = Ξ£(x - xΜ)Β² / n
For the fatalities dataset, Ξ£(x - xΜ)Β² = 0 + 4 + 4 + 16 + 1 + 1 + 16 = 42, and Variance = 42/7 = 6 (in "squared fatalities").
π Definition β Variance: the average of the squared deviations of observations from their arithmetic mean π Definition β Standard Deviation: the positive square root of the variance, giving a measure in the original unit of measurement
π Formula (raw data): S = β[Ξ£(x - xΜ)Β² / n]
For the example: S = β6 = 2.45 fatalities.
π Formula β Short Cut Formula (raw data): S = β[ (Ξ£xΒ²/n) - (Ξ£x/n)Β² ]
This uses only Ξ£x and Ξ£xΒ², reducing calculations.
For the example: Ξ£x = 28, Ξ£xΒ² = 154, n = 7. S = β[154/7 - (28/7)Β²] = β[22 - 16] = β6 = 2.45.
π Formula β Standard Deviation (grouped data): S = β[ Ξ£f(x - xΜ)Β² / n ] π Formula β Short Cut Formula (grouped data): S = β[ (Ξ£fxΒ²/n) - (Ξ£fx/n)Β² ]
π Example (electric light bulbs): Life (0-5): f=4, x=2.5; (5-10): f=9, x=7.5; (10-20): f=38, x=15; (20-40): f=33, x=30; (40+): f=16, x=50. Ξ£f=100, Ξ£fx=2437.5, Ξ£fxΒ²=78781.25. S = β[78781.25/100 - (2437.5/100)Β²] = β[787.8125 - 594.1406] = β193.6719 = 13.9 hundred hours = 1390 hours.
Coefficient of Variation
The coefficient of standard deviation is: S.D. / Mean. Multiplying by 100 gives the coefficient of variation: C.V. = (S / xΜ) Γ 100
π Definition β Coefficient of Variation (C.V.): a relative measure of dispersion expressed as a percentage, useful for comparing variability between different variables or between datasets with very different means.
π Example 1 (factory earnings): Country 1: mean = $19.50, S = $4 β C.V. = (4/19.5)Γ100 = 20.5%. Country 2: mean = Rs. 75, S = Rs. 28 β C.V. = (28/75)Γ100 = 37.3%. Conclusion: Country 2 has greater variability in earnings.
π Example 2 (crop yield): Untreated land: mean = 35 bushels, S = 10 β C.V. = 28.57%. Treated land: mean = 58 bushels, S = 10 β C.V. = 17.24%. Conclusion: The new fertilizer has reduced relative variability.
β Key Takeaways
The mean deviation provides a simple measure of dispersion by averaging absolute deviations from the mean, but its mathematical limitation is ignoring signs. The standard deviation and variance overcome this by squaring deviations, making them the preferred measures of dispersion in statistics. The coefficient of variation is the essential relative measure for comparing variability between different datasets, especially when their means differ substantially or when comparing different variables.
π§ Quick Revision Questions
- Why is the sum of deviations from the arithmetic mean always zero, and how does the mean deviation solve this problem?
- What is the mathematical advantage of the standard deviation over the mean deviation?
- Compute the standard deviation for the dataset: 2, 4, 6, 8 using the short-cut formula.
- In which situation would you use the coefficient of variation instead of the standard deviation?
- If two datasets have the same standard deviation but different means, which dataset has greater relative variability?