📝 Lecture Summary
Properties of the Hypergeometric Experiment
A hypergeometric experiment has the following properties: The outcomes of each trial may be classified into one of two categories, success and failure. The probability of success changes on each trial. The successive trials are not independent. The experiment is repeated a fixed number of times.
The number of successes, X, in a hypergeometric experiment is called a hypergeometric random variable, and its probability distribution is called the hypergeometric distribution.
🔑 Definition — Hypergeometric Probability Distribution: When the hypergeometric random variable X assumes a value x, the hypergeometric probability distribution is given by:
📐 Formula: P(X = x) = [C(k, x) × C(N-k, n-x)] / C(N, n)
Where:
- N = number of units in the population
- n = number of units in the sample
- k = number of successes in the population
The hypergeometric probability distribution has three parameters: N, n, and k.
The hypergeometric probability distribution is appropriate when:
- A random sample of size n is drawn WITHOUT REPLACEMENT from a finite population of N units
- k of the units are of one kind (classified as success) and the remaining N-k of another kind (classified as failure)
📌 Example: The names of 5 men and 5 women are written on slips of paper and placed in a hat. Four names are drawn. What is the probability that 2 are men and 2 are women?
Let us regard 'men' as success. Then X will denote the number of men. We have:
- N = 5 + 5 = 10 names to be drawn from
- n = 4 (drawing a sample of size 4 out of a 'population' of size 10)
- k = 5 (since there are 5 men in the population of 10)
- Possible values of X are 0, 1, 2, 3, 4
The hypergeometric distribution is given by: P(X = x) = [C(5, x) × C(5, 4-x)] / C(10, 4)
The required probability P(X = 2) is: P(X = 2) = [C(5, 2) × C(5, 2)] / C(10, 4) = (10 × 10) / 210 = 100/210 = 10/21
In other words, the probability is a little less than 50% that two of the four names drawn will be those of men.
Properties of the Hypergeometric Distribution
The mean and variance of the hypergeometric probability distribution are:
📐 Formulas:
- Mean: μ = n × (k/N)
- Variance: σ² = n × (k/N) × ((N-k)/N) × ((N-n)/(N-1))
If N becomes indefinitely large, the hypergeometric probability distribution tends to the BINOMIAL probability distribution.
Sampling and Distribution Selection:
- When sampling with replacement, the population remains undisturbed. The various trials (draws) are independent, and the binomial formula can be used.
- When sampling without replacement from a finite population, the constitution of the population changes at every draw. The trials are not independent, and the hypergeometric formula is appropriate.
- If the population size is much larger than the sample size (regarded as 'infinite' population), even without replacement, the population remains almost undisturbed. The trials can be assumed independent, and the binomial formula can be applied.
Rule of Thumb: The binomial formula can be applied when drawing a sample from a finite population without replacement and the sample size n is not more than 5 percent of the population size N (i.e., n < 0.05N). When n is greater than 5 percent of N, the hypergeometric formula should be used.
💡 Why this matters: This rule helps determine which probability distribution to use in real sampling situations, balancing accuracy with computational simplicity.
Poisson Distribution
The Poisson distribution is named after the French mathematician Siméon Denis Poisson (1781-1840). It arises in two situations:
- As a limiting approximation to the binomial distribution when p, the probability of success, is very small but n, the number of trials, is so large that the product np = μ is of a moderate size.
- As a distribution in its own right by considering a Poisson Process where events occur randomly over a specified interval of time or space or length.
Such random events might be:
- Number of typing errors per page in a book
- Number of traffic accidents in a particular city in a 24-hour period
- Number of taxicab arrivals at an intersection per day
- Number of radioactive particles emitted in a given period
- Number of flaws per unit length of some material
🔑 Definition — Poisson Distribution (Limiting Form): If n goes to infinity and p approaches zero in such a way that μ = np remains constant, then the limiting form of the binomial probability distribution is:
📐 Formula: P(X = x) = (e^(-μ) × μ^x) / x!, where x = 0, 1, 2, ..., ∞ and e = 2.71828
The Poisson distribution has only one parameter μ > 0. The parameter μ may be interpreted as the mean of the distribution.
Practical Rule: Most statisticians use the Poisson approximation to the binomial when p is 0.05 or less and n is 20 or more. The larger n is and the smaller p is, the better the approximation.
📌 Example: Two hundred passengers have made reservations for an airplane flight. If the probability that a passenger who has a reservation will not show up is 0.01, what is the probability that exactly three will not show up?
Solution: This is a binomial experiment with n = 200 and p = 0.01. Since p is very small and n is considerably large, apply the Poisson distribution using μ = np = (200)(0.01) = 2.
If X represents the number of successes (not showing up): P(X = 3) = (e^(-2) × 2³) / 3!
e^(-2) = 1/(2.71828)² = 0.1353
P(X = 3) = (0.1353 × 8) / (3 × 2 × 1) = 1.0824 / 6 = 0.1804
Poisson Process
A Poisson Process may be defined as a physical process governed at least in part by some random mechanism. Stated differently, a Poisson process represents a situation where events occur randomly over a specified interval of time or space or length.
🔑 Definition — Poisson Process Formula: The formula valid in the case of a Poisson process is:
📐 Formula: P(X = x) = (e^(-λt) × (λt)^x) / x!
Where:
- λ = average number of occurrences of the outcome of interest per unit of time
- t = number of time-units under consideration
- x = number of occurrences of the outcome of interest in t units of time
📌 Example: Telephone calls are being placed through a certain exchange at random times on the average of four per minute. Assuming a Poisson Process, determine the probability that in a 15-second interval, there are 3 or more calls.
Solution:
Step 1: Identify the unit of time — take a minute as the unit of time.
Step 2: Identify λ — the average number of occurrences per unit of time. λ = 4 calls per minute
Step 3: Identify t — the number of time-units under consideration. 15 seconds = 15/60 = 1/4 minutes, therefore t = 1/4
Step 4: Compute λt: λt = 4 × 1/4 = 1
Step 5: Apply the Poisson formula: P(X = x) = (e^(-λt) × (λt)^x) / x!
Since λt = 1, we need P(X ≥ 3) in a 15-second interval.
P(X ≥ 3) = 1 - P(X < 3) = 1 - [P(X=0) + P(X=1) + P(X=2)] = 1 - Σ(x=0 to 2) [e^(-1) × (1)^x] / x! = 1 - Σ(x=0 to 2) (0.3679 × 1^x) / x! [e^(-1) = 0.3679]
= 1 - [0.3679/0! + 0.3679/1! + 0.3679/2!] = 1 - [0.3679 + 0.3679 + 0.18395] = 1 - 0.91975 = 0.08025
Hence the probability is only 8% (very low probability) that in a 15-second interval, the telephone exchange receives 3 or more calls.
Properties of the Poisson Distribution
🔑 Main properties:
-
Mean equals Variance: If the random variable X has a Poisson distribution with parameter μ, then:
- E(X) = μ
- Var(X) = μ
-
Shape: The shape of the Poisson distribution is positively skewed. The distribution tends to be symmetrical as μ becomes larger and larger.
Comparison with Binomial: Whereas the binomial distribution can be symmetric, positively skewed, or negatively skewed (depending on whether p = 1/2, p < 1/2, or p > 1/2), the Poisson distribution can never be negatively skewed.
Fitting a Poisson Distribution to Real Data
The procedure is very similar to fitting the binomial distribution:
- The population mean μ is replaced by the sample mean X̄
- The probabilities of the various values of X are computed using the Poisson formula
- The chi-square test of goodness of fit enables us to determine whether or not it is a good fit (whether the discrepancy between expected frequencies and observed frequencies is small)
Important Mathematical Points:
- The Poisson approximation to the binomial formula works well when n > 20 and p < 0.05
- When the Poisson is used to approximate the binomial which is being used to approximate the hypergeometric, the rule of thumb is that the Poisson distribution can be used to approximate the hypergeometric distribution when n < 0.05N, n > 20, and p < 0.05
Uniform Distribution
A random variable X is said to be uniformly distributed if its density function is defined as:
🔑 Definition — Uniform Distribution (Rectangular Distribution):
📐 Formula: f(x) = 1/(b - a), for a ≤ x ≤ b
The graph of this distribution is a rectangle with:
- Base = (b - a)
- Height = 1/(b - a)
Why it is a proper probability density function:
- Since a < b, therefore f(x) > 0
- ∫(-∞ to ∞) f(x) dx = ∫(a to b) 1/(b-a) dx = [x/(b-a)](a to b) = (b-a)/(b-a) = 1
The total area can also be obtained from the simple formula: Area of rectangle = (Base) × (Height) = (b - a) × 1/(b - a) = 1
🔑 Properties — Uniform Distribution:
- Mean: μ = (a + b)/2
- Variance: σ² = (b - a)²/12
The distribution derives its name from the fact that its density is constant or uniform over the interval [a, b] and is 0 elsewhere. It is also called the rectangular distribution because its total probability is confined to a rectangular region.
Characteristics: The uniform probability distribution provides a model for continuous random variables that are evenly distributed over a certain interval. A uniform random variable is just as likely to assume a value in one interval as in any other interval of equal size. There is no clustering of values around any value — instead, there is an even spread over the entire region of possible values.
📌 Example 1: If a short exists in a 5-meter stretch of electrical wire, it may have an equal probability of being in any particular 1-centimeter segment along the line.
📌 Example 2: If a safety inspector plans to choose a time at random during the 4 afternoon work-hours to pay a surprise visit, then each 1-minute time-interval in this 4 work-hour period will have an equally likely chance of being selected for the visit.
The uniform distribution also arises in the study of rounding off errors.
⭐ Key Takeaways
The hypergeometric distribution is the correct model when sampling without replacement from a finite population, with the binomial being applicable only when the sample size is less than 5% of the population. The Poisson distribution serves as both a limiting approximation to the binomial when n is large (≥20) and p is small (≤0.05), and as a distribution for modeling random events occurring over time or space through the Poisson process. A defining characteristic of the Poisson distribution is that its mean equals its variance, and it is always positively skewed. The continuous uniform distribution represents variables with constant probability over an interval, with mean (a+b)/2 and variance (b-a)²/12.
🧠 Quick Revision Questions
-
What are the four properties of a hypergeometric experiment, and how do they differ from those of a binomial experiment?
-
Under what condition can the binomial distribution be used as an approximation to the hypergeometric distribution when sampling without replacement?
-
Calculate the probability using the Poisson distribution: If a bookstore averages 2 customer inquiries per hour, what is the probability of exactly 4 inquiries in a 2-hour period?
-
What is the relationship between the mean and variance of a Poisson distribution, and how does its skewness change as μ increases?
-
A bus arrives at a stop every 10 minutes (uniformly distributed). What is the probability that a randomly arriving passenger waits more than 7 minutes?
📘 Lecture 30 — Normal Distribution
📖 Overview: This lecture provides a comprehensive introduction to the normal distribution, its mathematical definition, key properties, and the standard normal distribution. It covers how to use the area table for direct and inverse probability calculations and concludes with the normal approximation to the binomial distribution for large samples. Understanding this lecture is crucial for performing probability calculations for continuous data and for approximating discrete distributions.
🗂️ Topics Covered
The lecture begins with the mathematical definition of the normal distribution and its important properties, including symmetry, asymptotic nature, and fixed area proportions. It then introduces the standard normal distribution and the process of standardization. The direct use of the area table is demonstrated through an example of dishwasher lifespan, followed by the inverse use of the table to find a minimum acceptable height for police applicants. The lecture concludes with the normal approximation to the binomial distribution, including the continuity correction, illustrated by a malaria death rate example.
📝 Lecture Summary
Normal Distribution
A continuous random variable X is normally distributed with mean μ and standard deviation σ if its probability density function is given by:
f(x) = 1/(σ√(2π)) * e^{-1/2 * [(x-μ)/σ]^2}, for -∞ < x < ∞
where π ≈ 3.1416 and e ≈ 2.71828. This formula defines a family of distributions depending on the two parameters μ and σ.
🔑 Definition — Normal Distribution: A continuous probability distribution that is symmetric about its mean, bell-shaped, and defined by its mean (μ) and standard deviation (σ).
📐 Formula: f(x) = 1/(σ√(2π)) * e^{-1/2 * [(x-μ)/σ]^2} → This is the probability density function for a normal random variable X with mean μ and standard deviation σ.
Important Properties of the Normal Distribution
Property 1: For N(μ, σ^2), μ is the mean and σ is the standard deviation. A change in μ shifts the distribution left or right along the x-axis, while a change in σ determines the flatness or peakedness of the curve.
Property 2: The normal curve is asymptotic to the x-axis as x → ±∞.
Property 3: Because of symmetry, 50% of the area is to the right of the mean (μ), and 50% is to the left.
Property 4: The density function attains its maximum value at x = μ, so the mean, median, and mode are all equal to μ.
Property 5: Since the normal distribution is absolutely symmetrical, the third moment about the mean, μ₃ = 0.
Property 6: For the normal distribution, it can be mathematically proved that μ₄ = 3σ⁴.
Property 7: The moment ratios of the normal distribution are β₁ = 0 and β₂ = 3. Since β₂ = 3, this value is a criterion for measuring kurtosis. If β₂ > 3, the distribution is leptokurtic (more peaked); if β₂ < 3, it is platykurtic (less peaked).
Property 8: Areas under the normal curve remain in fixed proportions within a specified number of standard deviations on either side of μ:
- The interval μ ± 1σ always contains 68.26% of the total area.
- The interval μ ± 2σ always contains 95.44% of the total area.
- The interval μ ± 3σ always contains 99.73% of the total area.
💡 Why this matters: This property is the theoretical foundation for the Empirical Rule discussed in descriptive statistics, which states that for approximately symmetric hump-shaped distributions, about 68% of data lies within ±1 standard deviation, 95% within ±2, and nearly 100% within ±3.
Property 9: The normal curve contains points of inflection where the direction of concavity changes. Their coordinates are (μ - σ, 1/(σ√(2πe))) and (μ + σ, 1/(σ√(2πe))).
The Standard Normal Distribution
A normal distribution with mean 0 and standard deviation 1 is known as the standard normal distribution. Areas under the normal curve have been computed for this specific distribution using numerical integration, and these values are available in the Area Table of the Standard Normal Curve.
🔑 Definition — Standard Normal Distribution: A normal distribution whose mean is zero (μ = 0) and whose standard deviation is one (σ = 1), denoted as N(0,1).
The Process of Standardization
The formula for converting a normal distribution N(μ, σ) to the standard normal distribution N(0, 1) is:
Z = (X - μ) / σ
📐 Formula: Z = (X - μ) / σ → This formula converts any value X from a normal distribution with mean μ and standard deviation σ into a Z-score, which represents the number of standard deviations X is from the mean in the standard normal distribution.
Direct Use of the Area Table
📌 Example: The length of life for an automatic dishwasher is approximately normally distributed with a mean life of 3.5 years and a standard deviation of 1.0 years. If this type of dishwasher is guaranteed for 12 months, what fraction of sales will require replacement?
Step 1: Standardize the warranty period (X = 1.0 year): Z = (1.0 - 3.5) / 1.0 = -2.5 / 1 = -2.5
Step 2: We need the area under the standard normal curve from -∞ to Z = -2.5. From the area table, the area from 0 to 2.5 is 0.4938.
Step 3: The area from Z = 2.5 to ∞ is 0.5 - 0.4938 = 0.0062.
Step 4: Due to symmetry, the area from -∞ to -2.5 is also 0.0062.
Therefore, the probability of a dishwasher lasting less than a year is 0.0062 (0.62%).
Inverse Use of the Area Table
📌 Example: The heights of applicants to the police force are normally distributed with mean 170 cm and standard deviation 3.8 cm. If the shortest 30% of applicants are to be rejected, what is the minimum acceptable height?
Step 1: We need the Z-value to the left of which 30% of the area lies. From the area table, the Z-value corresponding to an area of 0.2000 (the area from 0 to that Z) is 0.52 (since area from 0 to 0.52 is 0.1985, which is closest to 0.2000).
Step 2: Since we want the lower 30%, the Z-value is negative: Z = -0.52.
Step 3: The standardization formula can be rewritten as: X = μ + σZ. Substituting: X = 170 + 3.8(-0.52) = 170 - 1.976 = 168.024 cm.
Therefore, the minimum acceptable height is approximately 168 cm.
Normal Approximation to the Binomial Distribution
When n is large and neither p nor q is close to zero, the binomial distribution can be closely approximated by the normal distribution.
🔑 Definition — Normal Approximation to the Binomial: A method used to compute binomial probabilities by using the normal distribution when n is sufficiently large, typically when both np ≥ 5 and nq ≥ 5.
Key Points for Application:
- The mean and variance of the normal distribution used for approximation are the mean and variance of the binomial distribution:
μ = npandσ² = npq. - A continuity correction must be applied because the binomial distribution is discrete and the normal is continuous. Each integer value x is replaced by the interval
x - 0.5tox + 0.5.
📌 Example: The death rate from Malaria in a province is 20%. Find the probability that the number of deaths is between 70 and 80 (inclusive) out of 500 patients.
Step 1: Check conditions: np = 500 * 0.20 = 100 ≥ 5 and nq = 500 * 0.80 = 400 ≥ 5, so we can use the normal approximation.
Step 2: Calculate mean and standard deviation: μ = np = 100, σ² = npq = 500 * 0.20 * 0.80 = 80, so σ = √80 ≈ 8.94.
Step 3: Apply continuity correction. P(70 ≤ X ≤ 80) is replaced by P(69.5 < X < 80.5).
Step 4: Standardize the values and compute the area under the standard normal curve between them. The computed probability is approximately 0.0145 (1.5%).
💡 Why this matters: This technique allows us to calculate probabilities for large binomial samples without cumbersome calculations, as long as the binomial distribution is approximately symmetric (when p is close to 0.5 and n is large).
⭐ Key Takeaways
The normal distribution is a symmetric, bell-shaped continuous distribution completely defined by its mean (μ) and standard deviation (σ). For any normal distribution, fixed proportions of the total area lie within 1, 2, and 3 standard deviations of the mean (68.26%, 95.44%, and 99.73%, respectively). All problems involving normal distributions can be solved by standardizing to the standard normal distribution (Z = (X - μ)/σ) and using the area table. The normal distribution can also approximate the binomial distribution when both np and nq are at least 5, but a continuity correction (adding/subtracting 0.5) must be applied because the binomial is discrete while the normal is continuous.
🧠 Quick Revision Questions
- What is the formula for the probability density function of the normal distribution, and what do μ and σ represent?
- List three key properties of the normal distribution related to symmetry, asymptotes, and fixed area proportions.
- What is the standard normal distribution, and what is the formula for standardizing any normal distribution?
- When can the normal distribution be used to approximate the binomial distribution, and what is the continuity correction and why is it necessary?
- In the inverse use of the area table, how do you find an X-value when given a specific area (probability) under the normal curve?
📘 Lecture 31 — Sampling Distribution of X̄; Central Limit Theorem
📖 Overview: This lecture introduces the concept of sampling distributions, a cornerstone of statistical inference. It explains how the sample mean, X̄, behaves across repeated samples from a population, leading to the Central Limit Theorem—a fundamental result that underpins both estimation and hypothesis testing.
🗂️ Topics Covered
The lecture covers inferential statistics branches, the definition and construction of sampling distributions of X̄, mean and standard deviation (standard error) of this distribution, and the Central Limit Theorem. It provides a detailed illustration using all possible samples of sizes 2, 3, and 4 from a rectangular population to reveal properties of the sampling distribution and its convergence to normality.
📝 Lecture Summary
INFERENTIAL STATISTICS
That branch of Statistics which enables us to draw conclusions or inferences about various phenomena on the basis of real data collected on sample basis. In this regard, the first point to be noted is that statistical inference can be divided into two main branches--- estimation, and hypothesis-testing. Estimation itself can be further divided into two branches --- point estimation and interval estimation. The second important point is that the concept of sampling distributions forms the basis for both estimation and hypothesis-testing.
SAMPLING DISTRIBUTION
The probability distribution of any statistic (such as the mean, the standard deviation, the proportion of successes in a sample, etc.) is known as its sampling distribution. In this regard, the first point to be noted is that there are two ways of sampling --- sampling with replacement, and sampling without replacement. In case of a finite population containing N elements, the total number of possible samples of size n that can be drawn from this population with replacement is N^n. In case of a finite population containing N elements, the total number of possible samples of size n that can be drawn from this population without replacement is NCn.
We illustrate the concept of the sampling distribution of X̄ with the help of the following example:
🔑 Definition — Sampling Distribution of X̄: The probability distribution of the sample mean, X̄, obtained by considering all possible samples of a given size from a population.
EXAMPLE: Let X denotes the number of faults in a car. Then X can take the values 0, 1, 2, 3, and 4, the probability of each of these X values is 1/5. Hence, we have the following rectangular (uniform) probability distribution:
| No. of Faulty Items (X) | Probability f(x) |
|---|---|
| 0 | 1/5 |
| 1 | 1/5 |
| 2 | 1/5 |
| 3 | 1/5 |
| 4 | 1/5 |
| Total | 1 |
MEAN AND VARIANCE OF THE POPULATION DISTRIBUTION
μ = E(X) = Σ x f(x) = 2 σ² = Var(X) = E(X²) – [E(X)]² = Σ x² f(x) – [Σ x f(x)]² = 6 – 2² = 6 – 4 = 2
Practically speaking, only a sample of the cars will be tested at any one occasion, and as such, we are interested in considering the results that would be obtained if a sample of vehicles is tested. Let us consider the situation when only two cars are tested after being selected at the roadside by a mobile testing station.
The situation is equivalent to drawing all possible samples of size 2 from this probability distribution (i.e. the population) WITH REPLACEMENT. There are 5² = 25 possible samples. The table of sample means is produced. Some possible sample means occur several times. A frequency distribution of the sample means is constructed.
📌 Example: Sampling Distribution of X̄ for n=2
| Sample Mean (x̄) | No. of Samples (f) | Probability P(X̄=x̄) |
|---|---|---|
| 0.0 | 1 | 1/25 |
| 0.5 | 2 | 2/25 |
| 1.0 | 3 | 3/25 |
| 1.5 | 4 | 4/25 |
| 2.0 | 5 | 5/25 |
| 2.5 | 4 | 4/25 |
| 3.0 | 3 | 3/25 |
| 3.5 | 2 | 2/25 |
| 4.0 | 1 | 1/25 |
| Total | 25 | 1 |
This is the SAMPLING DISTRIBUTION of the mean. Its graph is triangular and symmetric.
MEAN AND VARIANCE OF THE SAMPLING DISTRIBUTION OF X̄
The mean is given by μx̄ = E(X̄) = Σ x̄ f(x̄) and the variance by σ²x̄ = Var(X̄) = E(X̄²) – [E(X̄)]² = Σ x̄² f(x̄) – [Σ x̄ f(x̄)]². The square root of the variance is the standard deviation, and the standard deviation of a sampling distribution is termed as its standard error.
Computing for the n=2 case: μx̄ = Σ x̄ f(x̄) = 50/25 = 2 σ²x̄ = E(X̄²) – [E(X̄)]² = 5 – 2² = 5 – 4 = 1 σx̄ = √1 = 1
These computations lead to two very important properties:
Property No. 1 In the case of sampling with replacement as well as in the case of sampling without replacement, we have: μx̄ = μ In this example: μ = 2, Hence μx̄ = 2. The mean of the sampling distribution of X̄ is equal to the population mean.
Property No. 2 In case of sampling with replacement: σx̄ = σ / √n In this example: σ = √2, σx̄ = √2 / √2 = 1. The standard error of the sampling distribution of X̄ is equal to the population standard deviation divided by the square root of the sample size.
In case of sampling without replacement from a finite population: σx̄ = (σ / √n) * √((N – n) / (N – 1))
The factor √((N – n) / (N – 1)) is known as the finite population correction (fpc). If the sample size n is much smaller than the population size N, the fpc is approximately equal to 1, and as such, is not required. In sampling from a finite population, we apply the fpc only if the sample size is greater than 5% of the population size.
Next, we consider the shape of the sampling distribution of X̄. As indicated by the line chart, the above sampling distribution for n=2 is absolutely symmetric and triangular. What happens to the shape with increased sample size?
SAMPLING DISTRIBUTION FOR SAMPLES OF SIZE 3 If all possible samples of size 3 were taken (5³ = 125 samples), the sampling distribution has a more bell-shaped appearance.
SAMPLING DISTRIBUTION FOR SAMPLES OF SIZE 4 If all possible samples of size 4 were taken (5⁴ = 625 samples), the sampling distribution becomes even closer to a bell-shaped curve.
In all three cases the line charts are symmetrical, but as the sample size increases, the overall configuration changes from a triangular distribution to a bell-shaped distribution. When relatively large samples are taken, this bell-shaped distribution assumes the form of a ‘normal’ distribution (also called the ‘Gaussian’ distribution), and this happens irrespective of the form of the parent population. (In this problem, the population of defective items in a car is rectangular.)
CENTRAL LIMIT THEOREM
The theorem states that: “If a variable X from a population has mean μ and finite variance σ², then the sampling distribution of the sample mean X̄ approaches a normal distribution with mean μ and variance σ²/n as the sample size n approaches infinity.” As n → ∞, the sampling distribution of X̄ approaches normality.
Due to the Central Limit Theorem, the normal distribution has found a central place in the theory of statistical inference. Since, in many situations, the sample is large enough for our sampling distribution to be approximately normal, therefore we can utilize the mathematical properties of the normal distribution to draw inferences about the variable of interest. The rule of thumb in this regard is that if the sample size, n, is greater than or equal to 30, then we can assume that the sampling distribution of X̄ is approximately normally distributed. On the other hand, if the POPULATION sampled is normally distributed, then the sampling distribution of X̄ will also be normal regardless of sample size. In other words, X̄ will be normally distributed with mean μ and variance σ²/n.
💡 Why this matters: The Central Limit Theorem is what allows statisticians to use the normal distribution to make inferences about population parameters from sample statistics, even when the original population is not normally shaped. It is the theoretical foundation for confidence intervals and hypothesis tests about the mean.
⭐ Key Takeaways
The sampling distribution of the sample mean is the probability distribution of all possible sample means from a population. Its mean always equals the population mean (μx̄ = μ). Its standard deviation, called the standard error, equals σ/√n for sampling with replacement, and with a finite population correction factor when sampling without replacement. The Central Limit Theorem states that for large samples (n ≥ 30), the sampling distribution of X̄ is approximately normal regardless of the population's shape, and if the population itself is normal, X̄ is normal for any sample size. This theorem is the bedrock of inferential statistics, enabling valid probability calculations about sample means.
🧠 Quick Revision Questions
- What is the mean of the sampling distribution of the sample mean called, and what is its relationship to the population mean?
- What is the formula for the standard error of the sample mean when sampling with replacement?
- When is the finite population correction factor required?
- State the Central Limit Theorem. Under what condition (sample size) can we assume the sampling distribution of X̄ is normal?
- If a population is normally distributed, does the sampling distribution of X̄ still require a large sample size (n≥30) to be normal?
📘 Lecture 32 — Sampling Distribution of ( \bar{X}_1 - \bar{X}_2 )
📖 Overview: This lecture continues the discussion of sampling distributions by examining the distribution of the sample mean and sample proportion in practical scenarios. It then introduces the sampling distribution of the difference between two sample means, explaining its properties, mean, standard error, and shape under different conditions. This is crucial for comparing two populations.
🗂️ Topics Covered
The lecture begins by applying the sampling distribution of the sample mean to a real-world problem involving employee salaries. It then introduces the sampling distribution of the sample proportion, defining it, illustrating its properties with an example, and covering its mean, standard error, and the normal approximation condition. Finally, it discusses the sampling distribution of the difference between two sample means, including its mean, standard error, and shape, supported by a detailed example.
📝 Lecture Summary
Application of Sampling Distribution of ( \bar{X} ) (Example)
A construction company has 310 employees with an average salary of Rs.24,000 and a standard deviation of Rs.5,000. A random sample of 100 employees is drawn to check if the average salary exceeds Rs.24,500. Because the sample size (n=100) is greater than 5% of the population (N=310), the finite population correction factor (fpc) is used to compute the standard error of the mean: (\sigma_{\bar{X}} = \frac{\sigma}{\sqrt{n}} \sqrt{\frac{N-n}{N-1}} = \frac{5000}{\sqrt{100}} \sqrt{\frac{310-100}{310-1}} = 412.20).
To find the probability (P(\bar{X} > 24500)), the z-score is computed: (z = \frac{24500-24000}{412.20} = 1.21). Using the standard normal table, (P(\bar{X} > 24500) = 0.5 - 0.3869 = 0.1131). This 11.31% probability suggests the government is likely (89% chance) to find the demand valid.
💡 Why this matters: This demonstrates how the Central Limit Theorem and the concept of sampling distribution are applied in real-world statistical inference, such as hypothesis testing and decision-making.
Sampling Distribution of the Sample Proportion (( \hat{p} ))
When population elements are classified into two categories (e.g., success/failure), the population proportion (p = X/N) and the sample proportion (\hat{p} = x/n), where (x) is the number of successes in the sample. The sampling distribution of (\hat{p}) is the probability distribution of the proportions of successes in all possible random samples of size (n).
🔑 Definition — Sample Proportion: A random variable computed as the number of successes in the sample divided by the sample size.
Example (with verification): A population of six values (1,3,6,8,9,12) is used. All 20 possible samples of size 3 (without replacement) are drawn. The population proportion of even numbers is (p = 3/6 = 0.5). The sampling distribution of (\hat{p}) is constructed.
- Mean: (\mu_{\hat{p}} = \sum \hat{p} f(\hat{p}) = 10/20 = 0.5), verifying (\mu_{\hat{p}} = p).
- Variance: (\sigma^2_{\hat{p}} = \sum \hat{p}^2 f(\hat{p}) - [\sum \hat{p} f(\hat{p})]^2 = 6/20 - (10/20)^2 = 0.05). This matches (\frac{pq}{n} \cdot \frac{N-n}{N-1} = \frac{(0.5)(0.5)}{3} \cdot \frac{3}{5} = 0.05).
📐 Properties of Sampling Distribution of ( \hat{p} ):
- Mean: (\mu_{\hat{p}} = p)
- Standard Error:
- With replacement: (\sigma_{\hat{p}} = \sqrt{\frac{pq}{n}})
- Without replacement (finite population): (\sigma_{\hat{p}} = \sqrt{\frac{pq}{n} \cdot \frac{N-n}{N-1}})
- Shape: Approximately normal if both (np \ge 5) and (nq \ge 5). Continuity correction of (\pm \frac{1}{2n}) is applied for normal approximation.
Example – 10% of sugar boxes are underweight (p=0.10). For a sample of n=144, find (P(\hat{p} \ge 0.05)). Applying continuity correction ((\hat{p} \ge 0.05 - \frac{1}{2(144)} = 0.04653)). (\sigma_{\hat{p}} = \sqrt{\frac{(0.1)(0.9)}{144}} = 0.025). (z = \frac{0.04653 - 0.10}{0.025} = -2.14). Thus, (P(Z \ge -2.14) = 0.4838 + 0.5 = 0.9838).
Sampling Distribution of the Difference Between Two Means (( \bar{X}_1 - \bar{X}_2 ))
This distribution is used to compare two populations. It is the probability distribution of the differences between the means of independent samples from two populations.
📌 Example: Draw all possible samples of size (n_1=2) (with replacement) from Population 1: {4,6,8} and size (n_2=2) from Population 2: {1,2,3}. Compute all 81 differences (\bar{x}_1 - \bar{x}_2). The sampling distribution is constructed, yielding mean = 4 and variance = 5/3 ≈ 1.67.
Verification:
- Mean of Population 1: (\mu_1 = 6), Variance: (\sigma^2_1 = 8/3).
- Mean of Population 2: (\mu_2 = 2), Variance: (\sigma^2_2 = 2/3).
- (\mu_{\bar{X}_1 - \bar{X}_2} = 4 = 6 - 2 = \mu_1 - \mu_2).
- (\sigma^2_{\bar{X}_1 - \bar{X}_2} = \frac{\sigma^2_1}{n_1} + \frac{\sigma^2_2}{n_2} = \frac{8/3}{2} + \frac{2/3}{2} = 4/3 + 1/3 = 5/3 \approx 1.67). The computed variance matches.
🔑 Properties of Sampling Distribution of ( \bar{X}_1 - \bar{X}_2 ):
- Mean: (\mu_{\bar{X}_1 - \bar{X}_2} = \mu_1 - \mu_2)
- Standard Error: (\sigma_{\bar{X}_1 - \bar{X}_2} = \sqrt{\frac{\sigma^2_1}{n_1} + \frac{\sigma^2_2}{n_2}}) (for infinite populations or sampling with replacement). For sampling without replacement from finite populations, a finite population correction factor is used.
- Shape:
- If both populations are normally distributed, the distribution of (\bar{X}_1 - \bar{X}_2) is exactly normal regardless of sample sizes.
- If populations are non-normal but both sample sizes are large (n ≥ 30), the distribution is approximately normal (Central Limit Theorem). The test statistic (Z = \frac{(\bar{X}_1 - \bar{X}2) - (\mu_1 - \mu_2)}{\sigma{\bar{X}_1 - \bar{X}_2}}) is approximately N(0,1).
💡 Why this matters: This distribution is the foundation for hypothesis tests and confidence intervals comparing the means of two independent groups (e.g., comparing test scores of two classes or effectiveness of two drugs).
⭐ Key Takeaways
- The finite population correction factor is essential when sampling without replacement from a finite population where sample size exceeds 5% of the population size. It increases the precision of the standard error.
- The sampling distribution of the sample proportion (\hat{p}) has mean (p) and standard error (\sqrt{pq/n}) (with fpc for finite populations). Its shape is approximately normal when both (np) and (nq) are at least 5, requiring a continuity correction of (\pm 1/(2n)).
- The sampling distribution of the difference between two means (\bar{X}_1 - \bar{X}_2) has a mean equal to (\mu_1 - \mu_2) and variance equal to (\sigma^2_1/n_1 + \sigma^2_2/n_2).
- The shape of the distribution of (\bar{X}_1 - \bar{X}_2) is exactly normal if both populations are normal, and approximately normal (via CLT) if both sample sizes are large (≥30), regardless of the population distribution.
- Any probability calculation involving sample statistics (mean or proportion) follows a three-step process: standardize the statistic using its properties, apply continuity correction (for proportion), and use the standard normal table to find the area/probability.
🧠 Quick Revision Questions
- When is the finite population correction factor (fpc) used in the sampling distribution of the mean, and how does it affect the standard error?
- What are the three main properties (mean, variance, shape) for the sampling distribution of the sample proportion (\hat{p})?
- For what conditions does the sampling distribution of the difference between two sample means ((\bar{X}_1 - \bar{X}_2)) follow an exact normal distribution? When is it approximately normal?
- In the example of sugar boxes, why was it necessary to apply a continuity correction of (1/(2n))? What would have happened if it was omitted?
- State the formula for the standard error of (\bar{X}_1 - \bar{X}_2). How does this formula change when sampling without replacement from finite populations?