π Lecture 30 β Simultaneous Equation Models
π Overview: This lecture introduces simultaneous equation models, where variables can be both causes and effects, creating interdependence that violates OLS assumptions. It explains why OLS suffers from simultaneity bias in such systems and covers concepts like endogenous/exogenous variables, reduced form equations, and the identification problem that determines whether structural parameters can be recovered from reduced form coefficients.
ποΈ Topics Covered
This lecture covers the limitation of OLS with interdependent variables, introduces simultaneous equation models with multiple equations (market model, liquidity-profitability model, national income model), distinguishes between endogenous and exogenous variables, explains the identification problem (under-identified, exactly identified, over-identified), demonstrates the transformation to reduced form equations, and works through an example showing how structural parameters can be expressed in terms of reduced form coefficients using the exclusion principle.
π Lecture Summary
Simultaneous Equation Models
OLS deals with single equations where we have a response variable and some explanatory variables. However, variables in real life may be a cause as well as an effect. The interdependence of variables may give rise to simultaneity bias if OLS is used. For example, income is influenced by consumption level but consumption level itself depends on income levels.
To handle such relationships, we use simultaneous models with multiple equations where the dependent variable in one equation may be the explanatory variable in some other equation.
The Market Model:
Qd = Ξ±β + Ξ±βP + Ξ±βI + eβ
Qs = Ξ²β + Ξ²βP + Ξ²βT + eβ
Qd = Qs
The Liquidity and Profitability Model:
PROFITABILITY = Ξ±β + Ξ±βLIQUIDITY + Ξ±α΅’Fα΅’ + eβ
LIQUIDITY = Ξ²β + Ξ²βPROFITABILITY + Ξ±α΅’Gα΅’ + eβ
Where Fα΅’ and Gα΅’ are matrices of determinants of profitability and liquidity.
The National Income (Macroeconomic) Model:
Yβ = Cβ + Iβ + Gβ
Iβ = Ξ±β + Ξ±βYβ
Cβ = Ξ²β + Ξ²βYβ + eβ
Endogenous and Exogenous Variables
Consider the following model:
Yβ = Ξ±β + Ξ±βYβ + Ξ±βXβ + eβ
Yβ = Ξ²β + Ξ²βYβ + Ξ²βXβ + eβ
The number of unknowns is 4 and the number of equations is 2. To solve the model, the number of equations should be equal to the number of unknowns. Note that Yβ and Yβ cause each other. Let us assume that Xβ and Xβ are already given (their values determined externally from outside the model). These are called exogenous variables. The remaining variables whose values we seek by solving the model are called endogenous variables. Here Xβ and Xβ are exogenous and Yβ and Yβ are endogenous variables.
π‘ Why this matters: In simultaneous models, the number of endogenous variables must equal the number of equations for the system to be solvable.
π Definition β Endogenous variables: Variables whose values are determined within the model (Yβ, Yβ). π Definition β Exogenous variables: Variables whose values are determined outside the model (Xβ, Xβ).
π Example: In the market model (Qd = Ξ±β + Ξ±βP + Ξ±βI + eβ, Qs = Ξ²β + Ξ²βP + Ξ²βT + eβ, Qd = Qs):
- Endogenous variables: P (price) and Q (quantity), since they are determined by the model
- Exogenous variables: I (income) and T (technology), since they are given from outside
π Example: In a three-equation system:
Yβ = Ξ±β + Ξ±βYβ + Ξ±βYβ + Ξ±βXβ + eβ
Yβ = Ξ²β + Ξ²βYβ + Ξ²βYβ + Ξ²βXβ + eβ
Yβ = Ξ³β + Ξ³βYβ + Ξ³βYβ + Ξ³βXβ + eβ
- We have three equations, so we must have three endogenous variables
- Yβ, Yβ, and Yβ are endogenous
- All remaining variables Xβ, Xβ, and Xβ are exogenous
Identification Problem
An equation (not a model) can be Unidentified or Under-identified, Exactly identified or Over identified. If OLS cannot be applied, we need to transform the model to reduced form.
Reduced form equations: Equations that express endogenous variables as functions only of exogenous variables and disturbances. OLS can be applied to reduced-form equations (no endogenous variables on RHS). We need to solve and get reduced form equations for each endogenous variable. The number of endogenous variables in a model equals the number of reduced form equations.
For the model:
Yβ = Ξ±β + Ξ±βYβ + Ξ±βXβ + eβ
Yβ = Ξ²β + Ξ²βYβ + Ξ²βXβ + eβ
After transforming to reduced form:
Yβ = Οββ + ΟββXβ + ΟββXβ + vβ
Yβ = Οββ + ΟββXβ + ΟββXβ + vβ
Ξ²α΅’ are called structural parameters. Οα΅’β±Ό are called reduced form coefficients.
π Definition β Unidentified or Under-identified: If we cannot express the structural parameters of an equation in terms of reduced form coefficients. π Definition β Exactly identified: If we CAN express the structural parameters of an equation in terms of reduced form coefficients in one way. π Definition β Over identified: If we CAN express the structural parameters of an equation in terms of reduced form coefficients in more than one way.
The Exclusion principle states: For an equation to be identified in a two-equation system, there should be at least one exogenous variable that is excluded from the equation (i.e., the variable does not exist in the equation but must be found on the RHS of the other equation).
Example β Transforming to Reduced Form and Checking Identification
Consider the model:
Yβ = Ξ±β + Ξ±βYβ + Ξ±βXβ + eβ ... (1)
Yβ = Ξ²β + Ξ²βYβ + Ξ²βXβ + eβ ... (2)
Substituting the value of Yβ from equation (2) into equation (1) and solving for Yβ gives:
Yβ = (Ξ±β + Ξ±βΞ²β)/(1 - Ξ±βΞ²β) + (Ξ±β/(1 - Ξ±βΞ²β))Xβ + (Ξ±βΞ²β/(1 - Ξ±βΞ²β))Xβ + uβ
This can be written as:
Yβ = Οββ + ΟββXβ + ΟββXβ + uβ [Reduced form equation 1]
Now substituting this expression for Yβ into equation (2) gives:
Yβ = (Ξ²β + Ξ±βΞ²β)/(1 - Ξ±βΞ²β) + (Ξ²βΞ±β/(1 - Ξ±βΞ²β))Xβ + (Ξ²β/(1 - Ξ±βΞ²β))Xβ + uβ
This can be written as:
Yβ = Οββ + ΟββXβ + ΟββXβ + uβ [Reduced form equation 2]
The reduced form coefficients are:
Οββ = (Ξ±β + Ξ±βΞ²β)/(1 - Ξ±βΞ²β)
Οββ = Ξ±β/(1 - Ξ±βΞ²β)
Οββ = Ξ±βΞ²β/(1 - Ξ±βΞ²β)
Οββ = (Ξ²β + Ξ±βΞ²β)/(1 - Ξ±βΞ²β)
Οββ = Ξ²βΞ±β/(1 - Ξ±βΞ²β)
Οββ = Ξ²β/(1 - Ξ±βΞ²β)
Solving the above, we can express the structural parameters (Ξ±α΅’ and Ξ²α΅’) in terms of reduced form coefficients:
Ξ²β = Οββ/Οββ
Ξ²β = Οββ - (Οββ/Οββ)Οββ
Ξ²β = Οββ - (Οββ/Οββ)Οββ
Since the structural parameters of equation (2) can be expressed in one way in terms of reduced form coefficients, Equation 2 is exactly identified.
Also:
Ξ±β = Οββ/Οββ
Ξ±β = Οββ - (Οββ/Οββ)Οββ
Ξ±β = Οββ - (Οββ/Οββ)Οββ
Since the structural parameters of equation (1) can be expressed in one way in terms of reduced form coefficients, Equation 1 is also exactly identified.
β Key Takeaways
The most critical concept from this lecture is that simultaneous equation models arise when variables are interdependent, and applying OLS directly leads to simultaneity bias. You must distinguish between endogenous variables (determined within the model, equal in number to the equations) and exogenous variables (determined outside the model). To estimate such models, you transform them into reduced form equations where each endogenous variable is expressed solely as a function of exogenous variables and error terms. The identification problem determines whether you can recover the original structural parameters from the reduced form coefficients β equations can be under-identified (cannot recover), exactly identified (recover in one way), or over-identified (recover in multiple ways). The exclusion principle provides a simple check: in a two-equation system, each equation must exclude at least one exogenous variable present in the other equation to be identified.
π§ Quick Revision Questions
- What is simultaneity bias, and why does OLS fail in simultaneous equation models?
- How do you identify which variables are endogenous and which are exogenous in a simultaneous equation system?
- What are reduced form equations, and how do they differ from structural equations?
- Explain the difference between under-identified, exactly identified, and over-identified equations.
- Using the market model (Qd = Ξ±β + Ξ±βP + Ξ±βI + eβ, Qs = Ξ²β + Ξ²βP + Ξ²βT + eβ, Qd = Qs), identify the endogenous and exogenous variables and explain why it is a simultaneous model.
π Lecture 31 β Simultaneous Equation Models-II
π Overview: This lecture continues the discussion of simultaneous equation models, focusing on the critical issue of identification. It demonstrates how to determine whether structural equations are under-identified, exactly identified, or over-identified using both algebraic derivation and the Order Condition, and explains which estimation method (ILS or 2SLS) is appropriate for each case.
ποΈ Topics Covered
The lecture begins with a detailed example of a market model (demand and supply) to show how to derive reduced form equations and check for exact identification. It then presents examples of under-identified and over-identified equations. Finally, it introduces the Order Condition as a quick rule for determining identification status and applies it to several examples with multiple endogenous variables.
π Lecture Summary
Identification of a Market Model
Consider the market model: νν = νΌ0 + νΌ1ν + νΌ2νΌ + ν1 νν = ν½0 + ν½1ν + ν½2ν + ν2 νν = νν
Endogenous variables are Q and P. Exogenous variables are I and T.
Using the equilibrium condition νν = νν : νΌ0 + νΌ1ν + νΌ2νΌ + ν1 = ν½0 + ν½1ν + ν½2ν + ν2
Solving for P: ν = (ν½0 β νΌ0)/(νΌ1 β ν½1) + (ν½2/(νΌ1 β ν½1))ν β (νΌ2/(νΌ1 β ν½1))νΌ + (ν2 β ν1)/(νΌ1 β ν½1)
Labeling: ν = ν10 + ν11ν + ν12νΌ + ν£1
Where: ν10 = (ν½0 β νΌ0)/(νΌ1 β ν½1), ν11 = ν½2/(νΌ1 β ν½1), ν12 = βνΌ2/(νΌ1 β ν½1)
Substituting into the demand equation: ν = νΌ0 + νΌ1(ν10 + ν11ν + ν12νΌ + ν£1) + νΌ2νΌ + ν1 ν = (νΌ0 + νΌ1ν10) + νΌ1ν11ν + (νΌ1ν12 + νΌ2)νΌ + (ν1 + νΌ1ν£1)
Labeling: ν = ν20 + ν21ν + ν22νΌ + ν£2
Where: ν20 = νΌ0 + νΌ1ν10, ν21 = νΌ1ν11, ν22 = νΌ1ν12 + νΌ2
All structural parameters can be expressed in terms of reduced form coefficients: ν½1 = ν22/ν12, ν½0 = ν20 β (ν22/ν12)ν10, ν½2 = ν21 β (ν22/ν12)ν11 νΌ1 = ν21/ν11, νΌ2 = ν22 β (ν21/ν11)ν12, νΌ0 = ν20 β (ν21/ν11)ν10
Hence both equations are exactly identified.
π‘ Why this matters: When an equation is exactly identified, there is a unique way to recover the structural parameters from the reduced form coefficients, allowing for consistent estimation using Indirect Least Squares (ILS).
Example: Under-identified Equation
Consider the model: ν1 = νΌ0 + νΌ1ν2 + νΌ2ν1 + ν1 ν2 = ν½0 + ν½1ν1 + ν2
Exogenous variables: ν1; Endogenous variables: ν1 and ν2
Substituting value of ν2 in equation 1: ν1 = (νΌ0 + νΌ1ν½0)/(1 β νΌ1ν½1) + (νΌ2/(1 β νΌ1ν½1))ν1 + (νΌ1ν2 + ν1)/(1 β νΌ1ν½1)
Labeling: ν1 = ν10 + ν11ν1 + ν£1
ν10 = (νΌ0 + νΌ1ν½0)/(1 β νΌ1ν½1), ν11 = νΌ2/(1 β νΌ1ν½1)
Substituting reduced form of ν1 in equation 2: ν2 = ν½0 + ν½1(ν10 + ν11ν1 + ν£1) + ν2 ν2 = (ν½0 + ν½1ν10) + ν½1ν11ν1 + (ν½1ν£1 + ν2)
Labeling: ν2 = ν20 + ν21ν1 + ν£2
ν20 = ν½0 + ν½1ν10, ν21 = ν½1ν11
We can solve for ν½1 and ν½0 but not for νΌν. So only equation 2 is exactly identified. Equation 1 is unidentified.
π Definition β Unidentified equation: An equation whose parameters cannot be estimated because there is not enough information in the reduced form to obtain meaningful estimates. The parameters of an unidentified equation have no interpretation.
Example: One Over-identified Equation
Consider the model: ν1 = νΌ0 + νΌ1ν2 + ν1 ν2 = ν½0 + ν½1ν1 + ν½2ν1 + ν½3ν2 + ν2
Substituting the first equation in second and rearranging: ν2 = (ν½0 + ν½1νΌ0)/(1 β νΌ1ν½1) + (ν½2/(1 β νΌ1ν½1))ν1 + (ν½3/(1 β νΌ1ν½1))ν2 + (ν½1ν1 + ν2)/(1 β νΌ1ν½1)
Labeling: ν2 = ν20 + ν21ν1 + ν22ν2 + ν£2
Where: ν20 = (ν½0 + ν½1νΌ0)/(1 β νΌ1ν½1), ν21 = ν½2/(1 β νΌ1ν½1), ν22 = ν½3/(1 β νΌ1ν½1)
Substituting the reduced form for ν2 in the first structural equation: ν1 = νΌ0 + νΌ1(ν20 + ν21ν1 + ν22ν2 + ν£2) + ν1 ν1 = (νΌ0 + νΌ1ν20) + νΌ1ν21ν1 + νΌ1ν22ν2 + (νΌ1ν£2 + ν1) ν1 = ν10 + ν11ν1 + ν12ν2 + ν1
Where: ν10 = νΌ0 + νΌ1ν20, ν11 = νΌ1ν21, ν12 = νΌ1ν22
This means we can express νΌ1 in terms of reduced form coefficients in two ways: νΌ1 = ν11/ν21 AND νΌ1 = ν12/ν22
Hence equation 1 is over-identified. Equation 2 is under-identified.
π Definition β Over-identified equation: An equation where there are more than one way to express the structural parameters in terms of reduced form coefficients, providing redundant information.
π Formula β Appropriate estimation methods:
- If exactly identified β use ILS (Indirect Least Squares)
- If over-identified β use 2SLS (Two Stage Least Squares)
Order Condition for Identification Status
The Order Condition is a simple rule to determine identification status without deriving reduced forms. Compare two parameters:
- ν1: Number of exogenous variables excluded from the equation = (total exogenous variables in model) β (exogenous variables in the equation)
- ν2: Number of endogenous variables in the model minus 1
If ν1 < ν2, the equation is under-identified If ν1 = ν2, the equation is exactly identified If ν1 > ν2, the equation is over-identified
Example: ν1 = νΌ0 + νΌ1ν2 + νΌ2ν1 + ν1 ν2 = ν½0 + ν½1ν1 + ν½2ν2 + ν2
Equation 1: ν1 = 1 (ν2 excluded), ν2 = 2 β 1 = 1 β ν1 = ν2, exactly identified (apply ILS) Equation 2: ν1 = 1 (ν1 excluded), ν2 = 2 β 1 = 1 β ν1 = ν2, exactly identified (apply ILS)
Example (market model): νν = νΌ0 + νΌ1ν + νΌ2νΌ + ν1 νν = ν½0 + ν½1ν + ν½2ν + ν2 νν = νν
Equation 1: ν1 = 1 (ν excluded), ν2 = 2 β 1 = 1 β exactly identified (apply ILS) Equation 2: ν1 = 1 (νΌ excluded), ν2 = 2 β 1 = 1 β exactly identified (apply ILS)
Example: ν1 = νΌ0 + νΌ1ν2 + νΌ2ν1 + ν1 ν2 = ν½0 + ν½1ν1 + ν2
Equation 1: ν1 = 0 (no exogenous variable excluded), ν2 = 2 β 1 = 1 β ν1 < ν2, under-identified (no method) Equation 2: ν1 = 1 (ν1 excluded), ν2 = 2 β 1 = 1 β exactly identified (apply ILS)
Example: ν1 = νΌ0 + νΌ1ν2 + ν1 ν2 = ν½0 + ν½1ν1 + ν½2ν1 + ν½3ν2 + ν2
Equation 1: ν1 = 2 (both ν1 and ν2 excluded), ν2 = 2 β 1 = 1 β ν1 > ν2, over-identified (apply 2SLS) Equation 2: ν1 = 0 (no exogenous excluded), ν2 = 2 β 1 = 1 β ν1 < ν2, under-identified (no method)
Example (three endogenous variables): ν1 = νΌ0 + νΌ1ν2 + νΌ2ν3 + ν½2ν1 + ν1 ν2 = ν½0 + ν½1ν1 + ν½2ν3 + ν½3ν2 + ν2 ν3 = νΎ0 + νΎ1ν1 + νΎ2ν2 + νΎ3ν3 + ν3
Equation 1: ν1 = 2 (ν2 and ν3 excluded), ν2 = 3 β 1 = 2 β ν1 = ν2, exactly identified (apply ILS) Equations 2 and 3 are also exactly identified.
β Key Takeaways
The identification status of a structural equation is fundamental to choosing the correct estimation method. An equation is under-identified if it lacks enough excluded exogenous variables (ν1 < ν2), making its parameters uninterpretable. It is exactly identified when the number of excluded exogenous variables equals the number of endogenous variables minus one (ν1 = ν2), allowing the use of Indirect Least Squares (ILS). It is over-identified when more exogenous variables are excluded than needed (ν1 > ν2), requiring Two Stage Least Squares (2SLS) for estimation. The Order Condition provides a quick way to determine identification status by simply counting and comparing these two parameters, without deriving reduced forms.
π§ Quick Revision Questions
- What are the two parameters compared in the Order Condition, and how do you compute each?
- If an equation has ν1 = 2 and ν2 = 2, what is its identification status and which estimation method should be used?
- In the market model with demand (including I) and supply (including T), why are both equations exactly identified?
- What does it mean when an over-identified equation has two different ways to compute the same structural parameter (e.g., νΌ1 = ν11/ν21 and νΌ1 = ν12/ν22)?
- Why can no estimation method be applied to an under-identified equation?
π Lecture 32 β Indirect Least Square (ILS)
π Overview: This lecture introduces the Indirect Least Squares (ILS) method, a technique used to obtain consistent estimates of structural parameters in simultaneous equation models when an equation is exactly identified. It contrasts ILS with direct OLS estimation, which suffers from simultaneity bias, and demonstrates the complete ILS procedure through step-by-step examples and Stata implementation.
ποΈ Topics Covered
The lecture covers the concept and steps of Indirect Least Squares (ILS), including the order condition for identification, derivation of reduced form equations, and expression of structural parameters in terms of reduced form coefficients. Two detailed examples are worked through with actual data: a two-equation macroeconomic model and a demand-supply system. The lecture also discusses exclusion restrictions for identification, the role of shifters (technology and income), and the Stata implementation of ILS using the reg3 command for 2SLS.
π Lecture Summary
What is Indirect Least Square (ILS)?
Indirect least square may be applied when an equation is exactly identified. ILS will provide consistent estimates of the structural parameters. Applying OLS (Ordinary Least Squares) to individual equations of a simultaneous equation model does not provide consistent results due to simultaneity bias, where endogenous variables are correlated with error terms.
Steps of ILS
- Apply order condition to check identification status
- Find the reduced form equations
- Express the structural parameters in terms of reduced form coefficients
- Estimate the reduced form coefficients by OLS
- Calculate the structural parameters
Example 1: Two-Equation System
Consider the structural equations: [ Y_1 = \alpha_0 + \alpha_1 Y_2 + \alpha_2 X_1 + e_1 ] [ Y_2 = \beta_0 + \beta_1 Y_1 + \beta_2 X_2 + e_2 ]
Applying the order condition shows that both equations are exactly identified.
The reduced form equations are: [ Y_1 = \pi_{10} + \pi_{11} X_1 + \pi_{12} X_2 + u_1 ] [ Y_2 = \pi_{20} + \pi_{21} X_1 + \pi_{22} X_2 + u_1 ]
Expressing structural parameters in terms of reduced form coefficients: [ \beta_1 = \frac{\pi_{21}}{\pi_{11}}, \quad \beta_0 = \pi_{20} - \frac{\pi_{21}}{\pi_{11}} \pi_{10}, \quad \beta_2 = \pi_{22} - \frac{\pi_{21}}{\pi_{11}} \pi_{12} ] [ \alpha_1 = \frac{\pi_{12}}{\pi_{22}}, \quad \alpha_0 = \pi_{10} - \frac{\pi_{12}}{\pi_{22}} \pi_{20}, \quad \alpha_2 = \pi_{11} - \frac{\pi_{12}}{\pi_{22}} \pi_{21} ]
Data (ILS.xlsx):
| Yβ | Yβ | Xβ | Xβ |
|---|---|---|---|
| 25 | 0.8 | 10 | 12 |
| 25 | 0.9 | 8 | 11 |
| 27 | 0.8 | 8 | 12 |
| 29 | 1.2 | 7 | 11 |
| 32 | 1.2 | 6 | 9 |
| 32 | 1.6 | 3 | 8 |
| 33 | 1.9 | 4 | 8 |
| 36 | 2.1 | 5 | 7 |
| 40 | 2.0 | 4 | 5 |
| 49 | 2.0 | 2 | 5 |
OLS estimation of reduced form equations gives: [ Y_1 = 54.96 - 0.245 X_1 - 2.359 X_2 ] [ Y_2 = 3.011 - 0.039 X_1 - 0.152 X_2 ]
Reduced form coefficients: [ \pi_{10} = 54.96086, \quad \pi_{11} = -0.24518, \quad \pi_{12} = -2.35947 ] [ \pi_{20} = 3.010546, \quad \pi_{21} = -0.03949, \quad \pi_{22} = -0.15175 ]
Indirect estimation of structural parameters: [ \alpha_{0-ILS} = 8.152606, \quad \alpha_{1-ILS} = 15.54809, \quad \alpha_{2-ILS} = 0.368888 ] [ \beta_{0-ILS} = -5.8429, \quad \beta_{1-ILS} = 0.161086, \quad \beta_{2-ILS} = 0.228326 ]
The estimated structural equations are: [ Y_1 = 8.15 + 15.55 Y_2 + 0.369 X_1 ] [ Y_2 = -5.84 + 0.161 Y_1 + 0.228 X_2 ]
π‘ Why this matters: If we would have estimated the structural equations individually by OLS, we would have gotten different and inconsistent results due to simultaneity bias.
Example 2: Demand and Supply System
Consider the demand and supply equations: [ Q^d = \alpha_0 + \alpha_1 P + \alpha_2 I + e_1 ] [ Q^s = \beta_0 + \beta_1 P + \beta_2 T + e_2 ] [ Q^d = Q^s ]
Applying the order condition shows both equations are exactly identified.
Reduced form equations: [ P = \pi_{10} + \pi_{11} T + \pi_{12} I + v_1 ] [ Q = \pi_{20} + \pi_{21} T + \pi_{22} I + v_2 ]
Structural parameters expressed in terms of reduced form coefficients: [ \beta_1 = \frac{\pi_{22}}{\pi_{12}}, \quad \beta_0 = \pi_{20} - \frac{\pi_{22}}{\pi_{12}} \pi_{10}, \quad \beta_2 = \pi_{21} - \frac{\pi_{22}}{\pi_{12}} \pi_{11} ] [ \alpha_1 = \frac{\pi_{21}}{\pi_{11}}, \quad \alpha_2 = \pi_{22} - \frac{\pi_{21}}{\pi_{11}} \pi_{12}, \quad \alpha_0 = \pi_{20} - \frac{\pi_{21}}{\pi_{11}} \pi_{10} ]
Data (ILS.xlsx):
| Quantity (Q) | Price (P) | Income (I) | Technology (T) |
|---|---|---|---|
| 5 | 3 | 5 | 0.2 |
| 6 | 5 | 10 | 0.5 |
| 7 | 2 | 6 | 0.5 |
| 4 | 6 | 7 | 0.2 |
| 6 | 10 | 15 | 0.2 |
| 9 | 5 | 8 | 0.5 |
| 11 | 6 | 10 | 0.9 |
| 7 | 6 | 8 | 0.5 |
| 6 | 12 | 12 | 0.2 |
| 12 | 12 | 16 | 0.9 |
OLS estimation of reduced form equations: [ P = -0.82 - 2.62 T + 0.9 I ] [ Q = 2.12 + 8.2 T + 0.15 I ]
Reduced form coefficients: [ \pi_{10} = -0.82, \quad \pi_{11} = -2.62, \quad \pi_{12} = 0.9 ] [ \pi_{20} = 2.12, \quad \pi_{21} = 8.2, \quad \pi_{22} = 0.15 ]
Indirect estimation of structural parameters: [ \alpha_{0-ILS} = -0.45087, \quad \alpha_{1-ILS} = -3.12665, \quad \alpha_{2-ILS} = 2.958705 ] [ \beta_{0-ILS} = 2.250948, \quad \beta_{1-ILS} = 0.161495, \quad \beta_{2-ILS} = 8.623996 ]
The estimated structural equations are: [ Q^d = -0.45 - 3.13 P + 2.96 I ] [ Q^s = 2.25 + 0.16 P + 8.62 T ]
π‘ Why this matters: If we would have estimated the structural equations individually by OLS, we would have gotten different and inconsistent results.
ILS using Stata
The reg3 command can be used in Stata. reg3 is a command for 3SLS (the option 2sls can be used). For exactly identified equations, 2SLS results are identical to ILS.
Example II can be done as follows:
reg3 q p i, exog(i t) endog(q p) 2sls
reg3 q p t, exog(i t) endog(q p) 2sls
From the interface: Statistics β Linear Models β Multiple equation models β Three stage least square
π Key insight: In a two-equation system, at least one variable must be excluded from an equation to make it identified.
Understanding Identification: Exclusion Restriction
Consider two points on the same demand curve. Two points on the demand curve show different supply curves. The supply curve shifts through 'shift factors' or supply shifters. Technology is a supply shifter.
The two points are on the same demand curve. Technology must not appear in the demand equation because if it does, it will shift the demand as well. To have two points on the same demand curve, we need an exogenous variable that does not shift the demand curve but only the supply curve.
Now consider two points on the same supply curve. Two points on the supply curve show different demand curves. The demand curve shifts through 'shift factors' or demand shifters. Income level is a demand shifter.
To show both points (different demand curves), income level must appear in the demand equation. It must not appear in the supply equation because if it does, it will shift the supply as well. To have two points on the same supply curve, we need an exogenous variable that does not shift the supply curve but only the demand curve.
Notes and Assumptions on ILS
We can directly write the reduced form equations without solving the model. We need to solve the model to derive the structural parameters from the reduced form coefficients. 2SLS also can be applied to exactly identified equations with the same results as ILS. ILS and 2SLS provide the same results when 2SLS is applied to a single equation. ILS and 3SLS may provide the same results when applied to a complete system. (Park, Canadian Journal of Statistics 01/1974)
Assumptions of ILS:
- Equations must be exactly identified
- Error terms in all reduced form equations must satisfy all usual assumptions of OLS estimation
- No multicollinearity in exogenous variables
- Sample size not very small (ILS is biased for small samples)
β Key Takeaways
Indirect Least Squares (ILS) is the appropriate estimation method for exactly identified structural equations in simultaneous equation models, providing consistent estimates that direct OLS cannot achieve due to simultaneity bias. The procedure involves estimating reduced form equations by OLS and then solving back for structural parameters using the mathematical relationships between reduced form coefficients and structural parameters. The exclusion restriction is fundamental for identification: to trace a demand curve, we need a supply shifter (like technology) that is excluded from the demand equation, and to trace a supply curve, we need a demand shifter (like income) excluded from the supply equation. ILS assumes exactly identified equations, classical OLS assumptions for each reduced form equation, no multicollinearity among exogenous variables, and sufficiently large sample sizes.
π§ Quick Revision Questions
- Why can't we simply apply OLS to each structural equation in a simultaneous equation model, and what problem does ILS solve?
- What are the five steps required to implement the ILS procedure?
- How does the exclusion restriction help identify demand and supply curves, and what specific variables serve as shifters in the examples?
- What is the relationship between ILS and 2SLS results for exactly identified equations?
- What are the four key assumptions that must be satisfied for ILS to provide valid estimates?
π Lecture 33 β Two Stage Least Square
π Overview: This lecture explains the Two Stage Least Square (2SLS) method for estimating parameters of over-identified equations in simultaneous equation models. It demonstrates both stages of the procedure with two detailed numerical examples, contrasts 2SLS estimates with inappropriate OLS estimates, and shows how to implement the method using Stata.
ποΈ Topics Covered
The lecture covers the two-stage procedure for 2SLS estimation, beginning with deriving reduced forms for endogenous variables on the right-hand side of the over-identified equation and estimating them using OLS in Stage I. Stage II involves replacing the endogenous variable with its trend values from the reduced form and re-estimating using OLS. Two worked examples (a general two-equation model and a supply-demand model) are presented with numerical data. The lecture also explains the order condition for over-identification, shows the calculation of trend values, compares 2SLS estimates with direct OLS estimates, and ends with Stata commands using reg3 and ivregress.
π Lecture Summary
Two Stage Least Square
We can use 2SLS to estimate the parameters of over-identified equations.
Stage I: Derive or write the reduced forms for all endogenous variables on the RHS of the over-identified equation and estimate them using OLS.
Stage II: Find the trend value of the above estimated reduced form equations, replace with the variables in the over-identified equation, and estimate it using OLS.
Consider the model: νβ = νΌβ + νΌβνβ + νβ νβ = ν½β + ν½βνβ + ν½βνβ + ν½βνβ + νβ
Stage I: The first equation is over-identified (verified using the order condition). Since νβ is the endogenous variable on the RHS of the first (over-identified) equation, we need to estimate the reduced form for νβ.
Stage II: Replace νβ with νΜβ (from the reduced form) and estimate it using OLS.
Detailed Procedure with Example 1
Let us do it in detail: νβ = νΌβ + νΌβνβ + νβ νβ = ν½β + ν½βνβ + ν½βνβ + ν½βνβ + νβ
Order Condition: Equation 1 Number of exogenous variables excluded from the equation is 2, which is greater than the number of endogenous variables in the model minus one (which gives 1). So equation 1 is over-identified. ILS cannot be used.
Stage 1
- We need the reduced form for the endogenous variable on the RHS of equation 1.
- νβ is the variable.
Reduced form equations contain only exogenous variables, and they contain all the exogenous variables of the model. νβ = νββ + νββνβ + νββνβ + ν£β
For 2SLS, we do not need to know what the Οα΅’ are equivalent to.
Now consider a small data set (2SLS.xlsx) to estimate: νβ = νββ + νββνβ + νββνβ + ν£β
The estimates are: νβ = 3.011 β 0.039 νβ β 0.152 νβ
This gives the trend values for νβ: 0.794564, 1.025306, 0.873553, 1.0648, 1.407801, 1.678038, 1.638543, 1.750802, 2.093803, 2.172792
Stage I is complete now.
Stage II In Stage II, we replace the variable Yβ in the original over-identified equation with the trend values from the reduced form of Yβ and run the regression.
The original (over-identified) equation was: νβ = νΌβ + νΌβνβ + νβ
After replacing Yβ with the estimated Yβ: νβ = νΌβ + νΌβνΜβ + νβ
Estimating this gives: νβ = 12.81 + 13.785 νΜβ
12.81 and 13.785 are the 2SLS estimates of νΌβββSLS and νΌβββSLS. If we had directly regressed νβ on νβ, we would have got 16.03 and 11.6 as νΌββOLS and νΌββOLS (not appropriate estimates).
Example 2: Supply-Demand Model
Consider the model: να΅ = νΌβ + νΌβν + νβ νΛ’ = ν½β + ν½βν + ν½βνΆ + ν½βν + νβ να΅ = νΛ’
Where: ν = Price, ν = Quantity (demanded or supplied) νΆ = Cost of production, ν = The level of technology
- 2SLS is needed for the first equation.
- Stage I: The first equation is over-identified. Since ν is the endogenous variable on the RHS of the first (over-identified) equation, we need to estimate the reduced form for ν.
- Stage II: Replace ν with νΜ (from the reduced form) in the demand equation and estimate using OLS.
Order Condition: Demand equation Number of exogenous variables excluded from the equation is 2, which is greater than the number of endogenous variables in the model minus one (which gives 1). So the demand equation is over-identified. ILS cannot be used.
Stage 1
- We need the reduced form for the endogenous variable on the RHS of the demand equation.
- Q and P are endogenous; C and T are exogenous variables.
- ν is the variable for which the reduced form is needed.
Reduced form equations contain only exogenous variables and contain all the exogenous variables of the model. ν = νββ + νββνΆ + νββν + ν£β
Using the data set, the estimates are: ν = 0.868 + 0.548 νΆ + 1.3683 ν
This gives the trend values for ν: 6.618038, 7.028532, 6.480933, 7.713237, 6.070439, 5.933333, 5.933059, 6.480933, 6.070439, 8.671056
Stage I is complete now.
Stage II In Stage II, we replace the variable P in the original over-identified equation with the trend values from the reduced form of P and run the regression.
The original (over-identified) equation was: να΅ = νΌβ + νΌβν + νβ
After replacing P with the estimated P: ν = νΌβ + νΌβνΜ + νβ
Estimating this gives: ν = 4.1735 + 0.4667 νΜ
4.1735 and 0.4667 are the 2SLS estimates of νΌβββSLS and νΌβββSLS. If we had directly regressed ν on ν, we would have got 5.906 and 0.20799 as νΌββOLS and νΌββOLS (not appropriate estimates).
Using Stata for Two Stage Least Square (2SLS)
Using reg3 (preferred) On the Menu: Statistics > Endogenous covariates > Three-stage least squares. In the window, after providing required information, check the option 2SLS.
For Example 1, in the command window type:
reg3 (y1 y2) (y2 x1 x2), 2sls
For Example 2, in the command window type:
reg3 (q p) (p c t), 2sls
Using ivregress In some cases ivregress can be used, but prefer reg3.
For Example 1, in the command window type:
ivregress 2sls y1 (y2= x1 x2)
The syntax is: ivregress 2sls dependent-variable (instrumented-variable=instruments)
We can use the option first to see the Stage I results:
ivregress 2sls y1 (y2= x1 x2), first
For Example 2, in the command window type:
ivregress 2sls q (p= c t)
ivregress 2sls q (p= c t), first
π‘ Why this matters: Direct OLS estimation of an over-identified equation produces biased and inconsistent estimates because the endogenous variable on the RHS is correlated with the error term. 2SLS solves this by using instruments (excluded exogenous variables) to generate predicted values that are uncorrelated with the error, yielding consistent estimates.
π Definition β Over-identified equation: An equation in a simultaneous equation model where the number of exogenous variables excluded from the equation is greater than the number of endogenous variables in the model minus one. ILS cannot be used for such equations.
π Definition β Reduced form equation: An equation that expresses an endogenous variable solely as a function of all exogenous variables in the system. It contains no other endogenous variables on the RHS.
π Formula β 2SLS Stage I: For an over-identified equation with endogenous Yβ on RHS, estimate: νβ = νββ + νββνβ + νββνβ + ν£β β Compute fitted values νΜβ.
π Formula β 2SLS Stage II: Replace Yβ with νΜβ and estimate: νβ = νΌβ + νΌβνΜβ + νβ β Obtain consistent 2SLS estimates of νΌβ and νΌβ.
π Example (from lecture): In the first data set, direct OLS gave νβ = 16.03 + 11.6 νβ, but the correct 2SLS estimates are νβ = 12.81 + 13.785 νΜβ. In the supply-demand example, direct OLS gave ν = 5.906 + 0.20799 ν, but correct 2SLS estimates are ν = 4.1735 + 0.4667 νΜ.
β Key Takeaways
For any over-identified equation in a simultaneous equation system, 2SLS is the appropriate estimation method because ILS is not applicable. The method proceeds in two clear stages: first, estimate the reduced form for each endogenous variable appearing on the RHS of the over-identified equation using all exogenous variables as regressors; second, replace the actual endogenous variable with its fitted (trend) values from the reduced form and estimate the original equation using OLS to obtain consistent parameter estimates. Direct OLS estimation of the original equation gives biased and inconsistent results because the endogenous regressor is correlated with the error term. The order condition must be checked first: if the number of excluded exogenous variables exceeds (number of endogenous variables minus one), the equation is over-identified and 2SLS is required.
π§ Quick Revision Questions
- Why can ILS not be used for an over-identified equation, and which method should be used instead?
- What is the key difference in the Stage I regression between 2SLS and a simple reduced form estimation?
- In the first example, what are the 2SLS estimates of νΌβ and νΌβ, and how do they compare to the direct OLS estimates?
- What does the
firstoption do when used with theivregresscommand in Stata? - For the supply-demand model, identify the instruments used for the demand equation and explain why they are valid.
π Lecture 34 β 2SLS & 3SLS Models
π Overview: This lecture explains why OLS fails when a system contains multiple endogenous variables, and introduces Two-Stage Least Squares (2SLS) and Three-Stage Least Squares (3SLS) as solutions. It covers the mathematical proof that 2SLS equals Indirect Least Squares (ILS) for exactly identified equations, a numerical example, and the motivation for using 3SLS to improve efficiency by accounting for cross-equation error correlations.
ποΈ Topics Covered
The lecture begins by explaining why 2SLS is needed when there are multiple endogenous variables in a system of equations, as OLS becomes biased. It introduces the Durban and Wu-Hausman tests for endogeneity. It then presents a mathematical proof showing 2SLS equals ILS for exactly identified equations, followed by a numerical example using Excel. The lecture concludes by introducing 3SLS as an extension of 2SLS that accounts for correlations between error terms of different equations, and demonstrates its implementation in Stata.
π Lecture Summary
Why to use 2SLS?
OLS has only one endogenous variable (the dependent variable). When we have a system of equations, there may be several endogenous variables. When a variable is endogenous, it may be correlated with the disturbance term, leading to biased OLS estimates. The goal of 2SLS is to find a proxy for the endogenous variable that is not correlated with the error term (e). This proxy is denoted as ( \hat{P} ). ( \hat{P} ) should not be correlated with ( e_1 ).
Testing Endogeneity: Durban and Wu-Hausman Tests
After using the ivregress command in Stata, the post-estimation command to test for endogeneity is:
estat endogeneity
If p-values are less than 5%, we can reject the null hypothesis (( H_0 )) of exogenous regressors and conclude that the variables can be used as endogenous variables.
π‘ Why this matters: This test formally confirms whether 2SLS is necessary or if OLS would have been unbiased.
Proof: 2SLS == ILS for exactly identified equations
Consider the model: [ Y_1 = \alpha_0 + \alpha_1 Y_2 + e_1 ] [ Y_2 = \beta_0 + \beta_1 Y_1 + \beta_2 X_1 + e_2 ]
The reduced form equations are: [ Y_1 = \pi_{10} + \pi_{11} X_1 + u_1 ] [ Y_2 = \pi_{20} + \pi_{21} X_1 + u_2 ]
Where: [ \pi_{11} = \frac{\alpha_1 \beta_2}{(1 - \alpha_1 \beta_1)}, \quad \pi_{21} = \frac{\beta_2}{(1 - \alpha_1 \beta_1)} ]
π Definition β ILS (Indirect Least Squares): A method where the structural parameters are derived from the reduced form parameters estimated by OLS.
Applying ILS: [ \alpha_{1_{ILS}} = \frac{\pi_{11}}{\pi_{21}} ]
We estimate the two reduced forms by OLS: [ \hat{\pi}{11{OLS}} = \frac{\sum x_1 y_1}{\sum x_1^2}, \quad \hat{\pi}{21{OLS}} = \frac{\sum x_1 y_2}{\sum x_1^2} ]
Applying 2SLS: We estimate ( \hat{Y}2 ) and replace it in the first equation. Since ( Y_2 = \pi{20} + \pi_{21} X_1 + u_2 ), we have ( \hat{Y}2 = \hat{\pi}{21} X_1 ).
Replacing in the original equation: [ Y_1 = \alpha_0 + \alpha_1 \hat{Y}_2 + e_1 ]
The 2SLS estimator is: [ \alpha_{1_{2SLS}} = \frac{\sum Y_1 \hat{Y}2}{\sum \hat{Y}2^2} = \frac{\sum Y_1 \hat{\pi}{21} X_1}{\sum (\hat{\pi}{21} X_1)^2} = \frac{\hat{\pi}{21} \sum X_1 Y_1}{(\hat{\pi}{21})^2 \sum X_1^2} = \frac{1}{\hat{\pi}_{21}} \frac{\sum X_1 Y_1}{\sum X_1^2} ]
π Formula: [ \alpha_{1_{2SLS}} = \frac{\sum X_1 Y_1}{\sum X_1^2} \cdot \frac{1}{\hat{\pi}{21}} = \frac{\frac{\sum X_1 Y_1}{\sum X_1^2}}{\hat{\pi}{21}} = \frac{\hat{\pi}{11}}{\hat{\pi}{21}} = \alpha_{1_{ILS}} ]
Therefore, ( \alpha_{1_{2SLS}} = \alpha_{1_{ILS}} ). ILS and 2SLS provide identical results when applied to exactly identified equations.
Numerical Example
Consider the same model. We can estimate it using data from ILS-2SLS.xlsx.
| ( Y_1 ) | ( Y_2 ) | ( X_1 ) |
|---|---|---|
| 25 | 0.8 | 10 |
| 25 | 0.9 | 8 |
| 27 | 0.8 | 8 |
| 29 | 1.2 | 7 |
| 32 | 1.2 | 6 |
| 32 | 1.6 | 3 |
| 33 | 1.9 | 4 |
| 36 | 2.1 | 5 |
| 40 | 2.0 | 4 |
| 49 | 2.0 | 2 |
Using the slope function in Excel: [ \hat{\pi}{11} = -2.45439, \quad \hat{\pi}{21} = -0.18158 ]
[ \alpha_{1_{ILS}} = \frac{\hat{\pi}{11}}{\hat{\pi}{21}} = \frac{-2.45439}{-0.18158} = 13.51659 ]
Now 2SLS: Stage I: Regress ( Y_2 ) on ( X_1 ) to get ( \hat{Y}_2 ):
| ( \hat{Y}_2 ) |
|---|
| 0.669191 |
| 1.032358 |
| 1.032358 |
| 1.213941 |
| 1.395525 |
| 1.940275 |
| 1.758692 |
| 1.577108 |
| 1.758692 |
| 2.121859 |
Stage II: Replace ( Y_2 ) with ( \hat{Y}2 ) in the first equation and estimate: [ \alpha{1_{2SLS}} = 13.51659 = \alpha_{1_{ILS}} ]
π Example: This confirms that ILS and 2SLS provide identical results for exactly identified equations.
Three Stage Least Square (3SLS)
Background:
- OLS: Inconsistent for systems with simultaneous equations.
- 2SLS: "Cleans" the endogenous regressors.
- Regress endogenous variables against all predetermined variables of the system (reduced form). This gives "theoretical values".
- Use OLS for theoretical values, replacing the original values.
Possible Problem with 2SLS:
- 2SLS focuses on a single equation in the system.
- Correlations between error terms of various equations are ignored.
- This may give inefficient estimates.
Solution: Use 3SLS (Zellner & Theil, 1962):
- After 2SLS, we add a third stage to account for correlations of error terms.
- 3SLS uses the results of 2SLS to estimate all coefficients of the system simultaneously.
- 3SLS is more efficient compared to 2SLS.
- 3SLS is better when the correlation of error terms is not small.
3SLS using Stata
Syntax:
reg3 (depvar1 varlist1) (depvar2 varlist2) ...... (depvarN varlistN) [if] [in] [weight]
Menu: Statistics > Endogenous Covariates > Three Stage Least Square
Example using klein dataset:
webuse klein
describe
EQ1: consump wagepriv wagegovt
EQ2: wagepriv consump govt capital1
Important options:
noconst: omits constant term for an equation if specified in an equation; omits constant term from instrument list (stage I) if specified overall.ireg3: iterates over the estimated disturbance covariance matrix and parameter estimates until the parameter estimates converge.sure: performs a seemingly unrelated regression estimation of the system - even if dependent variables from some equations appear as regressors in other equations.2sls: performs equation-by-equation two stage least squares on the full system of equations.first: requests display of first stage regression.corr: specifies the assumed form of the correlation structure of the equation disturbances; rarely requested.small: small sample statistics are also computed.3sls: performs three stage least square; this is the default.
β Key Takeaways
The core insight is that when multiple endogenous variables exist in a system of equations, OLS is biased. 2SLS solves this by finding a proxy (the predicted value from a first-stage regression) that is uncorrelated with the error term. A formal proof demonstrates that for exactly identified equations, 2SLS and ILS yield identical estimates. However, 2SLS ignores cross-equation error correlations, leading to inefficient estimates. Three-Stage Least Squares (3SLS) addresses this by adding a third stage that accounts for these correlations, making it more efficient, especially when error terms are highly correlated. The Durban-Wu-Hausman test should always be used to confirm the presence of endogeneity.
π§ Quick Revision Questions
- Why is OLS biased when estimating a system of simultaneous equations with multiple endogenous variables?
- What is the fundamental goal of the first stage in 2SLS, and what property must the resulting proxy variable have?
- Mathematically, prove that ( \alpha_{1_{2SLS}} = \alpha_{1_{ILS}} ) for an exactly identified equation.
- What is the key limitation of 2SLS that 3SLS aims to overcome, and how does 3SLS achieve this?
- What Stata post-estimation command is used to test for endogeneity after running
ivregress, and what does a p-value less than 5% indicate?