Sample Conditions Under Which Bias in IV Estimates can be Signed

Haeil Jung, Maureen A. Pirog

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The relative size of the treated and untreated groups, or the T/UT ratio, in an analysis sample often diverges from the T/UT ratio in the population (or original sample) because of choice-based sampling and missing values. While divergences of the sample from the population T/UT ratio do not generate bias for many estimators, instrumental variable (IV) estimates might be biased by such divergences even when (1) the IV is analytically valid for the population and (2) the sample-treated and -untreated groups are representative of the population-treated and -untreated groups, respectively. We survey published empirical manuscripts to show that this issue is prevalent across various fields. We also prove that the bias in IV estimates, generated by divergences of the sample from population T/UT ratio, is a monotonic function of the difference between the sample and population T/UT ratios when the above conditions (1 and 2) are met. Based on our findings, we suggest possible solutions and provide advice on how to interpret the bias in IV estimates even when the true T/UT ratio is not known.

Original languageEnglish
Pages (from-to)909-932
Number of pages24
JournalJournal of Policy Analysis and Management
Volume36
Issue number4
DOIs
Publication statusPublished - 2017 Sep 1

Fingerprint

trend
divergence
Group
Instrumental variables
Divergence
Values

Keywords

  • C01
  • C13
  • C26

ASJC Scopus subject areas

  • Business, Management and Accounting(all)
  • Sociology and Political Science
  • Public Administration

Cite this

Sample Conditions Under Which Bias in IV Estimates can be Signed. / Jung, Haeil; Pirog, Maureen A.

In: Journal of Policy Analysis and Management, Vol. 36, No. 4, 01.09.2017, p. 909-932.

Research output: Contribution to journalArticle

@article{a0ea882a0087444c939d26dce158f189,
title = "Sample Conditions Under Which Bias in IV Estimates can be Signed",
abstract = "The relative size of the treated and untreated groups, or the T/UT ratio, in an analysis sample often diverges from the T/UT ratio in the population (or original sample) because of choice-based sampling and missing values. While divergences of the sample from the population T/UT ratio do not generate bias for many estimators, instrumental variable (IV) estimates might be biased by such divergences even when (1) the IV is analytically valid for the population and (2) the sample-treated and -untreated groups are representative of the population-treated and -untreated groups, respectively. We survey published empirical manuscripts to show that this issue is prevalent across various fields. We also prove that the bias in IV estimates, generated by divergences of the sample from population T/UT ratio, is a monotonic function of the difference between the sample and population T/UT ratios when the above conditions (1 and 2) are met. Based on our findings, we suggest possible solutions and provide advice on how to interpret the bias in IV estimates even when the true T/UT ratio is not known.",
keywords = "C01, C13, C26",
author = "Haeil Jung and Pirog, {Maureen A.}",
year = "2017",
month = "9",
day = "1",
doi = "10.1002/pam.21988",
language = "English",
volume = "36",
pages = "909--932",
journal = "Journal of Policy Analysis and Management",
issn = "0276-8739",
publisher = "Wiley-Liss Inc.",
number = "4",

}

TY - JOUR

T1 - Sample Conditions Under Which Bias in IV Estimates can be Signed

AU - Jung, Haeil

AU - Pirog, Maureen A.

PY - 2017/9/1

Y1 - 2017/9/1

N2 - The relative size of the treated and untreated groups, or the T/UT ratio, in an analysis sample often diverges from the T/UT ratio in the population (or original sample) because of choice-based sampling and missing values. While divergences of the sample from the population T/UT ratio do not generate bias for many estimators, instrumental variable (IV) estimates might be biased by such divergences even when (1) the IV is analytically valid for the population and (2) the sample-treated and -untreated groups are representative of the population-treated and -untreated groups, respectively. We survey published empirical manuscripts to show that this issue is prevalent across various fields. We also prove that the bias in IV estimates, generated by divergences of the sample from population T/UT ratio, is a monotonic function of the difference between the sample and population T/UT ratios when the above conditions (1 and 2) are met. Based on our findings, we suggest possible solutions and provide advice on how to interpret the bias in IV estimates even when the true T/UT ratio is not known.

AB - The relative size of the treated and untreated groups, or the T/UT ratio, in an analysis sample often diverges from the T/UT ratio in the population (or original sample) because of choice-based sampling and missing values. While divergences of the sample from the population T/UT ratio do not generate bias for many estimators, instrumental variable (IV) estimates might be biased by such divergences even when (1) the IV is analytically valid for the population and (2) the sample-treated and -untreated groups are representative of the population-treated and -untreated groups, respectively. We survey published empirical manuscripts to show that this issue is prevalent across various fields. We also prove that the bias in IV estimates, generated by divergences of the sample from population T/UT ratio, is a monotonic function of the difference between the sample and population T/UT ratios when the above conditions (1 and 2) are met. Based on our findings, we suggest possible solutions and provide advice on how to interpret the bias in IV estimates even when the true T/UT ratio is not known.

KW - C01

KW - C13

KW - C26

UR - http://www.scopus.com/inward/record.url?scp=85017500446&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017500446&partnerID=8YFLogxK

U2 - 10.1002/pam.21988

DO - 10.1002/pam.21988

M3 - Article

VL - 36

SP - 909

EP - 932

JO - Journal of Policy Analysis and Management

JF - Journal of Policy Analysis and Management

SN - 0276-8739

IS - 4

ER -