Questions tagged [survey-weights]
survey weights are used when data are collected according to a probability sampling design with unequal probabilities of selection and/or response
217
questions
19
votes
2
answers
6k
views
Two worlds collide: Using ML for complex survey data
I am struck with seemingly easy problem, but I haven't found a suitable solution for several weeks now.
I have quite a lot of poll/survey data (tens of thousands of respondents, say 50k per dataset), ...
- 658
11
votes
4
answers
6k
views
Using post-stratification weights in R survey package
I am analyzing a dataset that has a variable for post-stratification weights. As this is a complex survey, the plan is to use the R survey package. I have been ...
- 141
10
votes
5
answers
7k
views
What is calibration?
What does it mean to calibrate survey weights?
Also, what are other definitions of calibration in statistics? I have heard it used in several contexts, particularly risk prediction (referring to ...
- 63.7k
9
votes
3
answers
4k
views
Recommend references on survey sample weighting
Let's aim for some at an introductory level, some articles and some textbooks. Applied is more helpful, including R code is great. Thanks!
8
votes
1
answer
748
views
In propensity score analysis, what are options to deal with very small or large propensities?
$\newcommand{\P}{\mathbb{P}}$I am concerned with observational data in which the treatment assignment can be explained exceedingly well. For example, a logistic regression of
$$\P(A =1 |X) = (1+ \...
- 6,624
8
votes
1
answer
874
views
Variables for post-stratification weights?
What justifies the usage of a variable for post-stratification?
I am working with a constituent survey of a non-profit's constituent with 2500 responses out of a much larger sample and even larger ...
- 666
7
votes
2
answers
2k
views
How to estimate the (approximate) variance of the weighted mean?
Background: weighted mean
In the context of survey statistics it so happens that a sample of respondents from a survey are fit some weights to adjust their answers to the general population. These ...
- 21.8k
7
votes
1
answer
1k
views
How can I use Propensity Scores to adjust for survey non-response bias?
Say I estimate the probability that each member of my target population responds to a survey using propensity scores. I am having a hard time finding a clear explanation of how I can use the ...
- 497
7
votes
0
answers
89
views
Defining quantiles for complex survey samples
I am looking to accumulate a comprehensive list of definitions for quantiles under complex sampling that have been published or implemented in software. I'm not worrying about the separate problem of ...
- 41.6k
7
votes
0
answers
7k
views
When to use longitudinal (panel) weights vs cross-section weights in complex surveys
I'm currently working with a longitudinal dataset, the Kauffman Firm Survey.
The survey tracks about 5000 firms starting from 2004 - 2009. Firms die out over the years.
It has both cross-sectional ...
- 285
6
votes
2
answers
292
views
Variance estimation for regression coefficients with complex survey data
I would like to explain to one of my professors why the regular methods for variance estimation are biased for complex survey data, but I am having some trouble articulating my point.
With weighted ...
- 208
6
votes
1
answer
595
views
Stratified survey calculations by hand and with survey package don't agree. Simulation results
Bounty info: I originally emailed Thomas Lumley at an old email address. He did respond to an email to his new address.
Note: Long post (lots of code)
I can’t seem to replicate the results of the <...
- 1,138
6
votes
2
answers
1k
views
Replicate weights and the Current Population Survey
The Current Population Survey’s Annual Social and Economic Supplement (abbreviated, oddly, as ASEC) is the USA’s longest running and most detailed annual survey of income and employment. Along with ...
- 3,157
6
votes
1
answer
2k
views
Are sampling weights necessary in logistic regression?
When should I use weights when performing a logistic regression? The weights I'm referring to are sampling weights from a survey? Or should I just use the unweighted data?
- 619
5
votes
1
answer
167
views
Why does the survey package in R and SPSS complex samples add-on give different standard errors?
I was comparing results that I generated in R for complex survey analysis using the survey package to results from SPSS using the complex samples analysis add-on. The sample size is large ~ N=5500
...
- 477