Thursday, March 22, 2018

Generational changes in support for gun laws

This is the fourth article in a series about changes in support for gun control laws over the last 50 years.

In the first article I looked at data from the General Social Survey and found that young adults are less likely than previous generations to support gun control.

In the second article I looked at data from the CIRP Freshman Survey and found that even the youngest adults, who grew up with lockdown drills and graphic news coverage of school shootings, are LESS likely to support strict gun control laws.

In the third article, I ran graphical tests to distinguish age, period, and cohort effects.  I found strong evidence for a period effect: support for gun control among all groups increased during the 1980s and 90s, and has been falling in all groups since 2000.  I also saw some evidence of a cohort effect: people born in the 1980s and 90s are less likely to support strict gun control laws.

In this article, I dive deeper, using logistic regression to estimate the sizes of these effects separately, while controlling for demographic factors like sex, race, urban or rural residence, etc.


Variables

As in the previous articles, I am using data from the General Social Survey (GSS), and in particular the variable 'gunlaw', which records responses to the question:
Would you favor or oppose a law which would require a person to obtain a police permit before he or she could buy a gun?
I characterize respondents who answer "favor" to be more likely to support strict gun control laws.

The explanatory factors I consider are:

'nineties', 'eighties', 'seventies', 'fifties', 'forties', 'thirties', 'twenties':  These variables encode the respondents decade of birth.

'female': indicates that the respondent is female.

'black': indicates that the respondent is black.

'otherrace': indicates that the respondent is neither white nor black (most people in this category are mixed race).

'hispanic': indicates that the respondent is Hispanic.

'conservative', 'liberal': indicates that the respondent reports being conservative or liberal (not moderate).

'lowrealinc', 'highrealinc': indicates that the respondent's household income is in the bottom or top 25%, based on self-report, converted to constant dollars.

'college': indicates whether the respondent attended any college.

'urban', 'rural': indicates whether the respondent lives in an urban or rural area (not suburban).


'gunhome': indicates whether the respondent reports that they "
have in [their] home or garage any guns or revolvers".


'threatened': indicates whether the respondent reports that they have "ever been threatened with a gun, or shot at". 

These factors are all binary.  In addition, I also estimate the period effect by including the following  variables: 'yminus10', 'yminus20', 'yminus30', and 'yminus40', to indicate respondents surveyed 10, 20, 30, and 40 years prior to 2016. 


Results

I used logistic regression to estimate the effect of each of these variables.  The regression also includes a cubic model of time, intended to capture the period effect.  You can see the period effect in the following figure, which shows actual changes in support for a gun permit law over the history of the GSS (in gray) and the retroactive predictions of the model (in red).



To present the results in an interpretable form, I define a collection of hypothetical people with different attributes and estimate the probability that each one would favor a gun permit law.

As a baseline, I start with a white, non-Hispanic male born in the 1960s who is politically moderate, in the middle 50% of the income range, who attended college, lives in a suburb, has never been threatened with a gun or shot at, and does not have a gun at home.  People like that interviewed in 2016 have a 74% chance of favoring "a law which would require a person to obtain a police permit before he or she could buy a gun".

The following table shows results for people with different attributes: the first row, which is labeled 'baseline' is the baseline person from the previous paragraph; the second row, labeled 'nineties', is identical to the baseline in every way, except born in the 1990s rather than the 1960s.  The line labeled 'female' is identical to the baseline, but female.

These results are generated by running 201 random samples from the GSS data and computing the median, 2.5th and 97.5th percentiles.  The range from 'low2.5' to 'high97.5' forms a 95% confidence interval.

low2.5 median high97.5
baseline 71.5 73.6 75.1
nineties 60.1 63.8 68.5
eighties 64.9 67.7 69.8
seventies 67.8 70.1 72.0
fifties 70.7 72.8 74.8
forties 71.4 73.7 75.4
thirties 69.9 72.0 73.8
twenties 70.7 72.9 74.8
female 83.2 84.7 85.6
black 75.9 78.0 79.5
otherrace 78.2 80.4 82.9
hispanic 70.7 73.5 76.0
conservative 64.1 65.8 67.8
liberal 75.9 77.7 79.3
lowrealinc 69.1 71.1 72.9
highrealinc 73.2 75.2 76.7
college 73.2 75.1 76.3
urban 66.0 68.3 69.9
rural 59.5 62.0 64.0
threatened 68.8 71.1 73.1
gunhome 51.1 53.6 55.8
yminus10 84.1 85.3 86.2
yminus20 84.3 85.3 86.4
yminus30 80.7 81.5 82.8
yminus40 78.8 79.9 81.4
lowest combo 16.5 19.2 22.1
highest combo 91.3 92.3 93.4



Again, the hypothetical baseline person has a 74% chance of favoring a gun permit law.  A nearly identical person born in the 1990s has only a 64% chance.

To see this and the other effects more clearly, I computed the difference between each hypothetical person and the baseline, then sorted by the magnitude of the apparent effect. 

low2.5 median high97.5
lowest combo -57.7 -54.5 -49.5
gunhome -21.1 -20.0 -18.6
rural -13.4 -11.5 -9.9
nineties -13.5 -9.8 -4.5
conservative -8.9 -7.6 -6.5
eighties -7.9 -5.9 -2.7
urban -6.6 -5.4 -4.1
seventies -5.6 -3.2 -1.4
lowrealinc -3.7 -2.5 -1.2
threatened -3.6 -2.4 -1.1
thirties -3.2 -1.5 -0.1
fifties -2.2 -0.8 0.8
twenties -2.8 -0.6 1.0
forties -1.7 -0.0 1.5
baseline 0.0 0.0 0.0
hispanic -1.5 0.2 2.0
college 0.6 1.6 2.6
highrealinc 0.7 1.7 2.6
liberal 2.9 4.2 5.2
black 3.1 4.5 5.8
yminus40 4.9 6.6 8.0
otherrace 4.8 6.9 9.6
yminus30 6.6 8.1 9.8
female 10.1 11.1 12.4
yminus20 10.2 11.7 14.0
yminus10 10.1 11.7 13.7
highest combo 16.9 18.8 21.1



All else being equal, someone who owns a gun is about 20 percentage points less likely to favor gun permit laws.

Compared to people born in the 1960s, people born in the 1990s are 10 points less likely.  People born in the 1980s and 1970s are also less likely, by 6 and 3 points.  People born in previous generations are not substantially different from people born in the 1960s (and the effect is not statistically significant).

Compared to suburbanites, people in rural and urban communities are less likely, by 12 and 5 points.

People in the lowest 25% of household income are less likely by 2.5 points; people in the highest 25% are more likely by 2 percentage point.

Blacks and other non-whites are more likely to favor gun permit laws, by 4.5 and 7 percentage points.

Compared to political moderates, conservatives are 8 points less likely and liberals are 4 points more likely to favor gun permit laws.

Compared to men, women are 11 points more likely to favor gun permit laws.

Controlling for all of these factors, the period effect persists: people with the same attributes surveyed 10, 20, 30, and 40 years ago would have been 10, 10, 7, and 5 points more likely to favor gun permit laws.

In these results, Hispanics are not significantly different from non-Hispanic whites.  But because of the way the GSS asked about Hispanic background, this variable is missing a lot of data; these results might not mean much.

Surprisingly, people who report that they have been "threatened with a gun or shot at" are 2 percentage points LESS likely to favor gun permit laws.  This effect is small but statistically significant, and it is consistent in many versions of the model.  A possible explanation is that this variable captures information about the respondent's relationship with guns that is not captured by other variables.  For example, if a respondent does not have a gun at home, but spends time around people who do, they might be more likely to have been threatened and also more likely to share cultural values with gun owners.  Alternatively, since this question was only asked until 1996, it's possible that it is capturing a period effect, at least in part.

"Lowest combo" represents a hypothetical person with all attributes associated with lower support for gun laws: a white conservative male born in the 1990s, living in a rural area, with household income in the lowest 25%, who has not attended college, who owns a gun, and has been threatened with a gun or shot at.  Such a person has a 19% change of favoring a gun permit law, 54 points lower than the baseline.

"Highest combo" represents a hypothetical person with all attributes associated with higher support for gun laws: a mixed race liberal woman born in the 1960s or before, living in a suburb, with household income in the highest 25%, who has attended college, does not own a gun, and has not been threatened with one.  Such a person has a 92% chance of favoring a gun permit law, 19 points higher than the baseline.

[You might be surprised that these results as asymmetric: that is, that the lowest combo is farther from the baseline than the highest combo.  The reason is that the "distance" between probabilities is not linear.  For more about that, see my previous article on the challenges of interpreting probablistic predictions].



Methodology

The entire analysis in this Jupyter notebook.  The steps are:

1) Load the subset of GSS data I selected, which you can download here.

2) For each year of the survey, use weighted bootstrap to select a random sample that accounts for the stratified sampling in the GSS design.

3) Fill missing values in each column by drawing random samples from the valid responses.

4) Convert some numerical and categorical variables to boolean; for example 'conservative' and 'liberal' are based on the categorical variable 'polviews'; and 'lowrealinc' and 'highrealinc' are based on the numerical variable 'realinc'.

5) Use logistic regression to estimate model parameters, which are in terms of log odds.

6) Use the model to make predictions for each of the hypothetical people in the tables, in terms of probabilities.

7) Compute the predicted difference between each hypothetical person and the baseline.

By repeating steps (2) through (7) about 200 times, we get a distribution of estimates that accounts for uncertainty due to random sampling and missing values.  From these distributions, we can select the median and a 95% confidence interval, as reported in the tables above.   

3 comments:

  1. I'm having a little trouble connecting the dots between your comment "people born in the 1990s are 10 points less likely" and the ipynb that shows the coefficient for "twenties" as -0.0236 at Out[98] which eventually resulted in an offset of -0.473421 at Out[103]. I know you re-sampled to get to the confidence intervals, but it also seems odd that the twenties interval was about as wide as the other ages despite having a z score of -0.531 in the original regression and the thinnest base at about 500 respondents.

    Regardless of my slow understanding of this, I also worry that the GSS is not a good way to measure the political trends of all ages. Yougov or Google search trends may have less bias because they are not administered or done in-person, in private with less social norm pressure.

    ReplyDelete
  2. The cells you are looking at are a single run, so they'll be different every time the notebook runs. The coefficient in Out[98] is a log odds ratio. The offset in Out[103] is a difference in percentage points. The median of that difference is -9.8 percentage points, as shown in Out[108].

    ReplyDelete
  3. Thank you for the clarification - I misinterpreted twenties as the age, instead of the decade of birth.

    ReplyDelete