The following describes the survey methodology of the 2018 Post-Election Recontacts iteration of The Psychology Political Behavior Studies (PPBS). This report is meant to detail the utilized survey methodology and relevant, general purpose characteristics of both exploratory and confirmatory samples, as well as any extra samples and its combined version. The text is in APA Style and is akin to an APA-like ‘Methods Section’.
PPBS datasets are designed to have an exploratory, quota-based Nationally Representative sample (on Age, Education, Income and Sex), and a Confirmatory (Replication) convenience sample, from the same data source to avoid false positives. Some PPBS studies also have recontacts or extra-samples to answer additional specific research questions (e.g., 2nd Sample in 2016). All data’s coodbooks can be found at the bottom of the page, with a searchable feature allowing to find metadata within and between columns.
For more details, see PBBS’s Motivation.
| Sample 1 | Sample 1-B | |
|---|---|---|
| Election cycle | Recontacts of Post-Election 2018 | [Standalone] Post-Election 2018 |
| Type | Recontacts Convenience | [Standalone] Convenience |
| Survey Period (Start) | February 12th, 2019 | February 12th, 2019 |
| Survey Period (End) | March 13th, 2019 | March 13th, 2019 |
| Country | United States | United States |
| Attention Checks | Yes (13; various types) | Yes (13; various types) |
| Time Checks | Yes (11 page submit checks) | Yes (11 page submit checks) |
| CAPTCHA | Yes (begining of survey) | Yes (begining of survey) |
| Sample Size (N) | 792 | 803 |
| Length of Interview (MD) | 106.2 | 106.3 |
| Attrition (%) | 0.08 | 0.08 |
| Data Quality checks (%) | 0.09 | 0.09 |
| Note. As explained more thoroughly below (last paragraph), Sample 1 and Sample 1-B are equal except for 11 cases. |
In 2019, we re-hired Cint (www.cint.com), a survey research firm that recruits participants from a pool of over 13 million U.S. citizens, to recruit a recontacts sample of 792 Americans (69.95% women) from its panel who months prior had successfully completed the 2018 Psychology Political Behavior Studies (PPBS; from December 01 to February 26, 2019). The follow-up recontacts study took place in the first months of 2019 (from February 12 to March 13, 2019). The time difference between the two surveys ranged from 1 to 98 days (M = 51.52, SD = 20.21). All subjects in this sample participated successfully in both iterations of the PPBS (2018 Post-Election and Post-Election Recontacts).
In addition to administering a much greater number and variety of political and psychological instruments (including full scales) than in other nationally representative surveys (such as ANES, GSS, and WVS), we took a number of steps to insure that the quality of the data would be especially high. These included following professional recommendations to minimize problems of careless responding and satisficing behavior in online survey studies (Meade & Craig, 2012). Specifically, we employed 7 random attention questions, 5 page-time controls, and a Captcha Verification (or Completely Automated Public Turing Test to tell Computers and Humans Apart) question at the beginning of the survey.
We sent Cint a total of 6136 IDs from the 2018 Post-Election studies, of which 965 participants were directed to the survey (21.24%), and 889 of them finished the survey (attrition rate 8%). There were 86 (9%) participants who failed more than two attention checks or time-checks, or finished the survey in under ~22 minutes and were therefore excluded. Lastly, eleven participants were excluded from this sample because they had not successfully completed the initial study but successfully completed the recontacts phase. For the final sample of 792, participants who successfully completed all study materials had a completion time of 115.71 minutes on average (MD: 106.2min).
The age distribution of the sample was as follows: 18–24 years (0.88%), 25–34 (8.59%), 35–44 (15.15%), 45–54 (19.95%), 55–65 (21.09%), and older than 65 (34.34%). The ethnic breakdown was: White (80.93%), Black/African American (10.98%), Hispanic/Latino (3.28%), Asian/Pacific Islander (2.78%), Native American (0.63%), Middle Eastern (0%), and Other (1.39%). In terms of religion, (18.43% identified as Catholic, 51.14% as Protestant, 2.78% as Jewish,0.63% as Muslim, 15.4% as either Atheist or Agnostic, and 11.62% responded they are not sure or refused to answer. With respect to education, 3.28% declared their highest educational achievement to be less lower than high-school, 22.22% declared being High school graduates (including equivalencies), 34.22% indicated having Some college, no degree, and lastly, 40.28% indicated having received a Bachelor or Graduate degree. The median income category was $50,000 to $74,999. The exact distribution of Income is as follows: Less $15,000 (10.1%), $15,000 to $24,999 (11.36%), $25,000 to $34,999 (11.49%), $35,000 to $49,999 (14.77%), $50,000 to $74,999 (22.22%), $75,000 to $99,999 (12.37%), $100,000 to $149,999 (9.85%) and $150,000 more (7.83%).
In 2019, we re-hired Cint (www.cint.com), a survey research firm that recruits participants from a pool of over 13 million U.S. citizens, to recruit a recontacts sample of 803 Americans (70.36% women) from its panel who months prior had successfully completed the 2018 Psychology Political Behavior Studies (PPBS; from December 01 to February 26, 2019). The follow-up recontacts study took place in the months after the 2018 US Midterms Election (from February 12 to March 13, 2019). The time difference between the two surveys ranged from 15 to 2360 days (M = 1236.51, SD = 485.05), or between a little over 3 months to a little over 4 months. All subjects in this sample participated successfully in both iterations of the The Psychology Political Behavior Studies (PPBS).
In addition to administering a much greater number and variety of political and psychological instruments (including full scales) than in other nationally representative surveys (such as ANES, GSS, and WVS), we took a number of steps to insure that the quality of the data would be especially high. These included following professional recommendations to minimize problems of careless responding and satisficing behavior in online survey studies (Meade & Craig, 2012). Specifically, we employed 7 random attention questions, 5 page-time controls, and a Captcha Verification (or Completely Automated Public Turing Test to tell Computers and Humans Apart) question at the beginning of the survey.
We sent Cint a total of 3728 IDs from the 2018 Post-Election studies, of which 965 participants were directed to the survey (21.54%), and 889 of them finished the survey (attrition rate 8%). There were 86 (9%) participants who failed more than two attention checks or time-checks or finished the survey in under ~22 minutes and were therefore excluded. For the final sample of 803 participants who successfully completed all study materials had a completion time of 116.01 minutes on average (MD: 106.25min).
The sample distributions below mirror perfectly that of the recontacts samples because the Recontacts survey instrument did not ask the same demographic questions again. So the below demographic distributions refer to only 609 out of 622 participants.
The age distribution of our sample was as follows: 18–24 years (0.88%), 25–34 (8.59%), 35–44 (15.15%), 45–54 (19.95%), 55–65 (21.09%), and older than 65 (34.34%). The ethnic breakdown was: White (80.93%), Black/African American (10.98%), Hispanic/Latino (3.28%), Asian/Pacific Islander (2.78%), Native American (0.63%), Middle Eastern (0%), and Other (1.39%). In terms of religion, (18.43% identified as Catholic, 51.14% as Protestant, 2.78% as Jewish,0.63% as Muslim, 15.4% as either Atheist or Agnostic, and 11.62% responded they are not sure or refused to answer. With respect to education, 3.28% declared their highest educational achievement to be less lower than high-school, 22.22% declared being High school graduates (including equivalencies), 34.22% indicated having Some college, no degree, and lastly, 40.28% indicated having received a Bachelor or Graduate degree. The median income category was $50,000 to $74,999. The exact distribution of Income is as follows: Less $15,000 (10.1%), $15,000 to $24,999 (11.36%), $25,000 to $34,999 (11.49%), $35,000 to $49,999 (14.77%), $50,000 to $74,999 (22.22%), $75,000 to $99,999 (12.37%), $100,000 to $149,999 (9.85%) and $150,000 more (7.83%).
In sum, the difference between this Standalone sample (N=622) and the Recontacts sample (N=609) boils down to the 13 extra cases which have finished the Recontacts survey successfully but did not participate in the original PPBS Post-Election survey. We do not know how (or why) these participants arrived at the survey. Normally only the IDs we sent over should be invited but then again 13 out 3728 IDs (0.3%) is not a bad margin). Importantly, we didn’t exclude these 13 participants and present it as a ‘standalone’ sample because (a) these participants were paid for; (b) excluding or neglecting participants based on ‘convenience’ isn’t exactly methodologically sound; and (c) it may also be unethical to do so.
Search box on the right finds items in all columns. Search boxes at the column level finds matches in their specific column.