Jonathan D. Klingler - Research

Home About Research Teaching

My research uses text data to gain insight into the decision making of American political elites. I refine and train supervised machine learning models to measure political elites' psychological traits, fundamental economic preferences, and values from texts, such as the Congressional Record. This project has produced a book already in print. I also use unsupervised machine learning models to uncover the presentation strategies used by the White House to maintain the support of core supporters, as well as the issues on which presidential grassroots lobbying organizations focus as they engage in targeted appeals. I track variation in both over time to later test for their effects on the legislative agenda and the demographic composition of the presidential primary constituency. I supplement my text as data research by using survey data and causal inference methods to examine political socialization and the assumptions and implications of my core projects.

Measuring Elite Differences via Supervised Learning

I have published a book with the University of Chicago Press and another paper at PSRM which utilize supervised machine learning to process legislative text and generate measures of Big Five personality traits for members of the U.S. Congress, called ELUCIDATION scores. These publications are part of a larger collaborative project with Adam Ramey at NYU Abu Dhabi and Gary Hollibaugh at Notre Dame, which is focused on using supervised models to generate measures of elite personality traits, economic preferences, and values based on linguistic cues present in text data. The book, which was published in April 2017, describes the generation of ELUCIDATION scores and introduces a behavioral modeling framework for incorporating the Big Five personality traits, perhaps the most highly used typology of personality traits, into formal models. The book proceeds to revisit several aspects of congressional behavior, finding these traits have significant influence on legislative choices throughout the congressional lifespan. I have another paper under review which finds evidence that citizens reward legislators with `valence' personality profiles more than legislators who are similar to themselves, and a published and another working paper which test the implications of our modeling framework for Neuroticism and Openness to Experience, respectively.

The publication of the book has led me to turn my attention to training original text-based recognizers of traits, preferences, and values. ELUCIDATION scores are generated by processing the output of an existing text classifier to mitigate endogeneity concerns and add uncertainty estimates. My collaborators and I were awarded significant grants from the French ANR and NYU to train text-based recognizers of lower level facets within the Big Five construct, Moral Foundations Questionnaire scores, basic economic preferences through the Preference Survey Module, authoritarianism, the dark triad, and the Schwartz Values Survey. We also have begun digitizing 50 years of the Congressional Record so that the newly trained models may be used to generate estimates for elites reaching back to 1945. The survey instrument received IRB approval this summer, data collection will begin this fall, with early results appearing in winter 2018.

The collaboration has also extended to several other projects which are applying the ELUCIDATION algorithm to other elite actors. I have a paper under review with Ramey and Hollibaugh along with Matthew E.K. Hall at Notre Dame which applied ELUCIDATION to U.S. Supreme Court concurrences to generate SCIPE (prounounced similarly to `Skype') scores for Supreme Court justices. I am also working with a large group of collaborators to apply ELUCIDATION to municipal officials' public and semi-private speech and validate the resulting measures against Big Five estimates collected through traditional inventories. Over the long term, we plan to extend our recognizer training and generation of legislator estimates to as many languages as possible, starting with French and Arabic because of existing funding interest. Finally, given my own interests in the presidency, I plan to apply ELUCIDATION to presidential debate transcripts and validate them against existing expert classifications in Rubenzer and Faschingbauer (2005).

Measuring Elite Personality Using Speech with Gary Hollibaugh and Adam Ramey (forthcoming in Political Science Research and Methods).

Don't Know What You Got: A Bayesian Hierarchical Model of Neuroticism and Nonresponse with Gary Hollibaugh and Adam Ramey (forthcoming in Political Science Research and Methods).

What I Like About You: Legislator Personality and Legislator Approval with Gary Hollibaugh and Adam Ramey (revise and resubmit at Political Behavior).

Attributes Beyond Attitudes: Measuring Personality Traits on the Supreme Court with Matthew E.K. Hall, Adam Ramey, and Gary Hollibaugh (revise and resubmit at Political Analysis).

(Sympathy for) The Devil You Know? Openness, Risk Aversion, and the Incumbency Advantage with Adam Ramey and Gary Hollibaugh.

My presentation of the elite behavior in institutions project at Northwestern University's Kellogg School of Management for the Fifth Annual Text-as-Data Conference:



Uncovering Elite Strategies via Unsupervised Learning

My primary solo research interest focuses on understanding the president's communication with core supporters using unsupervised machine learning on text data. I have collected eight years of email text sent by President Obama's grassroots lobbying organization, OFA, to his primary constituency, and many months of email text sent by President Trump to his core supporters. I have analyzed this corpus using unsupervised machine learning techniques, particularly, the Topics over Time model, to uncover several strategies used by President Obama and his staff to emphasize common interest and trust with his base and measure variation in the mixture of these strategies used over time. I argue that these strategies should shift with economic conditions and political expectations, and themselves lead to change in the demographic makeup of a president's most fervent supporters. The collection of this corpus and comparable text data across multiple administrations and parties has required notable patience and investment, but with the 2017 presidential transition, the research agenda is well positioned now that comparisons may be made between the Obama and Trump administrations going forward.

Though presidential grassroots lobbying organizations (PGLOs) like OFA have existed for over a decade, they are understudied, and I have a working paper which describes OFA's use of email in the first seven years of the Obama administration and argues that the use of digital tools to 'go public' by presidents should be effective only among presidential copartisans in the public and Congress. I am currently revising this paper to include new data from the Trump administration, and I plan to build on this over the next few years with several other projects, leading into into a book on PGLOs. I have already been able to apply topic modeling using a high number of dimensions to my PGLO email dataset to develop measures of relative policy salience among the emails in this corpus, and I am writing a new working paper which tests for the influence of PGLO emails on the floor speech of presidential copartisan legislators. I also have a working paper with a corresponding formal model of primary-focused public appeals, and I plan to test of the effect of PGLO events on electoral outcomes using coarsened exact matching (CEM), which will contribute to rounding out the planned book on PGLOs' influence on elections and agenda control. Beyond this larger project on PGLOs, I plan to continue to study the maintenance of the presidential primary constituency as technology develops, and when appropriate, extend my work to the primary constituencies of other actors.

Primary Constituency Focused Presidential Communication.

Political Capital in the 21st Century: Presidential Grassroots Lobbying in the Obama Administration.

Causal Inference and Veterans' Political Attitudes

I also use survey data and causal inference methods to study the effects of military service on political attitudes, as volunteer veterans are highly over-represented among political elites but the extant data on this group has been poor. I have administered the Survey of American Veterans (SAVe) with Tyson Chatagnier at the University of Houston, and we applied CEM to these data to uncover treatment effects of military service on political attitudes in a paper currently under review. In a previously published article we found that veterans of the All Volunteer Force are generally more conservative than those who did not serve, but the CEM revealed that military service is associated only with more nationalism, not general conservatism. We administered a second wave of the SAVe this summer to further articulate and confirm this nationalist causal effect of service.

Are You Doing Your Part? Veterans' Political Attitudes and Heinlein's Conception of Citizenship at Armed Forces and Society with J. Tyson Chatagnier.

The Development of Political Attitudes and Behaviour Among Young Adults at the Australian Journal of Political Science with Richard G. Niemi.