Abstract
Americans are increasingly turning to social media for political information. However, given that the average social media user only clicks through on a small fraction of the political content available, the brief article previews that appear in the News Feed likely serve as shortcuts to political information. Yet, in addition to sharing political news, social media also allow users to make their own comments on news posts, comments which may challenge or distort the information contained in the articles. In this paper, we first analyze how social media posts on Twitter and Facebook differ from the actual content of their linked news articles, finding that social media comments regularly misrepresent the facts reported in the news. We then use a survey experiment to test the consequences of these information discrepancies. Specifically, we randomly assign individuals to read a full news article, a news article preview post (as seen on Facebook), or a news article preview with misinformative social commentary attached. We find that individuals in the social commentary conditions are more misinformed about the featured topic, tending to report the factually-incorrect information relayed in the comments rather than the factually-correct information embedded within the article preview.
Similar content being viewed by others
Notes
Trump’s tweet was made on March 11, 2018. The most recent Rasmussen poll before that date was released on March 9, 2018, and showed Trump’s approval rating to be 44%.
Crimson Hexagon (https://www.crimsonhexagon.com/) is a data vendor allowing subscribers to access data from Twitter, Facebook, Instagram, Blogs, Forums, News, Comments, Reviews, YouTube, and other sources. Crimson Hexagon provides access to over 1 trillion social media posts going back to 2008. The platform provides sentiment scores using its proprietary algorithms and allows users to extract random samples of the posts.
The full text of the articles is available in the Online Appendix.
In the full article condition, this was phrased as the person who “wrote” the article.
Choices included 15%, 23%, 36%, 49%, and a “Don’t know” option. The Yahoo! News article and its preview reported that Trump’s approval rating was 36% at the time, while the liberal and conservative commentaries suggested that his approval rating was actually 23 or 49%, respectively.
Choices included “Sampled more Democrats,” “Sample more Republicans,” “Inaccurate during the 2016 election,” “Funded by liberals,” and a “Don’t know” option. The Yahoo! News article reported Trump’s claims that the poll was inaccurate during the 2016 election, while the liberal and conservative commentaries suggested that the poll sampled more Republicans or Democrats, respectively. The article preview did not include any information about survey flaws.
Because H4 is concerned only in the relationship whether partisan motivated reasoning explains belief in misinformation, H4’s analysis is limited to only those assigned to the misinformative experimental conditions.
Petty and Cacioppo’s (1981, 1986) Elaboration Likelihood Model considers two routes to persuasion: a central route in which individuals thoughtfully examine new pieces of information, and a peripheral route in which persuasion occurs as the result of some heuristic (e.g., a source cue) rather than careful consideration. Because individuals motivated by a need for cognition may be more likely to scrutinize competing pieces of information than those motivated by a need for affect (see Arceneaux and Vander Wielen 2017), we include measures for both NFC (Cacioppo et al. 1984) and for NFA (Maio and Esses 2001) as control variables in our analyses. We also include measures of political knowledge (measured using five factual questions about politics), age, gender, race, education, income, and party (with higher values indicating identification with the Republican party). The full survey and balance tests can be found in the Online Appendix.
References
Allcott, H., & Gentzkow, M. (2017). Social media and fake news in the 2016 election. Journal of Economic Perspectives, 31(2), 211–236.
American Press Institute. (2014). The personal news cycle. Media Insight Project. Retrieved March 17, 2014, from https://www.americanpressinstitute.org/publications/reports/survey-research/how-americans-get-news/.
Anspach, N. M. (2017). The new personal influence: How our Facebook friends influence the news we read. Political Communication, 34(4), 590–606.
Anspach, N. M., Jennings, J. T., & Arceneaux, K. (2018). A little bit of knowledge: Facebook’s News Feed and self-perceptions of knowledge. In Presented at the 2017 midwest political science association conference.
Arceneaux, K., & Johnson, M. (2013). Changing minds or changing channels? Partisan news in an age of choice. Chicago: University of Chicago Press.
Arceneaux, K., & Vander Wielen, R. J. (2017). Taming intuition: How reflection minimizes partisan reasoning and promotes democratic accountability. New York: Cambridge University Press.
Bakshy, E., Messing, S., & Adamic, L. (2015). Exposure to ideologically diverse news and opinion on Facebook. Science, 348(6239), 1130–1132. https://doi.org/10.1126/science.aaa1160.
Bartels, L. M. (2002). Beyond the running tally: Partisan bias in political perceptions. Political Behavior, 24(2), 117–150.
Barthel, M., Mitchell, A., & Holcomb, J. (2016). Many Americans believe fake news is sowing confusion. Pew Research Center. Retrieved December 15, 2016, from http://www.journalism.org/2016/12/15/many-americans-believe-fake-news-is-sowing-confusion/.
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012). Evaluating online labor markets for experimental research: Amazon.com’s mechanical turk. Political Analysis, 20(3), 351–368.
Bernstein, M.S., Bakshy, E., Burke, M., & Karrer, B. (2013). Quantifying the invisible audience in social networks. In CHI’13 (pp. 21–30).
Bialik, K., & Matsa, K. E. (2017). Key trends in social and digital news media. Pew Research Center. Retrieved October 4, 2017, from http://www.pewresearch.org/fact-tank/2017/10/04/key-trends-in-social-and-digital-news-media/.
Bode, L. (2016). Political news in the news feed: Learning politics from social media. Mass Communication and Society, 19(1), 24–48.
Brundidge, J. (2010). Encountering “difference” in the contemporary public sphere: The contribution of the Internet to the heterogeneity of political discussion networks. Journal of Communication, 60(4), 680–700.
Budak, C., Goel, S., & Rao, J. M. (2016). Fair and balanced? Quantifying media bias through crowdsourced content analysis. Public Opinion Quarterly, 80(1), 250–271.
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6(1), 3–5.
Cacioppo, J. T., Petty, R. E., & Kao, C. F. (1984). The efficient assessment of need for cognition. Journal of Personal Assessment, 48(3), 306–307.
Carlson, T. N. (2018). Modeling political information transmission as a game of telephone. Journal of Politics, 80(1), 348–352.
Chaiken, S. (1987). The heuristic model of persuasion. In M. P. Zanna, J. M. Olsen, & C. P. Herman (Eds.), Social influence: The Ontario symposium (Vol. 5, pp. 3–39). Hillsdale, NJ: Erlbaum.
Conover, M., Ratkiewicz, J., Francisco, M. R., Goncalves, B., Menczer, F., & Flammini, A. (2011). Political polarization on Twitter. ICWSM, 133, 89–96.
DeMarzo, P. M., Vayanos, D., & Zwiebel, J. (2003). Persuasion bias, social influence, and unidimensional opinions. Quarterly Journal of Economics, 118(3), 909–968.
Downs, A. (1957). An economic theory of democracy. New York: Harper and Row.
Enke, B., & Zimmermann, F. (2017). Correlation neglect in belief formation. The Review of Economic Studies. https://doi.org/10.1093/restud/rdx081.
Erisen, C., Redlawsk, D. P., & Erisen, E. (2017). Complex thinking as a result of incongruent information exposure. American Politics Research, 46(2), 217–245.
Eyster, E., & Rabin, M. (2010). Naïve herding in rich-information settings. American Economic Journal: Microeconomics, 2(4), 221–243.
Feezell, J. T. (2017). Agenda setting through social media: The importance of incidental news exposure and social filtering in the digital era. Political Research Quarterly, 71, 482–494.
Fiorina, M. P. (1981). Retrospective voting in American national elections. American Journal of Political Science, 22(2), 426–443.
Fletcher, R., & Nielsen, R. K. (2017). Are news audiences increasingly fragmented? A cross-national comparative analysis of cross-platform news audience fragmentation and duplication. Journal of Communication, 67, 476–498.
Gallup, Inc., and the Knight Foundation. (2018). American views: Trust, media, and democracy. Retrieved January 16, 2018, from https://kf-site-production.s3.amazonaws.com/publications/pdfs/000/000/242/original/KnightFoundation_AmericansViews_Client_Report_010917_Final_Updated.pdf.
Garrett, R. K., Weeks, B. E., & Neo, R. L. (2016). Driving a wedge between evidence and beliefs: How online ideological news exposure promotes political misperceptions. Journal of Computer-Mediated Communication, 21(5), 331–348.
Hilligoss, B., & Rieh, S. Y. (2008). Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context. Information Processing and Management, 44(4), 1467–1484.
Hochschild, J. L. (2001). Where you stand depends on what you see: Connections among values, perceptions of fact, and political prescriptions. In James Kuklinski (Ed.), Citizens and politics: Perspectives from political psychology. New York: Cambridge University Press.
Jerit, J., & Barabas, J. (2012). Partisan perceptual bias and the information environment. The Journal of Politics, 74(3), 672–684.
Karnowski, V., Kumpel, A. S., Leonhard, L., & Leiner, D. J. (2017). From incidental news exposure to news engagement. How perceptions of the news post and news usage patterns influence engagement with news articles encountered on Facebook. Computers in Human Behavior, 76, 42–50.
Katz, E., & Lazarsfeld, P. F. (1955). Personal influence: The part played by people in the flow of mass communications. New York: Free Press.
Kim, Y., Hsu, S., & Gil de Zuniga, H. (2013). Influence of social media use on discussion network heterogeneity and civic engagement: The moderating role of personality traits. Journal of Communication, 63, 498–516.
Krupnikov, Y., & Levine, A. S. (2014). Cross-sample comparisons and external validity. Journal of Experimental Political Science, 1(1), 59–80.
Kuklinski, J. H., Quirk, P. J., Jerit, J., Schwieder, D., & Rich, R. F. (2002). Misinformation and the currency of democratic citizenship. The Journal of Politics, 62(3), 790–816.
Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108(3), 480.
Lau, R. R., & Redlawsk, D. P. (1997). Voting correctly. American Political Science Review, 91(3), 585–598.
Lau, R. R., & Redlawsk, D. P. (2001). Advantages and disadvantages of cognitive heuristics in political decision making. American Journal of Political Science, 45(4), 951–971.
Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., et al. (2018). The science of fake news. Science, 359(6380), 1094–1096.
Levendusky, M. (2013). How partisan media polarize America. Chicago: University of Chicago Press.
Lord, C. G., Ross, L., & Lepper, M. R. (1979). Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence. Journal of Personality and Social Psychology, 37(11), 2098–2109.
Lupia, A., & McCubbins, M. D. (1998). The democratic dilemma: Can citizens learn what they need to know?. New York: Cambridge University Press.
Maio, G. R., & Esses, V. M. (2001). The need for affect: individual differences in the motivation to approach or avoid emotions. Journal of Psychology, 69(4), 583–614.
Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon’s mechanical turk. Behavior Research Methods, 44(1), 1–23.
Messing, S., & Westwood, S. J. (2014). Selective exposure in the age of social media: Endorsements trump partisan source affiliation when selecting news online. Communication Research, 20(10), 1042–1063.
Metzger, M. J., Flanagin, A. J., & Medders, R. B. (2010). Social and heuristic approaches to credibility evaluation online. Journal of Communication, 60(3), 413–439.
Mitchell, A., Gottfried, J., Barthel, M., & Shearer, E. (2016). The modern news consumer: News attitudes and practices in the digital era. Pew Research Center. Retrieved July 7, 2016, from, http://www.journalism.org/2016/07/07/the-modern-news-consumer/.
Muirhead, R. (2013). The case for party loyalty. Nomos, 54, 229–256.
Mutz, D. C. (1998). Impersonal influence: How perceptions of mass collectives affect political attitudes. New York: Cambridge University Press.
Mutz, D. C. (2006). Hearing the other side: Deliberative versus participatory democracy. New York: Cambridge University Press.
Nyhan, B., & Reifler, J. (2010). When corrections fail: The persistence of political misperceptions. Political Behavior, 32(2), 303–330.
Oeldorf-Hirsch, A. (2017). The role of engagement in learning from active and incidental news exposure on social media. Mass Communication and Society, 21(2), 225–247.
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010). Running experiments on Amazon mechanical turk. Judgment and Decision Making, 5(5), 411–419.
Pasek, J., Sood, G., & Krosnick, J. A. (2015). Misinformed about the affordable care act? Leveraging certainty to assess the prevalence of misperceptions. Journal of Communication, 65(4), 660–673.
Petty, R., & Cacioppo, J. T. (1981). Attitudes and persuasion: Classic and contemporary approaches. Dubueque: William C. Brown.
Petty, R., & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion. Advances in Experimental Social Psychology, 19, 123–205.
Pirolli, P. (2005). Rational analyses of information foraging on the web. Cognitive Science, 29(3), 343–373.
Popkin, S. L. (1994). The reasoning voter: Communication and persuasion in presidential campaigns. Chicago: University of Chicago Press.
Prior, M. (2005). News vs. entertainment: How increasing media choice widens gaps in political knowledge and turnout. American Journal of Political Science, 49(3), 577–592.
Prior, M. (2007). Post-broadcast democracy: How media choice increase inequality in political involvement and polarizes elections. New York: Cambridge University Press.
Redlawsk, D. P. (2002). Hot cognition or cool consideration? Testing the effects of motivated reasoning on political decision making. Journal of Politics, 64(4), 1021–1044.
Ryan, J. B. (2011). Accuracy and bias in perceptions of political knowledge. Political Behavior, 33(2), 335–356.
Settle, J. (2018). Frenemies: How social media polarizes America. New York: Cambridge University Press.
Shapiro, R. Y., & Bloch-Elkon, Y. (2008). Do the facts speak for themselves? Partisan disagreement as a challenge to democratic competence. Critical Review, 20(1–2), 115–139.
Shearer, E., & Gottfried, J. (2017). News use across social media platforms 2017. Pew Research Center: Journalism & Media. Retrieved September 7, 2017, from http://www.journalism.org/2017/09/07/news-use-across-social-media-platforms-2017/.
Shin, J., Jian, L., Driscoll, K., & Bar, F. (2017). Political rumoring on Twitter during the 2012 US presidential election: Rumor diffusion and correction. New Media & Society, 19(8), 1214–1235.
Sides, J., & Vavreck, L. (2012). The gamble: The hand you’re dealt with. Princeton: Princeton University Press.
Stroud, N. (2011). Niche news: The politics of news choice. New York: Oxford.
Sundar, S. S. (2008). The MAIN model: A heuristic approach to understanding technology effects on credibility. In M. Metzger & A. Flanagin (Eds.), Digital media, youth, and credibility (pp. 73–100). Cambridge: MIT Press.
Taber, C. S., & Lodge, M. (2006). Motivated skepticism in the evaluation of political beliefs. American Journal of Political Science, 50(3), 755–769.
Turcotte, J., York, C., Irving, J., Scholl, R. M., & Pingree, R. J. (2015). News recommendations from social media opinion leaders: Effects on media trust and information seeking. Journal of Computer-Mediated Communication, 20(5), 520–535.
Valeriani, A., & Vaccari, C. (2016). Accidental exposure to politics on social media as online participation equalizer in Germany, Italy, and the United Kingdom. New Media & Society, 18(9), 1857–1874.
Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146–1151.
Weeks, B. E., Ardèvol-Abreu, A., & de Zúñiga, H. G. (2017). Online influence? Social media use, opinion leadership, and political persuasion. International Journal of Public Opinion Research, 29(2), 214–239.
Zaller, J. (1992). The nature and origins of mass opinion. New York: Cambridge University Press.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Anspach, N.M., Carlson, T.N. What to Believe? Social Media Commentary and Belief in Misinformation. Polit Behav 42, 697–718 (2020). https://doi.org/10.1007/s11109-018-9515-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11109-018-9515-z