Survey: Education, attitude matter when detecting fake headlines – news release

People with higher education levels and more positive attitudes about news can more easily spot fake headlines, according to a research report by the News Co/Lab at Arizona State University’s Walter Cronkite School of Journalism and Mass Communication in collaboration with the Center for Media Engagement at The University of Texas at Austin.

Their report, “How the Public, News Sources, and Journalists Think about News in Three Communities,” compiles and analyzes a series of online surveys of news consumers, news sources and newsrooms deployed during the course of the year.

In the headline exercise, a total of 4,854 community members from Fresno, Calif.; Kansas City, Mo., and Macon, Ga. were given three headlines tailored to each city. Two were real. One was fake. Participants were asked to identify the phony headline.

Overall, 61.6 percent of the survey-takers could correctly identify the fake headline. For people with college degrees, the success rate rose to 67.7 percent. But for those without college degrees, it fell to 56.7 percent.

Although those with more education were more likely to answer correctly, nearly a third — 32.3 percent — of those with a college degree or better could not identify the fake headline.

“This is both good and bad news,” said Eric Newton, News Co/Lab co-founder. “Good, because a general education seems to help protect a person against hoaxes. Bad, because a third of the college graduates were still fooled. This suggests a need for a greater focus on news fluency.”

Other groupings, such as age, income and political affiliation also produced different success rates, with seniors, those with lower incomes and Republicans less likely to detect fake news headlines. While 53.7 percent of those making less than $30,000 a year correctly identified the false headline, for example, 71.1 percent of those with incomes exceeding $150,000 a year did so.

“Overall, these findings show that more work needs to be done to help the public differentiate between what’s real and what’s not,” said Gina Masullo Chen, Ph.D., assistant director of the Center for Media Engagement. “We’re seeing a divide in news literacy among specific groups that may diminish their ability to fully understand what’s happening in the world. That’s a challenge for both the news media and for democracy.”

The research also linked a person’s attitude to an inability to spot fake headlines. In the attitude exercise, study participants were asked to identify the first word that came to mind when they saw the word “news.” Of those who answered the question, 61.9 percent of participants said a negative word, such as “fake,” or “untrustworthy,” while 38.1 percent of respondents provided a positive or neutral word, such as “information” or “factual.” (Attitudes broke along party lines: 74.0 percent of Republicans but only 26.0 percent of the Democrats used a negative word.)

A stark example of the impact of attitude came in Kansas City. There, 68.6 percent of those who used negative words the word “news” identified the fake news headline. But 81.8 percent of those who used positive or neutral words could spot the fake.

The public survey was supplemented by two others of community news sources and journalists from The Fresno Bee, The Kansas City Star and The Telegraph in Macon. This allowed comparisons about how all three groups rated the news organizations on a variety of measures, including accuracy, fairness, transparency and engagement.

In general, journalists rated themselves considerably higher than did news sources and members of the public. When asked how much they agreed that the local news organization “is fair in its reporting,” for example, 94.3 percent of journalists agreed or strongly agreed, 50.0 percent of news sources, and 17.8 percent of the public.

Though 75.3 percent of journalists surveyed agreed or strongly agreed that it is part of their news organization’s mission to help people understand how news works, only 28.4 percent of them agreed or strongly agreed that their news organization explains “who its journalists are and what they do.”

The full report can be found on the News Co/Lab’s website.

The News Co/Lab is a collaborative lab aimed at helping people find new ways of understanding and engaging with news and information. The Center for Media Engagement is dedicated to helping media organizations meet their business and democratic goals.