Algorithmic or Human Source? Examining Relative Hostile Media Effect With a Transformer-Based Framework

Open Access Journal | ISSN: 2183-2439

Article | Open Access

Algorithmic or Human Source? Examining Relative Hostile Media Effect With a Transformer-Based Framework

  • Chenyan Jia Moody College of Communication, The University of Texas at Austin, USA
  • Ruibo Liu Department of Computer Science, Dartmouth College, USA

Full Text   PDF (free download)
Views: 734 | Downloads: 375

Abstract:  The relative hostile media effect suggests that partisans tend to perceive the bias of slanted news differently depending on whether the news is slanted in favor of or against their sides. To explore the effect of an algorithmic vs. human source on hostile media perceptions, this study conducts a 3 (author attribution: human, algorithm, or human-assisted algorithm) x 3 (news attitude: pro-issue, neutral, or anti-issue) mixed factorial design online experiment (N = 511). This study uses a transformer-based adversarial network to auto-generate comparable news headlines. The framework was trained with a dataset of 364,986 news stories from 22 mainstream media outlets. The results show that the relative hostile media effect occurs when people read news headlines attributed to all types of authors. News attributed to a sole human source is perceived as more credible than news attributed to two algorithm-related sources. For anti-Trump news headlines, there exists an interaction effect between author attribution and issue partisanship while controlling for people’s prior belief in machine heuristics. The difference of hostile media perceptions between the two partisan groups was relatively larger in anti-Trump news headlines compared with pro-Trump news headlines.

Keywords:  algorithms; automated journalism; computational method; hostile media effect; source credibility



© Chenyan Jia, Ruibo Liu. This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 license (, which permits any use, distribution, and reproduction of the work without further permission provided the original author(s) and source are credited.