Softening online extremes using network engineering

IEEE Access

The prevalence of dangerous misinformation and extreme views online has intensified since the onset of Israel-Hamas war on 7 October 2023. Social media platforms have long grappled with the challenge of providing effective mitigation schemes that can scale to the 5 billion-strong online population. Here, we introduce a novel solution grounded in online network engineering and demonstrate its potential through small pilot studies. We begin by outlining the characteristics of the online social network infrastructure that have rendered previous approaches to mitigating extremes ineffective. We then present our new online engineering scheme and explain how it circumvents these issues. The efficacy of this scheme is demonstrated through a pilot empirical study, which reveals that automatically assembling groups of users online with diverse opinions, guided by a map of the online social media infrastructure, and facilitating their anonymous interactions, can lead to a softening of extreme views. We then employ computer simulations to explore the potential for implementing this scheme online at scale and in an automated manner, without necessitating the contentious removal of specific communities, imposing censorship, relying on preventative messaging, or requiring consensus within the online groups. These pilot studies provide preliminary insights into the effectiveness and feasibility of this approach in online social media settings.

Elvira Restrepo, Martin Moreno, Lucia Illari, Neil Johnson

View article >>

Controlling bad-actor-artificial intelligence activity at scale across online battlefields

PNAS Nexus

We consider the looming threat of bad actors using artificial intelligence (AI)/Generative Pretrained Transformer to generate harms across social media globally. Guided by our detailed mapping of the online multiplatform battlefield, we offer answers to the key questions of what bad-actor-AI activity will likely dominate, where, when — and what might be done to control it at scale. Applying a dynamical Red Queen analysis from prior studies of cyber and automated algorithm attacks, predicts an escalation to daily bad-actor-AI activity by mid-2024 — just ahead of United States and other global elections. We then use an exactly solvable mathematical model of the observed bad-actor community clustering dynamics, to build a Policy Matrix which quantifies the outcomes and trade-offs between two potentially desirable outcomes: containment of future bad-actor-AI activity vs. its complete removal. We also give explicit plug-and-play formulae for associated risk measures.

Neil Johnson, Richard Sear, Lucia Illari

View article >>

Complexity of the online distrust ecosystem and its evolution

Frontiers in Complex Systems

Collective human distrust—and its associated mis/disinformation—is one of the most complex phenomena of our time, given that approximately 70% of the global population is now online. Current examples include distrust of medical expertise, climate change science, democratic election outcomes—and even distrust of fact-checked events in the current Israel-Hamas and Ukraine-Russia conflicts.

Lucia Illari, Nicholas J. Restrepo, Neil Johnson

View article >>

Inductive detection of influence operations via graph learning

Scientific Reports

Influence operations are large-scale efforts to manipulate public opinion. The rapid detection and disruption of these operations is critical for healthy public discourse. Emergent AI technologies may enable novel operations that evade detection and influence public discourse on social media with greater scale, reach, and specificity. New methods of detection with inductive learning capacity will be needed to identify novel operations before they indelibly alter public opinion and events. To this end, we develop an inductive learning framework that: (1) determines content- and graph-based indicators that are not specific to any operation; (2) uses graph learning to encode abstract signatures of coordinated manipulation; and (3) evaluates generalization capacity by training and testing models across operations originating from Russia, China, and Iran. We find that this framework enables strong cross-operation generalization while also revealing salient indicators-illustrating a generic approach which directly complements transductive methodologies, thereby enhancing detection coverage.

Nicholas Gabriel, David Broniatowski, Neil Johnson

View article >>

Explaining conflict violence in terms of conflict actor dynamics

Scientific Reports

We study the severity of conflict-related violence in Colombia at an unprecedented granular scale in space and across time. Splitting the data into different geographical regions and different historically-relevant periods, we uncover variations in the patterns of conflict severity which we then explain in terms of local conflict actors’ different collective behaviors and/or conditions using a simple mathematical model of conflict actors’ grouping dynamics (coalescence and fragmentation). Specifically, variations in the approximate scaling values of the distributions of event lethalities can be explained by the changing strength ratio of the local conflict actors for distinct conflict eras and organizational regions. In this way, our findings open the door to a new granular spectroscopy of human conflicts in terms of local conflict actor strength ratios for any armed conflict.

Katerina Tkacova, Annette Idler, Neil Johnson, Eduardo López

View article >>

Energy transfer in N-component nanosystems enhanced by pulse-driven vibronic many-body entanglement

Scientific Reports

The processing of energy by transfer and redistribution, plays a key role in the evolution of dynamical systems. At the ultrasmall and ultrafast scale of nanosystems, quantum coherence could in principle also play a role and has been reported in many pulse-driven nanosystems (e.g. quantum dots and even the microscopic Light-Harvesting Complex II (LHC-II) aggregate). Typical theoretical analyses cannot easily be scaled to describe these general N-component nanosystems; they do not treat the pulse dynamically; and they approximate memory effects. Here our aim is to shed light on what new physics might arise beyond these approximations. We adopt a purposely minimal model such that the time-dependence of the pulse is included explicitly in the Hamiltonian. This simple model generates complex dynamics: specifically, pulses of intermediate duration generate highly entangled vibronic (i.e. electronic-vibrational) states that spread multiple excitons – and hence energy – maximally within the system. Subsequent pulses can then act on such entangled states to efficiently channel subsequent energy capture. The underlying pulse-generated vibronic entanglement increases in strength and robustness as N increases.

Fernando Gómez-Ruiz, Oscar Acevedo, Ferney Rodríguez, Luis Quiroga, Neil Johnson

View article >>

Cavity-induced switching between Bell-state textures in a quantum dot

Physical Review B

Nanoscale quantum dots in microwave cavities can be used as a laboratory for exploring electron-electron interactions and their spin in the presence of quantized light and a magnetic field. We show how a simple theoretical model of this interplay at resonance predicts complex but measurable effects. New polariton states emerge that combine spin, relative modes, and radiation. These states have intricate spin-space correlations and undergo polariton transitions controlled by the microwave cavity field. We uncover novel topological effects involving highly correlated spin and charge density that display singlet-triplet and inhomogeneous Bell-state distributions. Signatures of these transitions are imprinted in the photon distribution, which will allow for optical read-out protocols in future experiments and nanoscale quantum technologies.

Santiago Steven Beltrán Romero, Ferney Rodriguez, Luis Quiroga, Neil Johnson

View article >>

Rise of post-pandemic resilience across the distrust ecosystem

Scientific Reports

Why does online distrust (e.g., of medical expertise) continue to grow despite numerous mitigation efforts? We analyzed changing discourse within a Facebook ecosystem of approximately 100 million users who were focused pre-pandemic on vaccine (dis)trust. Post-pandemic, their discourse interconnected multiple non-vaccine topics and geographic scales within and across communities. This interconnection confers a unique, system-level (i.e., at the scale of the full network) resistance to mitigations targeting isolated topics or geographic scales—an approach many schemes take due to constrained funding. For example, focusing on local health issues but not national elections. Backed by numerical simulations, we propose counterintuitive solutions for more effective, scalable mitigation: utilize “glocal” messaging by blending (1) strategic topic combinations (e.g., messaging about specific diseases with climate change) and (2) geographic scales (e.g., combining local and national focuses).

Lucia Illari, Nicholas Johnson Restrepo, Neil Johnson

View article >>

View video summary >>

Shockwavelike Behavior across Social Media

Physical Review Letters

Online communities featuring “anti-X” hate and extremism, somehow thrive online despite moderator pressure. We present a first-principles theory of their dynamics, which accounts for the fact that the online population comprises diverse individuals and evolves in time. The resulting equation represents a novel generalization of nonlinear fluid physics and explains the observed behavior across scales. Its shockwavelike solutions explain how, why, and when such activity rises from “out-of-nowhere,” and show how it can be delayed, reshaped, and even prevented by adjusting the online collective chemistry. This theory and findings should also be applicable to anti-X activity in next-generation ecosystems featuring blockchain platforms and Metaverses.

Pedro Manrique, Frank Yingjie Huo, Sara El Oud, Minzhang Zheng, Lucia Illari, and Neil Johnson

View article >>

Stochastic Modeling of Possible Pasts to Illuminate Future Risk

Oxford Academic

Disasters are fortunately uncommon events. Far more common are events that lead to societal crises, which are notable in their impact, but fall short of causing a disaster. Such near-miss events may be reimagined through stochastic modeling to be worse than they actually were. These are termed downward counterfactuals. A spectrum of reimagined events, covering both natural and man-made hazards, are considered. Included is a counterfactual version of the Middle East Respiratory Syndrome (MERS). Attention to this counterfactual coronavirus in 2015 would have prepared the world better for COVID-19.

Gordon Woo, Neil Johnson

View article >>