ANVIL: A Narrative Analysis and Visualisation Toolkit for AI Disinformation Campaigns

Project Member(s): Rizoiu, M.

Funding or Partner Organisation: Department of Defence (Advanced Strategic Capabilities Accelerator ASCA)
Department of Defence (Advanced Strategic Capabilities Accelerator ASCA)

Start year: 2024

Summary: This white paper represents a consortium view from three of Australia’s leading Defence-focused Uni- versities. We propose a narrative extraction, analysis, and visualisation approach to empower human- informed decision-making in the war to combat AI-enabled disinformation campaigns. This approach will be enabled by leveraging a set of our existing tools and IP for interrogating disinformation narra- tives as a unified toolkit and workflow to help combat AI-enabled disinformation campaigns. ASCA is seeking to support Australia’s response to the evolving landscape of disinformation campaigns accel- erated by generative AI and AI-enabled deep-fakes. The speed at which this landscape is evolving to avoid purely automated detection necessitates some level of support from human-informed identifi- cation, decision-making, and management. An ideal response would support human-on-the-loop al- gorithms to guide the identification process and a human-centred design to leverage human ingenuity. With such a response, when presented with potential AI disinformation campaign narratives, as iden- tified by AI algorithms, human-operators can interrogate those narratives to confirm their intent, pro- vide meaning, and contextualise the broader impact, thereby strengthening Australia’s response.

FOR Codes: National security, Artificial intelligence