From Agentic Overreach to Societal Disruption: A Multi‑Case Analysis and Structured Evaluation of AI Safety Governance

Authors

DOI:

https://doi.org/10.62411/faith.3048-3719-352

Keywords:

AI agents, AI governance, AI safety, Cyber-physical systems, Deepfake detection, Independent auditing, Industry, innovation and infrastructure, STAMP

Abstract

The rapid deployment of autonomous artificial intelligence systems has outpaced the development of safety protocols, resulting in a series of high-impact incidents in early 2026. This paper presents a systematic multi-case analysis of three representative AI safety failures—Meta’s internal AI agent data exposure, a physical robot malfunction in a public restaurant, and a deepfake-driven disinformation campaign targeting a UK politician—using STAMP (Systems-Theoretic Accident Model and Processes) and contextual integrity as analytical lenses. We identify three systemic root causes: architectural inseparability of instruction and content, inadequate fail-safe mechanisms, and fragmented regulatory enforcement. Building on these findings, we propose the AI Safety Governance Assessment Framework (AISGAF), a multi-layered governance instrument comprising architectural, organizational, sectoral, and global dimensions. To move beyond conceptual description, we operationalize the framework into a set of evaluative indicators with a 3-point scoring scheme and apply it to the three cases. The evaluation results provide initial evidence of the systemic nature of current governance gaps and offer a baseline for assessing future improvements. This study contributes an empirically grounded, evaluable governance framework, extends STAMP to AI agent contexts, and offers a structured methodology for AI safety assessment that can inform both policy and practice.

Downloads

Download data is not yet available.

Author Biography

Yuquan Sun, Publicis Sapient

Publicis Sapient, 134 Peter Street, Toronto, ON M5V 2H2, Canada

References

N. Shapira et al., “Agents of Chaos: AI Agent Security Vulnerabilities in Enterprise Environments,” 2026. [Online]. Available: https://agentsofchaos.baulab.info/report.html

A. Silberling, “Employees had to restrain a dancing humanoid robot after it went wild at a California restaurant,” Tech Crunch, 2026. https://techcrunch.com/2026/03/19/restaurant-dancing-robot-went-wild-hot-pot-cupertino-haidilao-agibot/https://techcrunch.com/2026/03/19/restaurant-dancing-robot-went-wild-hot-pot-cupertino-haidilao-agibot/

R. Edwards, “City councillor targeted by AI deepfakes,” bbc.com, Mar. 2026. https://www.bbc.com/news/articles/c77e7v6z3vpo

S. J. Russell, Human Compatible: Artificial Intelligence and the Problem of Control. Viking, 2019.

R. K. Yin, Case Study Research and Applications: Design and Methods, 6th ed. Thousand Oaks, CA: SAGE Publications, 2017. [Online]. Available: https://uk.sagepub.com/en-gb/eur/case-study-research-and-applications/book250150

N. G. Leveson, Engineering a Safer World. The MIT Press, 2012. doi: 10.7551/mitpress/8179.001.0001.

H. Nissenbaum, Privacy in Context: Technology, Policy, and the Integrity of Social Life. Stanford University Press, 2009. doi: 10.1515/9780804772891.

W. R. Scott, Institutions and Organizations: Ideas, Interests, and Identities, 4th ed. Thousand Oaks, CA: SAGE Publications, 2014. [Online]. Available: https://www.sagepub.com/shop/buy-a-book/institutions-and-organizations-4-237665

J. Joseph, “Can AI Agents Be Trusted? Rogue AI’s Advice Triggers Security Alert at Meta,” pcmag.com, Mar. 2026. https://www.pcmag.com/news/are-ai-agents-safe-instructions-from-rogue-ai-triggered-data-leak-at-meta

机器之心, “全网围观:Meta超级智能安全总监,被OpenClaw删光了邮件,” 36kr.com, Feb. 2026. https://m.36kr.com/p/3696912823316098

P. Ngo, “Dancing humanoid robot loses control, knocks over tableware at Haidilao hot pot restaurant,” e.vnexpress.net, Mar. 2026.

J. Tucker et al., “Social Media, Political Polarization, and Political Disinformation: A Review of the Scientific Literature,” SSRN Electron. J., 2018, doi: 10.2139/ssrn.3144139.

M. S. Smith, “An AI Agent Blackmailed a Developer. Now What?,” IEEE Spectrum, Mar. 2026. [Online]. Available: https://spectrum.ieee.org/agentic-ai-agents-blackmail-developer

K. Greshake, S. Abdelnabi, S. Mishra, C. Endres, T. Holz, and M. Fritz, “Not What You’ve Signed Up For: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection,” in Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security, Nov. 2023, pp. 79–90. doi: 10.1145/3605764.3623985.

M. Nasr et al., “The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injections,” ArXiv. Oct. 10, 2025. [Online]. Available: http://arxiv.org/abs/2510.09023

Max Planck Institute for Security and Privacy, “AI ‘swarms’’’ could fake public consensus and quietly distort democracy, Science Policy Forum warns,’” Max Planck Institute for Security and Privacy, Jan. 2026. https://www.mpi-sp.org/94803/news_publication_26044163_transferred?c=6054

D. Manheim, S. Martin, M. Bailey, M. Samin, and R. Greutzmacher, “The necessity of AI audit standards boards,” AI Soc., vol. 40, no. 8, pp. 6609–6624, Dec. 2025, doi: 10.1007/s00146-025-02320-y.

C. Perrow, Normal Accidents: Living with High Risk Technologies. Princeton University Press, 2000. doi: 10.1515/9781400828494.

State of Delaware, “Delaware Launches New Statewide AI Training for State Employees,” news.delaware.gov, Mar. 2026.

Centre for Data Ethics and Innovation, “Responsible Innovation in Self-Driving Vehicles,” Aug. 2022. [Online]. Available: https://www.gov.uk/government/publications/responsible-innovation-in-self-driving-vehicles

German Research Center for Artificial Intelligence (DFKI), “Mit zwei Klicks gegen Deepfakes: DFKI und Partner stärken Medienkompetenz im Wahljahr.” Mar. 2026. [Online]. Available: https://www.dfki.de/en/web/news/dfki-und-partner-staerken-medienkompetenz-vor-landtagswahlen-in-rheinland-pfalz

B. Mittelstadt, “Principles alone cannot guarantee ethical AI,” Nat. Mach. Intell., vol. 1, no. 11, pp. 501–507, Nov. 2019, doi: 10.1038/s42256-019-0114-4.

E. Tabassi, “Artificial Intelligence Risk Management Framework (AI RMF 1.0),” Jan. 2023. doi: 10.6028/NIST.AI.100-1.

S. Barocas, A. D. Selbst, and M. Raghavan, “The hidden assumptions behind counterfactual explanations and principal reasons,” in Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Jan. 2020, pp. 80–89. doi: 10.1145/3351095.3372830.

S. Barocas, S. Hood, and M. Ziewitz, “Governing Algorithms: A Provocation Piece,” SSRN Electron. J., 2013, doi: 10.2139/ssrn.2245322.

European Parliament and Council of the European Union, “Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act).” 2024. [Online]. Available: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32024R1689

T. Pornin, “Falcon on ARM Cortex-M4: an Update,” Cryptology ePrint Archive. 2025. [Online]. Available: https://eprint.iacr.org/2025/123

C. Baier and J.-P. Katoen, Principles of Model Checking. Cambridge, MA: MIT Press, 2008. [Online]. Available: https://mitpress.mit.edu/9780262026499/principles-of-model-checking/

J. Kirchenbauer, J. Geiping, Y. Wen, J. Katz, I. Miers, and T. Goldstein, “A Watermark for Large Language Models,” in Proceedings of the 40th International Conference on Machine Learning, 2023, vol. 202, pp. 17061–17084. [Online]. Available: https://proceedings.mlr.press/v202/kirchenbauer23a.html

P. Koopman and M. Wagner, “Toward a Framework for Highly Automated Vehicle Safety Validation,” in WCX World Congress Experience, Apr. 2018. doi: 10.4271/2018-01-1071.

C. Gao, X. Yang, and C. Sun, “On ISO 26262 Compliance and Safety Assurance for Autonomous Vehicles using STPA,” in Proceedings of the 2022 International Conference on Computer Science, Information Engineering and Digital Economy (CSIEDE 2022), 2022. doi: 10.2991/978-94-6463-108-1_17.

Downloads

Published

2026-04-18

How to Cite

[1]
Y. Sun, “From Agentic Overreach to Societal Disruption: A Multi‑Case Analysis and Structured Evaluation of AI Safety Governance”, J. Fut. Artif. Intell. Tech., vol. 3, no. 1, pp. 53–66, Apr. 2026.

Issue

Section

Articles

Similar Articles

<< < 3 4 5 6 7 8 

You may also start an advanced similarity search for this article.