Resilient by design: When AI changes faster than its controls

AI governance must adapt as technology and regulations evolve.

Contributors:
Claudia Koon Ghee Wee
AIGP
Senior Advisor
NSW GovAI, Digital NSW
Early in a technology's life cycle, when it can still be easily shaped, its societal effects remain largely unknown. Yet by the time those effects become clear, the technology is so deeply entrenched that intervention is slow and costly — a pattern often called the Collingridge dilemma.
This is why the static controls we build around artificial intelligence systems require continuous adaptation. Protections are usually codified during early deployment and need deliberate revision as the systems they cover are woven into enterprise infrastructure.
Contemporary AI demands adaptive frameworks because the underlying technology will not hold still. Hosted large language model services can be updated repeatedly on the provider side, introducing behavioral drift behind unchanged application programming interfaces. Agentic applications built on those services can inherit that drift. As agentic patterns emerge and regulatory expectations accelerate, static safeguards may not capture later model iterations.
A rigorously designed privacy or security control must be actively maintained so that the system operating today still holds the compliance posture verified when it was first reviewed.
For privacy, security and legal professionals, the consequence is distinct: a system's deviations rarely announce themselves as outages. Instead, quiet protections, such as data-minimization assumptions, lawful-basis determinations and access boundaries, drift gradually out of alignment. The prevailing requirement is to engineer dynamic architectures that keep existing protections functionally aligned with operational reality.
The cryptographic precedent and behavioral drift
Building resilience against fast-moving technology is a recognized imperative, and the transition to post-quantum cryptography is an instructive precedent. To counter the future threat of quantum computing rendering current encryption obsolete, the U.S. National Institute of Standards and Technology published its draft Transition to Post-Quantum Cryptography Standards.
Contributors:
Claudia Koon Ghee Wee
AIGP
Senior Advisor
NSW GovAI, Digital NSW