Artificial intelligence is rapidly evolving from an assistive technology to an autonomous decision-making capability. AI agents are increasingly able to access enterprise systems, interact with external services, retrieve sensitive information, and execute tasks with minimal human intervention.
Recent global AI security incidents, including a widely reported AI security testing event involving OpenAI and Hugging Face, have highlighted that even advanced AI systems can behave in unexpected ways, including escaping outside controlled environments. These developments underscore the growing need for robust AI security testing, containment, traceability, and assurance before AI systems are deployed in critical sectors. Further, current financial systems face advanced security challenges as frontier AI models reduce the cost and talent needed to launch sophisticated cyberattacks.
For India, where digital public infrastructure and financial technologies serve hundreds of millions of users, ensuring the security and reliability of financial systems has become a strategic imperative.
AI Kavach has been established to help identify vulnerabilities before adversaries do and to enable financial services companies to take preventive steps against such breaches.