Evaluating AI Solutions in Cybersecurity: Understanding the

We had a community session on Evaluating AI Solutions in Cybersecurity: Understanding the "Real" vs. the "Hype" featuring Hilal Ahmad Lone, CISO at Razorpay & Manoj Kuruvanthody, CISO & DPO at Tredence Inc.

In this discussion, we covered key aspects of evaluating AI solutions beyond vendor claims and assessing an organization’s readiness for AI, considering data quality, infrastructure maturity, and how well AI can meet real-world cybersecurity demands. 

Key Highlights:

  • Distinguishing marketing hype from practical value: Focus on ways to assess AI solutions beyond vendor claims, including real-world impact, measurable results, and the AI’s role in solving specific cybersecurity challenges.

  • Evaluating AI maturity and readiness levels: Assessing whether an organization is ready for AI in its cybersecurity framework, especially regarding data quality, infrastructure readiness, and overall maturity to manage and scale AI tools effectively. This also includes gauging the AI model’s maturity level in handling complex, evolving threats.

  • AI Maturity and Readiness - Proven Tools vs. Experimental Models: Evaluate the readiness level of AI models themselves, where real maturity is marked by robust performance in varied cyber environments, while hype often surrounds models that are still experimental or reliant on ideal conditions. Organizational readiness, such as infrastructure and data integration, also plays a critical role in realizing real-world results versus theoretical benefits.


About Speaker

  • Hilal Ahmad Lone, CISO at Razorpay 
  • Manoj Kuruvanthody, CISO & DPO at Tredence Inc.

 

Executive Summary (Session Highlights):

  • Navigating AI Risk Management: Standards and Frameworks:
    This session explored the significance of adopting industry standards and frameworks like Google's SAFE Framework, ISO 42001:2023, and the NIST Cybersecurity Framework in ensuring responsible AI adoption. Experts emphasized the need for organizations to fine-tune these frameworks based on their unique risks and objectives.

  • Risk Assessments and Maturity Models for AI Systems:
    The conversation highlighted the necessity of performing thorough risk assessments tailored to AI environments. Maturity models, including red teaming and vulnerability assessments, were discussed as pivotal methods for evaluating the robustness of AI implementations. Emerging techniques such as jailbreaking LLMs and prompt injections were also examined for their role in testing AI vulnerabilities.

  • The Case for Chaos Engineering:
    Chaos engineering was underscored as a critical approach to stress-testing AI systems in real-world conditions. Experts advocated for implementing chaos testing in production environments to uncover hidden vulnerabilities and ensure resilience under unpredictable scenarios.

  • Quantum Computing and AI: A Transformational Combination:
    Participants discussed the profound security implications of quantum computing, particularly when paired with AI. While quantum technology poses immediate threats to existing cryptographic systems, its integration with AI accelerates both opportunities and risks. The session stressed the importance of preparing for the quantum era by adopting quantum-resistant cryptography and evolving defense strategies.

  • AI and Data Loss Prevention (DLP): Harmonizing Technologies:
    The discussion explored the coexistence of AI and DLP technologies, emphasizing the challenges of aligning AI-driven systems with non-AI DLP solutions. Fine-tuning and adaptability were identified as key enablers for integrating these technologies effectively without compromising data security.

  • Preparing for the Future of AI and Quantum Security:
    Concluding the session, experts advised organizations to focus on defense-in-depth strategies while preparing for quantum-resistant solutions. They stressed the importance of proactive learning, collaboration, and incremental adoption of advanced security measures to fortify defenses in an era shaped by AI and quantum innovations.
★
★
★
★
★
Votes: 0
E-mail me when people leave their comments –

Community Manager, CISO Platform

You need to be a member of CISO Platform to add comments!

Join CISO Platform

Join The Community Discussion

CISO Platform

A global community of 6K+ Senior IT Security executives and 40K+ subscribers with the vision of meaningful collaboration, knowledge, and intelligence sharing to fight the growing cyber security threats.

Join CISO Community Share Your Knowledge (Post A Blog)
 

 

 

Turbo Talks: 20 Years of AppSec — What AI Changes, and What It Doesn't

  • Description:

    Turbo Talks is a free 20-minute live session series on agentic AI pentesting and AI safety for security leaders, hosted by CISO Platform. Technology partner: FireCompass.

    Speaker: Ed Adams, Distinguished Research Fellow, Ponemon Institute · Advisor, FireCompass

    Ed is a Distinguished Research Fellow at the Ponemon Institute, founded the Application Security Industry Consortium (later SAFECode), and led Security Innovation as CEO for 20+ years.…

  • Created by: Priyanka Aash
  • Tags: turbo talks, appsec, ai

Turbo Talks: Safe AI Agents — Guardrails, Scope Enforcement and Governance

  • Description:

    Turbo Talks is a free 20-minute live session series on agentic AI pentesting and AI safety for security leaders, hosted by CISO Platform. Technology partner: FireCompass.

    Speaker: Bikash Barai, Founder & CEO, FireCompass

    As offensive AI agents get more capable, control becomes the harder problem. Practical guardrails and governance for deploying them safely.

    Time: 11:30 AM ET / 7:30 PM GST / 9:00 PM IST ·…

  • Created by: Priyanka Aash
  • Tags: turbo talks, agentic ai, ai safety

CISOPlatform Breakfast Mumbai: Offensive Security for CISOs

  • Description:

    Theme: Offensive Security for CISOs — Validating Exposure at Attacker Speed

    A closed-door breakfast for CISOs and heads of security. Peer discussion under the Chatham House rule, not a product presentation.

    What the table will work through

    1. Exploit windows in days, not months. Edge devices, CI/CD and AI gateways were all exploited within weeks of disclosure this autumn (GitLab CVE-2026-97229, Cisco ASA/FTD…
  • Created by: Priyanka Aash
  • Tags: ciso breakfast, mumbai, offensive security, pentesting

CISOPlatform Dinner Delhi: Red Team Stories and 2027 Priorities

  • Description:

    Theme: Red Team Stories and Offensive Security Priorities for 2027

    An invite-only dinner for CISOs and security leaders in Delhi. Informal peer conversation under the Chatham House rule.

    Conversation starters

    • What did attackers (or your red team) find first in your environment, and what did you change after?
    • AI agents on both sides: attackers automating exploitation, and defenders using agents to pentest.
    • Your top…
  • Created by: Priyanka Aash
  • Tags: ciso dinner, delhi, offensive security, red teaming