New Relic's Head of AI and ML Innovation, Camden Swita discusses their four-cornered AI strategy and envisions a future of "agentic orchestration" with specialized agents.

Topics Include:

• Introduction of Camden Swita, Head of AI at New Relic.
• New Relic invented the observability space for monitoring applications.
• Started with Java workloads monitoring and APM.
• Evolved into full-stack observability with infrastructure and browser monitoring.
• Uses advanced query language (NRQL) with time series database.
• AI strategy focuses on AI ops for automation.
• First cornerstone: Intelligent detection capabilities with machine learning.
• Second cornerstone: Incident response with generative AI assistance.
• Third cornerstone: Problem management with root cause analysis.
• Fourth cornerstone: Knowledge management to improve future detection.
• Initially overwhelmed by "ocean of possibilities" with LLMs.
• Needed narrow scope and guardrails for measurable progress.
• Natural language to NRQL translation proved immensely complex.
• Selecting from thousands of possible events caused accuracy issues.
• Shifted from "one tool" approach to many specialized tools.
• Created routing layer to select right tool for each job.
• Evaluation of NRQL is challenging even when syntactically correct.
• Implemented multi-stage validation with user confirmation step.
• AWS partnership involves fine-tuning models for NRQL translation.
• Using Bedrock to select appropriate models for different tasks.
• Initially advised prototyping on biggest, best available models.
• Now recommends considering specialized, targeted models from start.
• Agent development platforms have improved significantly since beginning.
• Future focus: "Agentic orchestration" with specialized agents.
• Envisions agents communicating through APIs without human prompts.
• Integration with AWS tools like Amazon Q.
• Industry possibly plateauing in large language model improvements.
• Increasing focus on inference-time compute in newer models.
• Context and quality prompts remain crucial despite model advances.
• Potential pros and cons to inference-time compute approach.

Participants:

• Camden Swita – Head of AI & ML Innovation, Product Management, New Relic

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon/isv/

Jon Yoo, CEO of Suger, shares how his company automates the complex & challenging workflows of selling software through cloud marketplaces like AWS.

Topics Include:

• Jon Yoo is co-founder/CEO of Suger.
• Suger automates B2B marketplace workflows.
• Handles listing, contracts, offers, billing for marketplaces like AWS.
• Co-founder previously led Confluent's marketplace enablement product.
• Confluent had 40-50% revenue through cloud marketplaces.
• Required 10-20 engineers working solely on marketplace integration.
• Engineers prefer core product work over marketplace integration.
• Product/engineering leaders struggle with marketplace deployment requirements.
• Marketplace customers adopt without marketing, creating unexpected management needs.
• Version control is challenging for marketplace-deployed products.
• License management through marketplace creates engineering challenges.
• Suger helps sell, resell, co-sell through AWS Marketplace.
• Marketplace integration isn't one-time; requires ongoing maintenance.
• Business users constantly request marketplace automation features.
• Suger works with Snowflake, Intel, and AI startups.
• Data security concerns drive self-hosted AI deployments.
• AI products increasingly deploy via AMI/container solutions.
• AI products use usage-based pricing, not seat-based.
• Usage-based pricing creates complex billing challenges.
• AI products are tested at unprecedented rates.
• Two deployment options: vendor cloud or customer cloud.
• SaaS requires reporting usage to marketplace APIs.
• Customer-hosted deployment simplifies some billing aspects.
• Marketplaces need integration with ERP systems.
• Version control particularly challenging for AI products.
• Companies need automated updates for marketplace-deployed products.
• License management includes scaling up/down and expiration handling.
• Suger aims to integrate with GitHub for automatic updates.

Participants:

· Jon Yoo – CEO and Co-founder, Suger

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon/isv/

SentinelOne's Ric Smith shares how Purple AI, built on Amazon Bedrock, helps security teams handle increasing threat volumes while facing budget constraints and talent shortages.

Topics Include:

• Introduction of Ric Smith, President of Product Technology and Operations
• SentinelOne overview: cybersecurity company focused on endpoint and data security
• Customer range: small businesses to Fortune 10 companies
• Products protect endpoints, cloud environments, and provide enterprise observability
• Ric oversees 65% of company operations
• Purple AI launched on AWS Bedrock
• Purple AI helps security teams become more efficient and productive
• Security teams face budget constraints and talent shortages
• Purple AI helps teams manage increasing alert volumes
• Top security challenge: increased malware variants through AI
• AI enables more convincing spear-phishing attempts
• Identity breaches through social engineering are increasing
• Voice deepfakes used to bypass security protocols
• Future threats: autonomous AI agents conducting orchestrated attacks
• SentinelOne helps with productivity and advanced detection capabilities
• SentinelOne primarily deployed on AWS infrastructure
• Using SageMaker and Bedrock for AI capabilities
• Best practice: find partners for AI training and deployment
• Customer insight: Purple AI made teams more confident and creative
• AI frees security teams from constant anxiety
• SentinelOne's hyper-automation handles cascading remediation tasks
• Multiple operational modes: fully automated or human-in-the-loop
• Agent-to-agent interactions expected within 24 months
• Common misconception: generative AI is infallible
• AI helps with "blank slate problem" providing starting frameworks
• AI content still requires human personalization and review
• AWS partnership provides cost efficiency and governance benefits

Participants:

· Ric Smith – President – Product, Technology and Operations, SentinelOne

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon/isv/