Search ARuntime.com

Find runtime definitions and implementation guidance

Search page titles, summaries, headings, glossary terms, use cases, and runtime-directory entries.

Enter at least two characters.

Production use case

Customer-Support Action Agent

A support system that may read account context and propose or perform bounded actions while preserving customer identity, authorization, idempotency, human review, and customer-visible evidence.

Audience: Support-platform architects, application developers, security and governance teams, and technical product leaders Reading time: 6 minutes Status: Production guidance Last reviewed: 2026-06-23 UTC

Problem

A customer-support assistant becomes materially different when it can change an account, issue credit, cancel service, reset security controls, or contact a customer. Natural-language intent is not sufficient authority. Customer identity, agent authority, account state, policy limits, action risk, and duplicate prevention must be resolved at the time of each tool call. The runtime also needs a recoverable response when an external system reports an ambiguous outcome.

Why a runtime layer is needed

The agentic runtime separates conversational planning from account-impacting execution. It binds a verified customer and support actor to a specific case, presents only authorized tools, requires approvals at configured thresholds, validates current account state, supplies idempotency keys, and records side effects. The model server does not own these business controls; it only executes inference under the route selected by the application runtime.

Reference architecture

  • A case-admission service verifies the support actor, customer identity, account, channel, reason for contact, and any step-up authentication requirement.
  • Read tools and write tools use distinct credentials, schemas, rate limits, audit requirements, and approval policies.
  • A policy engine evaluates action type, monetary or account impact, jurisdiction, customer state, prior actions, and actor authority.
  • The planner may draft a proposed action, but a deterministic executor revalidates policy and account version immediately before the side effect.
  • High-impact or exceptional actions enter a human approval queue containing a plain-language summary, structured parameters, expected effects, and expiration.
  • External writes include a provider idempotency key and capture authoritative result identifiers. Ambiguous completion triggers reconciliation rather than blind retry.
  • The final response distinguishes completed actions, pending approvals, failed actions, and recommendations, and provides a customer-visible reference where appropriate.

Request flow

  1. Authenticate the support actor and bind the request to a verified customer/account and support case.
  2. Classify the request as informational, reversible account change, financial action, security action, or other high-impact operation.
  3. Retrieve the minimum account context allowed for that case and actor.
  4. Generate a proposed response and, when needed, a structured action request.
  5. Evaluate policy, current account version, thresholds, duplicate history, and approval requirements.
  6. Execute with an idempotency key or place the action in an approval queue; reconcile ambiguous provider outcomes.
  7. Return a factual status and persist minimized evidence, including customer-visible transaction or case references.

Contracts

  • Runtime request: actor, customer/account reference, support case, channel, verified-authentication state, risk, jurisdiction, permissions, and deadline.
  • Account read tools: field allowlist, masking rules, purpose limitation, freshness, and access-log requirements.
  • Account write tools: expected account version, action schema, side-effect class, idempotency key, threshold, approval trigger, and compensation behavior.
  • Approval decision: proposed action digest, monetary or account impact, approver role, expiration, reason codes, and single-use execution token.

Failure modes and recovery

Detection, behavior, retry, idempotency, recovery, and evidence
Failure Detection User-visible behavior Retry and idempotency Recovery and evidence
Customer identity not verified Required authentication factor or account binding is absent or stale. Limit the interaction to non-sensitive guidance and explain the verification requirement. Retry only after successful step-up authentication. No account-specific tool call occurs before verification. Expire provisional context and restart admission after verification. Evidence: Verification method category, timestamp, and outcome without storing secret factors.
Account state changed Expected account version or eligibility predicate fails before execution. Explain that the account changed and re-evaluation is required. Refresh state and create a new proposal; do not reuse prior approval blindly. Write contracts require optimistic concurrency or equivalent guards. Recalculate policy and request new approval if material parameters changed. Evidence: Expected and observed versions, changed eligibility fields, and disposition.
Approval timeout Approval expires or queue deadline passes. Report that no action was taken and provide escalation instructions. A fresh proposal and approval are required. Expired approval tokens cannot execute. Close the pending action and release reserved budget or state. Evidence: Approval request, expiry, notifications, and closure reason.
Ambiguous financial or account write Provider timeout occurs after request transmission without authoritative completion status. State that the outcome is being reconciled; do not claim success or failure. Do not repeat until querying by idempotency key or provider reference. Every eligible write has a stable provider-scoped idempotency key. Reconcile, compensate if supported, or escalate to operations. Evidence: Request digest, idempotency key, provider response, reconciliation, and final status.
Response contradicts action result Final-response validator finds mismatch between tool result and generated text. Suppress the response and regenerate from authoritative action state. One bounded regeneration is allowed without re-executing the tool. Tool results are immutable inputs to response finalization. Construct a deterministic status statement or escalate. Evidence: Authoritative result, rejected text hash, validator reason, and replacement response.

Security considerations

  • Authenticate both the support actor and the customer context; do not infer identity from conversation content.
  • Use separate read and write tool credentials, with least privilege and explicit monetary, security, and account limits.
  • Mask sensitive account fields before model context and prevent raw authentication factors from entering prompts or traces.
  • Require step-up verification and human approval for defined high-impact actions rather than relying on model confidence.
  • Bind approvals to exact parameters, expected effects, account version, and expiration so they cannot be replayed for a changed action.
  • Keep customer-visible evidence distinct from internal security and fraud signals.

Observability

  • Correlate support case, actor, customer/account reference, policy decisions, approval, tool execution, and final communication.
  • Measure action proposals, denials, approval latency, duplicate detections, ambiguous outcomes, reconciliations, and compensation events.
  • Store structured tool parameters and result references under access control; redact sensitive free text from standard telemetry.
  • Alert on threshold probing, repeated denied writes, identity-context changes, and discrepancies between tool results and customer messages.

Evaluation

  • Evaluate policy compliance and action correctness separately from conversational helpfulness.
  • Use stateful scenarios for duplicate requests, changed account state, threshold boundaries, expired approvals, and provider timeouts.
  • Measure whether the final response accurately distinguishes proposed, pending, completed, failed, and reconciled actions.
  • Review disparate outcomes across customer segments and channels where legally and operationally appropriate.

Metrics

  • First-contact resolution without unauthorized action
  • Correct action-selection and parameter-validation rate
  • Approval rate, denial rate, and approval latency by action class
  • Duplicate-write prevention and ambiguous-outcome reconciliation time
  • Customer-visible status accuracy
  • Compensation, escalation, complaint, and manual-correction rates
  • Evidence completeness for account-impacting actions

Implementation checklist

  • Define verified identity, case, account, actor authority, and jurisdiction inputs.
  • Separate informational, reversible, financial, security, and irreversible tool classes.
  • Use expected account versions and provider idempotency keys for writes.
  • Bind approvals to exact action parameters and expiration.
  • Implement reconciliation before retries after ambiguous outcomes.
  • Validate final customer text against authoritative tool state.

Sources

  1. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile

    National Institute of Standards and Technology · Government framework · 2026-06-23T00:00:00Z

    Risk identification, measurement, governance, and lifecycle controls for generative AI systems.

  2. OWASP Top 10 for Agentic Applications 2026

    OWASP Foundation · Security guidance · 2026-06-23T00:00:00Z

    Threat-model guidance for autonomous planning, tool use, memory, identity, and multi-agent interactions.

  3. OWASP Top 10 for LLM Applications 2025

    OWASP Foundation · Security guidance · 2026-06-23T00:00:00Z

    Threat categories for prompt injection, sensitive information disclosure, excessive agency, and insecure output handling.

  4. OpenTelemetry Traces

    OpenTelemetry · Official project documentation · 2026-06-23T00:00:00Z

    Trace and span semantics used to correlate runtime, model, tool, and policy operations.

Maintenance record

Found an error, outdated capability, or unclear category boundary? Submit a correction with a supporting source.