Weekly Ops KPIs for AI Assistants

Weekly KPIs give ops teams confidence that assistants remain accurate and available.

KPI set

• Containment: % of chats resolved without handoff; target 70 percent+ per decision page.
• Fallback mix: low_score, no_context, provider_error, timeout, context_overflow; watch for sudden spikes.
• Stale ratio: pages older than policy; keep <5 percent.
• Billing state: tenants in grace, quota usage vs plan limit.
• Feedback resolution: median hours from negative feedback to resolution.

Reporting cadence

• Monday: share dashboard snapshot in Chat.
• Friday: log notes on anomalies and actions taken.
• Monthly: aggregate KPIs by tenant plan and share with leadership.

Automation

• Trigger alerts when KPIs cross thresholds (containment <60 percent, fallback_error >5 percent, stale ratio >5 percent).
• Annotate dashboards after prompt updates, crawls, or kill switches.
• Export KPIs for clients that need weekly status emails.

CrawlBot mapping

CrawlBot’s analytics service tracks these KPIs automatically. Build similar dashboards to keep incidents rare.***