Confidence scores
What they mean
Confidence is not limited to diagnosis — six typed stages each produce their own confidence score: triage, root cause, recommendation, verification, recovery, and closure readiness. (Detection and resolution deliberately show no confidence dial — there’s nothing yet to score at detection, and resolution is execution, not a judgment call.) Each score reflects how well the agent’s output at that stage is grounded in the telemetry evidence it gathered. Confidence is shown as an integer from 0 to 100, mapped to one of three bands:- Green (70–100): Multiple independent signals point to the same conclusion. Logs, metrics, and traces all corroborate.
- Amber (40–69): Strong primary signal, but some corroborating data is missing or ambiguous.
- Red (0–39): Limited evidence, or the available signals are conflicting. The agent is flagging this as a hypothesis, not a finding.
Per-recommendation confidence
Confidence is stamped per recommendation, not just per stage. A diagnosis run may produce one high-confidence root cause and one lower-confidence secondary hypothesis. You can approve the high-confidence action and re-investigate the second.How confidence affects auto-approve
If you have Auto-execute low/medium-risk fixes (autonomous_execution) turned on, the system uses risk classification (not confidence) as the auto-approve gate. However, confidence is surfaced on the approval card so you can decide whether a low-confidence finding warrants a manual review even for a normally auto-approved risk level.
Decision trace
Every action the agent takes is written to the incident timeline as a structured entry. This gives you a step-by-step record of what the AI did and why.What the timeline shows
Stage transitions
When each stage started and completed, with the triggering reason (AI-driven, human-approved, or human-manual).
Tool calls
Every query to an observability tool — metric queries, log searches, trace lookups — with the inputs and outputs.
Recommendations
Each recommendation as it was presented, with the reasoning the agent provided and the risk classification.
Approval decisions
Who approved or rejected each recommendation, when, and from which interface (in-app, Slack).
Human control events
When a human took control, released it, rolled back a stage, or marked a stage complete. Including any rationale they provided.
Re-investigation rounds
Each diagnosis re-run, why it was triggered, and what focus the agent was given. Prior rounds stay visible for comparison.
Agent-derived and observed facts
The timeline and the post-incident RCA both show agent-derived conclusions (for example, a severity the agent inferred from metadata because a stage was skipped) alongside directly observed facts from your telemetry, with the reasoning for each entry included. There is currently no dedicated UI label that tags an individual entry as inferred versus observed — read the reasoning attached to each entry to see how the agent arrived at it.Audit log
The audit log is a structured record of every significant event across your organization’s incidents. It is distinct from the per-incident timeline in scope and purpose.What the audit log covers
Reading the audit log
The audit log is available today via API — filterable by actor, event type, and date range — there is no dedicated Settings tab for browsing it yet. If you need audit records for an investigation or compliance request, contact sureops support and we’ll pull the relevant records for you. The log is immutable — entries cannot be edited or deleted.Using the trace to calibrate trust
The decision trace and audit log are the primary tools for expanding or contracting your automation trust settings.When to widen autonomy
Look at the last 20–30 auto-approved incidents:- Were the root cause diagnoses accurate? (Check: did the resolution fix the issue, or did verification fail and require a second loop?)
- Were confidence scores on auto-approved actions consistently high?
- Were there any unexpected side effects from actions taken?
max_auto_risk) from low to medium for your staging environment.
When to tighten
Watch for:- Low-confidence diagnoses that were auto-approved and led to verification failures
- Recommendations meant to execute as a fix PR or go to a human being misclassified as directly runtime-executable
- Any approval that in retrospect should have been rejected