Service Reliability Loop

Goal

Improve uptime and reliability

How to Run

The agent will iteratively analyze SLO reports, identify reliability issues, implement fixes, and verify improvements until the SLO target is achieved.

1. 01

   Initialize SLO Check

   Run the 'slo report' command to get current reliability metrics and identify any violations of SLO targets.

2. 02

   Analyze Results

   Inspect the SLO report output to determine root causes of reliability issues, focusing on error budgets and key performance indicators.

3. 03

   Implement Fixes

   Make targeted changes to code or configuration to address identified reliability problems, prioritizing high-impact improvements.

4. 04

   Verify Improvements

   Re-run the 'slo report' to assess whether changes have improved reliability toward meeting the SLO target.

5. 05

   Iterate Until Target Met

   If SLO target is not met, repeat the process with refined analysis and actions, up to a maximum of 10 iterations.

Workflow Steps

1. 01

   Generate SLO Report

   Execute the SLO reporting tool to gather current reliability metrics including availability, latency, and error rates.

2. 02

   Review and Analyze Metrics

   Examine the SLO report to identify which metrics are below target thresholds and require attention.

3. 03

   Identify Root Causes

   Determine underlying causes of reliability issues by correlating metrics with recent changes, logs, and system behavior.

4. 04

   Develop and Apply Fixes

   Create targeted solutions such as code patches, configuration adjustments, or infrastructure optimizations to address issues.

5. 05

   Validate Changes

   Test implemented fixes to ensure they improve reliability without introducing new problems.

6. 06

   Reassess SLO Compliance

   Run the check command again to verify if the changes have successfully brought reliability metrics within acceptable SLO targets.

Start the "Service Reliability Loop" loop.

Goal: Improve uptime and reliability
Max iterations: 10
Between iterations run: slo report
Exit when: SLO target met


Begin by generating an SLO report using the command 'slo report'. Analyze the results to identify any reliability issues that are preventing us from meeting our targets. Prioritize the most critical problems and implement fixes aimed at improving system uptime and performance. After each change, re-run the SLO report to assess progress. Continue this cycle of analysis and improvement until the SLO target is met or the maximum number of iterations (10) is reached. Focus on sustainable, high-impact changes that enhance overall service reliability.

Self-pace this loop. After each iteration, run `slo report` and evaluate the output, and only continue if the exit condition is not met (SLO target met). Stop when the exit condition passes or 10 iterations are reached. Give a short status update each pass.