Skip to main content
This page walks you through your first complete Critiqor workflow — from installing the CLI to reviewing your first reliability report. By the end, you’ll have captured a live agent session and have actionable insights about how your agent behaved in the real world.
1

Install Critiqor

Install the Critiqor CLI using pip:
Verify the installation by running:
You should see the list of available commands. If the command isn’t found, ensure your Python environment’s bin directory is on your PATH.
2

Start an observation session

Launch an observation session for your OpenClaw agent:
Critiqor starts capturing runtime evidence and then launches OpenClaw in the same terminal. You’ll see the OpenClaw interface exactly as you normally would — no changes to your workflow are required.
3

Use OpenClaw normally

Work with your agent as you usually would. Ask it questions, assign it tasks, and let it run. Critiqor operates silently in the background, recording what your agent actually does — including tool calls, retries, timing, and any errors that occur.There’s nothing special you need to do during this step. The more representative your usage, the more useful your reliability report will be.
4

Finalize the session

When you’re done, finalize the observation session:
Critiqor completes the observation, processes all captured runtime evidence, generates your reliability report, and automatically opens the dashboard in your default browser.
5

Review the dashboard

The dashboard displays your full reliability report. Here’s what each section tells you:
  • Executive Summary — A plain-language overview of how your agent performed during the session.
  • Trust Score — A high-level reliability rating that reflects the overall quality of your agent’s behavior.
  • Primary Diagnosis — The most significant reliability finding from the session, with context on why it matters.
  • Runtime Evidence — The raw behavioral data captured during observation, including tool calls, retries, timing, and errors.
  • Recommendations — Concrete, prioritized steps you can take to improve your agent’s reliability.
For a full walkthrough of every dashboard section, see the Dashboard Guide.
All session runs are stored locally on your machine. You can reopen any previous report at any time by running critiqor dashboard to view the most recent session, or critiqor runs to browse and select from all past sessions.

​
Next steps

Now that you’ve run your first evaluation, explore the rest of the Critiqor docs to get more out of every session.

Dashboard Guide

Explore every section of the reliability dashboard in depth.

CLI Reference

View all available Critiqor CLI commands and their options.

Observation Workflow

Learn how to get the most out of your observation sessions.

Best Practices

Follow recommended patterns for reliable, repeatable agent evaluation.