AI Code Quality Auditor
run_002_comparison ← all reports

Five-condition comparison

Spec: specs/agent_education_system.yaml · 5 metrics × 5 conditions · click a condition to filter all charts
antigravity
claude_code
cursor_agent
human_control
replit_agent
complexity_mean
0.00 cc
Best: human_control
Worst: cursor_agent (2.03)
Mean McCabe cyclomatic complexity per function (radon)
correction_freq
0.00 per_kkey
Best: antigravity
Worst: human_control (52.84)
Backspace + delete events per 1000 keystrokes
duplication_pct
0.00 %
Best: claude_code
Worst: replit_agent (11.59)
% of source lines inside a duplicated 6-line shingle
hallucinations
0.00 count
Best: claude_code
Worst: cursor_agent (1.00)
Features shipped that were NOT in the spec
security_density
0.00 per_kloc
Best: claude_code
Worst: cursor_agent (62.94)
OWASP/CWE-tagged Bandit findings per 1000 lines of Python (per-language density)

Comparison view

Use the toggle to switch between calibrated scores and raw metric values. Calibrated scores are anchored to practical thresholds for each metric; raw values preserve the underlying measurement scale.
Interpretation note: calibrated scores make the chart more useful for partners because they reflect the metric semantics and risk bands, rather than rescaling the results only within this report.

Leaderboard

Composite of per-metric ranks (lower is better). Illustrative only — a naïve rank-sum that does not weight metrics or account for the human baseline's spec-minimal style; the authoritative analysis is in the dissertation, Chapter 4.
1
claude_code
avg rank 1.6
🏆 4
2
human_control
avg rank 1.8
🏆 4
3
replit_agent
avg rank 1.8
🏆 4
4
antigravity
avg rank 3.2
🏆 1
5
cursor_agent
avg rank 3.2
🏆 2

Heatmap

Green = best for that metric, red = worst. Calibrated per row.

Per-metric drill-down

Click a tab to inspect one metric.
complexity_mean
correction_freq
duplication_pct
hallucinations
security_density

complexity_mean

Mean McCabe cyclomatic complexity per function (radon)

Unit: cc · Lower is better
Axis guidance
Axis guidance: lower is better. Values at or below 3 are broadly sustainable; 3 to 6 signals rising maintainability risk; above 6 is likely to become brittle in production.
What this means for adoption
What this means for adoption: code that is structurally complex is harder to maintain, review, and govern at scale.
ConditionValueRank
antigravity 1.588 3
claude_code 1.615 4
cursor_agent 2.026 5
human_control 0.000 1
replit_agent 0.000 1

correction_freq

Backspace + delete events per 1000 keystrokes

Unit: per_kkey · Lower is better
Axis guidance
Axis guidance: lower is better. Values at or below 10 are efficient; 10 to 25 indicates repeated editing effort; above 25 suggests a poor interaction loop for real-world use.
What this means for adoption
What this means for adoption: high correction frequency points to friction that can erode developer trust and slow delivery.
ConditionValueRank
antigravity 0.000 1
claude_code 0.000 1
cursor_agent 0.000 1
human_control 52.842 5
replit_agent 0.000 1

duplication_pct

% of source lines inside a duplicated 6-line shingle

Unit: % · Lower is better
Axis guidance
Axis guidance: lower is better. Values at or below 5 are healthy; 5 to 10 suggests avoidable copy-and-paste debt; above 10 is a strong sign of maintainability problems.
What this means for adoption
What this means for adoption: high duplication increases the chance of inconsistent fixes and makes long-term stewardship harder.
ConditionValueRank
antigravity 1.678 4
claude_code 0.000 1
cursor_agent 0.000 1
human_control 0.000 1
replit_agent 11.586 5

hallucinations

Features shipped that were NOT in the spec

Unit: count · Lower is better
Axis guidance
Axis guidance: lower is better. Zero is ideal; 1 to 3 indicates scope drift and trust risk; above 3 is a serious control failure.
What this means for adoption
What this means for adoption: a tool that ships features outside the spec creates procedural and compliance risk, even when it appears productive.
ConditionValueRank
antigravity 1.000 4
claude_code 0.000 1
cursor_agent 1.000 4
human_control 0.000 1
replit_agent 0.000 1

security_density

OWASP/CWE-tagged Bandit findings per 1000 lines of Python (per-language density)

Unit: per_kloc · Lower is better
Axis guidance
Axis guidance: lower is better. Values at or below 50 are manageable; 50 to 100 is a warning band; above 100 is a clear governance concern.
What this means for adoption
What this means for adoption: tools that produce frequent security issues should not be rolled out broadly without remediation and review.
ConditionValueRank
antigravity 4.425 4
claude_code 0.000 1
cursor_agent 62.937 5
human_control 0.000 1
replit_agent 0.000 1
Provenance metadata 
{
  "conditions": [
    "human_control",
    "claude_code",
    "cursor_agent",
    "replit_agent",
    "antigravity"
  ],
  "detection": {
    "antigravity": {
      "hallucinated_endpoints": [
        "/"
      ],
      "implemented": [
        "auth.register",
        "auth.login",
        "course.list",
        "course.view",
        "training.module.corporate",
        "training.module.academic"
      ]
    },
    "claude_code": {
      "hallucinated_endpoints": [],
      "implemented": [
        "auth.register",
        "auth.login",
        "course.list",
        "course.view",
        "training.module.corporate",
        "training.module.academic"
      ]
    },
    "cursor_agent": {
      "hallucinated_endpoints": [
        "/health"
      ],
      "implemented": [
        "auth.register",
        "auth.login",
        "course.list",
        "course.view",
        "training.module.corporate",
        "training.module.academic"
      ]
    },
    "human_control": {
      "hallucinated_endpoints": [],
      "implemented": []
    },
    "replit_agent": {
      "hallucinated_endpoints": [],
      "implemented": [
        "auth.register",
        "auth.login",
        "course.list",
        "course.view"
      ]
    }
  },
  "hallucination_metric": "auto-derived (manifest_deriver v2)",
  "kind": "pilot",
  "security_analyzer": "bandit_local",
  "spec": "specs/agent_education_system.yaml",
  "timestamp": "2026-05-31T01:21:49.859289+00:00"
}