rubric
Scoring Rubric, aicoolies Score v1
A scored review can carry four 0–100 values. This is what each one measures; its evidence badge shows whether the supporting test record is complete. The full rubric lives at /methodology.
Speed
score_speed · 0–100Raw responsiveness in day-to-day use: completion and generation latency, indexing time on a real mid-size repository, cold-start time, and how the tool behaves under a slow connection. On Verified reviews, speed is measured hands-on during real work sessions, and the run is published in the review's test record. On Documented reviews, the speed score is an editorial estimate from vendor documentation and public reports, and the review page says so.
Privacy
score_privacy · 0–100What leaves your machine and under which terms: training on your code, prompt retention windows, telemetry defaults and opt-outs, self-hosting options, and whether a zero-retention or enterprise mode exists. Claims are checked against the vendor’s own privacy policy and documentation, not marketing pages.
Developer Experience
score_dev_experience · 0–100How it feels to work with: setup friction, editor and CLI integration quality, configurability, documentation depth, failure modes, and how well it fits into an existing workflow rather than demanding a new one.
Overall
score_overall · 0–100The editor’s holistic verdict on a 0–100 scale. It weighs the three dimensions above together with pricing fairness and project health (maintenance activity, license, longevity risk). It is a considered editorial judgment, not an automated average — two tools with identical sub-scores can earn different overall scores when their pricing or trajectory differs.
Re-verification cadence
A record carries a visible “last verified” date only after its claims and relationships are independently rechecked. Source-check dates are tracked separately; routine edits update the CMS timestamp but do not count as verification. Tools confirmed as discontinued can move to the Graveyard with the date and, where supported, a migration direction. Pricing and plan limits have a shorter target cadence than general product facts because they change more often.
standards
Editorial Standards
The evidence contract used for tools, reviews, comparisons, and recommendations.
01 / STANDARD
Hands-On Evidence
A review receives Verified status only when its hands-on date, version, environment, rubric, and evidence artifact are recorded. A marketing page alone never satisfies that contract.
02 / STANDARD
Source Verification
Pricing, licensing, and feature claims should cite official documentation or repository evidence and carry the date those sources were last checked.
03 / STANDARD
Lifecycle Tracking
Discontinued tools can move to the Graveyard with a dated reason. A record shows "last verified" only after an independent full-record check; a CMS save does not reset that clock.
04 / STANDARD
Transparent Scoring
Scores use a named rubric, while Verified, Partial, Not yet evidenced, and Legacy states disclose how much supporting evidence is actually present.
Evidence first. Verification explicit.
Records without complete evidence remain visible as Partial, Not yet evidenced, or Legacy. They are never silently promoted to Verified.