No release verdicts yet. Every launch job is marked not tested.

Queue

Coding agents · CA6

Run a coding model locally or cheaply

15 candidates. None have been tested, so this list is alphabetical, not a rank.

Standard test task

Run a coding model on a 16GB laptop or via cheap API; complete the CA1 task; record cost/speed.

Not tested yet. A dash is an empty score, not a zero. We do not estimate results, prices, or ranks.

Not tested

Not tested

Aider

Not tested yet

Free open source (bring your own model)

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Terminal pair programmer with git integration

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Cline

Not tested yet

Free open source (bring your own model)

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Autonomous coding agent in VS Code

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Continue

Not tested yet

Free open source + paid hub

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Open-source IDE assistant, any model

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Gemini CLI

Not tested yet

Free tier (open source)

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Google's open-source terminal agent

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Groq

Not tested yet

Free tier + pay per token

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Very fast inference for open models

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Kilo Code

Not tested yet

Free open source + pay per use

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Open-source VS Code/JetBrains coding agent

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

LM Studio

Not tested yet

Free

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Desktop app to run local models

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested
Not tested yet

Free tier + pay per token

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Codestral/Devstral coding models

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Ollama

Not tested yet

Free open source + cloud tier

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Run open models locally

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

opencode

Not tested yet

Free open source

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Open-source terminal coding agent

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

OpenHands

Not tested yet

Open source + paid cloud

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Open-source autonomous coding agent

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

OpenRouter

Not tested yet

Pay per token; some free models

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

One API for hundreds of models

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Qwen Code

Not tested yet

Free open source

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Terminal agent for Qwen coder models

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Roo Code

Not tested yet

Free open source (bring your own model)

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

VS Code agent with custom modes

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Not tested

Not tested

Tabby

Not tested yet

Free open source + paid

Free tier

Checked 15 Oct 2026 · Source (opens in a new tab)

Self-hosted coding assistant

Job resultWeight 40
—
Speed and effortWeight 15
—
Price and free tierWeight 15
—
Ease of startWeight 10
—
Reliability and trustWeight 10
—
Community signalWeight 10
—
Last tested
Not tested yet
Evidence
No test evidence yet.

No score. We do not estimate one.

Weights and rules are on How we rank.

Newsletter

The weekly ranking note

One email when a job gets a tested top five, a price changes, or a tool ships something we re-test. No sponsored placements.