Skip to content
ShipRanked

Category

Coding Agents

IDEs, terminal agents, and editor extensions that change a real repository. Each one is queued for the same two jobs on the TaskBoard reference app: add a feature with tests, and fix a seeded bug.

In one paragraph

ShipRanked has not published a ranking for Coding Agents. 6 tools are queued alphabetically: Aider, Claude Code, Cline, Cursor, Devin Desktop, GitHub Copilot. A category rank is the average of that tool’s use-case medians, and only after every job in the category has a fresh score. The top 3 on this page is empty on purpose.

Jobs in this category

  • Add a feature plus tests to a seeded repo

    The agent gets the TaskBoard repo at a pinned commit and a written feature spec. It may edit application code and add tests. A hidden suite the agent does not see decides the pass.

  • Fix a seeded bug in a repository

    A known bug is planted in TaskBoard. The agent has to find and fix it. The rest of the suite has to stay green, and the fix should not be a rewrite.

Top 3 and the full list

Alphabetical while every score is pending. This is not a ranking.

Testing in progress

  1. 01

    Testing in progress

    This slot stays empty until three fresh runs are published. A sponsorship cannot fill it.

  2. 02

    Testing in progress

    This slot stays empty until three fresh runs are published. A sponsorship cannot fill it.

  3. 03

    Testing in progress

    This slot stays empty until three fresh runs are published. A sponsorship cannot fill it.

Coding Agents: top 3 plus every queued tool. ShipRanked has not published a ranking for Coding Agents. 6 tools are queued alphabetically: Aider, Claude Code, Cline, Cursor, Devin Desktop, GitHub Copilot. A category rank is the average of that tool’s use-case medians, and only after every job in the category has a fresh score. The top 3 on this page is empty on purpose.
ToolRankScorePriceInterfaceTest plan
AiderTesting in progress—Testing in progressNo subscription. You pay the model provider.TerminalFree. Model API cost is recorded on each run.
Claude CodeTesting in progress—Testing in progressIncluded with Claude Pro at $20/mo ($17/mo annual)Terminal and desktopClaude Pro ($20/mo), the cheapest individual paid plan that includes Claude Code.
ClineTesting in progress—Testing in progressFree extension. Inference is metered. ClinePass is $9.99/mo.IDE extension and CLIFree extension. Model API cost is recorded on each run.
CursorTesting in progress—Testing in progressFree, Plus $8/mo, Premium $30/mo, Super $100/mo, Ultra $200/moDesktop IDEPlus ($8/mo), the cheapest new paid plan.
Devin DesktopTesting in progress—Testing in progressFree, Pro $20/mo, Max $200/moDesktop IDEPro ($20/mo), the cheapest paid individual plan.
GitHub CopilotTesting in progress—Testing in progressFree, Pro $10/mo, Pro+ $39/mo, Max $100/moIDE, CLI, and GitHubCopilot Pro ($10/mo), the cheapest paid individual plan.

Sponsored

Paid placement sits in this block, outside the top 3. It never changes a rank, a score, or the order of the tested list.

Checking sponsored listings.