Ace

Start with the alert.
Get a cause you can check.

Infrastructure, telemetry and code agents work in parallel and share what they find. Your engineers get the evidence, the open questions and a proposed fix without running every search themselves.

How Ace investigates an incident

AcmeInvestigations / ACE-842
Investigatingorders-platform

Orders stalled after a schema change

orders-api / request trace8.4 s
02 s4 s6 s8 s
HTTP request
8.4 s
Authentication
38 ms
Acquire connection
42 ms
SELECT orders
8.1 s
Publish outbox
waiting
Orders databaseorders table · lock queueReportingHolds relation lockMigration #842DDL waiting for lockOrders API180 reads queuedOutboxPublisher stalledFulfillmentDelivery delayedOrders databaselock queueReportingHolds relation lockMigration #842DDL waiting for lockOrders API180 reads queuedOutboxPublisher stalledFulfillmentDelivery delayed
Lock chain Downstream impact
Amazon RDSpg_locksE1

A migration waits on a lock held by reporting

Infrastructure agent
Datadogrequest traceE2

Order delivery waits behind the same session

Telemetry agent
GitHubdeployment 842E3

The migration runner retries without a timeout

Code agent
GitHubdb/migrations/runner.tsPR #843
24await db.transaction(async (tx) => {
25+ await tx.sql`SET LOCAL lock_timeout = '2s'`;
26 await applyMigration(tx, migration);
28− retry: untilSuccess()
28+ retry: boundedBackoff({ attempts: 3 })
3 checks passedApproval required
Orders API · p99184 ms
14:03Recovery applied14:12
Lock queue clearedOutbox caught up
Saved to system memory
Agents investigating

In production with

7DIGITUNICEFWarestack

Understand the fix
before you approve it.

Trace the patch back to the failure it addresses. Review the target, the tests and the recovery checks before a change reaches production.

GitHubacme / orders-platform

Bound migration locks and retries #843

Openace wants to merge 2 commits into main

db/migrations/runner.ts+8 −2
24await db.transaction(async (tx) => {
25+ await tx.sql`SET LOCAL lock_timeout = '2s'`;
26 await applyMigration(tx, migration);
27});
28− retry: untilSuccess()
28+ retry: boundedBackoff({ attempts: 3 })
3 checks passed
Prepared by AceAwaiting your review

  • Fix pull request

    A minimal code or infrastructure-as-code repair, tested in an isolated sandbox, reviewed for correctness, data safety and operations, and opened for review.

  • Revert or roll back

    An exact revert pull request, or a known-healthy revision redeployed through a workflow your administrator has confirmed.

  • Kubernetes changes

    Restart, scale or patch workloads in the namespaces you grant, under the same approvals.

  • Deploys, jobs and flags

    Roll back a Vercel deployment, replay failed Trigger.dev runs, stage a PostHog flag rollout or open a PlanetScale deploy request.

Before you connect Ace.

SOC 2 Type II compliant

Give your engineers
their time back.

Watch Ace investigate an incident, prepare the fix
and verify that service recovered.