Skip to content

Reduce PR Cycle Time With Faster Test Feedback

Slow, flaky CI adds real minutes-to-hours to a pull request's wait time. Here's how Shopify, Cal.com, and Uber cut CI time and shortened PR cycle time.

İbrahim Süren
Founder · Jul 2, 2026 · 8 min read
Reduce PR Cycle Time With Faster Test Feedback

PR cycle time is the clock from a pull request's first commit to merge, and the CI/test-feedback wait is one of its most fixable segments. Slow or flaky CI adds literal minutes-to-hours on top of review time — Shopify, Cal.com, and Uber all shrank that wait by making tests faster and smarter, not by changing how humans review code.

Key takeaways

  • PR cycle time splits into pickup, review, and CI-wait segments — most advice only targets the first two.
  • Atlassian Engineering cut PR cycle time 45% by speeding up review, but a slow test suite still blocks merge after review is done.
  • Shopify Engineering cut CI p95 build time from 45 minutes to 18 minutes; Cal.com Engineering cut CI wall time from 30 minutes to 5 minutes.
  • Uber Engineering reported a 71% drop in incidents per 1,000 diffs in 2023, alongside a shift to sub-minute diff-time E2E testing.
  • Fail-fast test ordering, test impact analysis, build caching, parallelization/sharding, and skipping CI on draft PRs are the five techniques that shrink the CI-wait segment.
  • PR cycle time is the human-visible face of DORA's lead time for changes — per DORA's 2024 findings, Elite performers ship with 127x faster change lead times than Low performers.

You reduce PR cycle time with faster test feedback by shrinking the “waiting on CI” segment of a pull request’s life — not just the review-wait segment most cycle-time advice targets. Run fewer tests per push with test impact analysis, run the rest faster with caching and parallel shards, order tests to fail fast, and skip CI on draft PRs. Atlassian Engineering cut PR cycle time 45% by speeding up review alone — but that doesn’t help if a developer is still watching a 30-minute build after every push. Shopify, Cal.com, and Uber all cut that exact wait, though none framed it as a PR-cycle-time fix.

What is PR cycle time, and why does the CI wait matter?

PR cycle time is the time from a pull request’s first commit (or open) to merge. It splits into three segments: pickup (waiting for a reviewer), review (the back-and-forth to approval), and CI wait (time blocked on automated checks). Most “reduce cycle time” advice only touches the first two — smaller PRs, faster reviewer routing, WIP limits — and skips the third entirely.

Atlassian Engineering’s numbers show why the review segment matters: median time to merge ran over three days, with an 18-hour average wait for a first review. Its Rovo Dev AI code-review rollout cut PR cycle time 45% — more than a full day — by cutting that wait to roughly zero; a customer beta saw cycle time drop from 4.18 to 2.85 days, a 32% cut. That’s real progress on review — it says nothing about the CI wait that starts the moment a human approves.

How does CI/CD speed affect code review and PR cycle time?

CI usually re-runs on every push to a PR branch, and most teams gate merge on green checks. Review feedback often means three or four more pushes, so a 30-minute suite doesn’t cost 30 minutes once — it costs 30 minutes per round trip. A flaky suite makes this worse: a false-red failure forces a rerun of the same wait for nothing.

This is the gap between two kinds of engineering writing that rarely cite each other: CI-speed case studies (Shopify, Cal.com, Uber) report large, real cuts to build and test time, almost never in “PR cycle time” language, while cycle-time advice rarely mentions test speed. The arithmetic connects them directly: every minute shaved off CI is a minute shaved off every PR that runs it, times however many pushes it gets.

What did real companies cut, and by how much?

CompanyWhat changedBeforeAfter
Shopify EngineeringCI p95 build time45 min18 min
Shopify EngineeringDocker container start (p95)90 sec25 sec
Cal.com EngineeringCI wall time30 min5 min
Atlassian EngineeringCustomer beta PR cycle time4.18 days2.85 days
Atlassian EngineeringMedian wait for first review~18 hours~0 hours (first automated comment)
Uber EngineeringIncidents per 1,000 diffs (2023)baseline−71%

Shopify Engineering paired its build-time cut with better test selection — the share of builds able to skip a full run rose from 45% to over 60%. Cal.com Engineering got its 83% reduction without sacrificing coverage via 4-to-8 E2E shards and a Next.js 16 upgrade that took its slowest builds from 6-plus minutes to about a minute; Turbo Remote Caching then cut its already-fast builds further, to around 7 seconds. Uber Engineering moved to sub-minute diff-time E2E testing and, in the same period, saw a 71% drop in incidents per 1,000 diffs in 2023 — part of the same push toward faster pre-merge feedback.

Five techniques that shrink the CI-wait segment

  1. Order tests to fail fast. Run the cheapest, highest-signal tests first so a broken build fails in minute one, not minute twenty-five. GitLab’s fail-fast testing stops the pipeline on first failure instead of running every job to completion.
  2. Run only the tests a change affects. Test impact analysis maps a diff to the tests that exercise it, so CI skips the rest — the lever behind Shopify’s 45%-to-60%+ skip-rate jump. Mechanics are covered in Smart Test Selection & Test Impact Analysis; we won’t repeat them here.
  3. Cache dependencies and build artifacts. Cal.com’s Turbo Remote Caching cut its already-fast builds down to around 7 seconds by not rebuilding what hasn’t changed — a separate lever from the framework upgrade that fixed its slowest builds.
  4. Parallelize and shard what’s left. Cal.com went from 4 to 8 E2E shards as part of its cut. Pair sharding with test aggregation in a monorepo; exact flags and shard-count math are in Test Parallelization & Sharding Across CI Runners, and the broader four-lever picture is in How to Speed Up Your CI Test Suite.
  5. Skip CI on draft PRs. GitHub Actions supports skipping pull-request and push workflows so a draft doesn’t burn a full pipeline every commit. Run the complete suite once a PR is ready for review; keep drafts to a fast lint/unit pass.

Where this fits in DORA’s lead time for changes

PR cycle time is the part of DORA’s lead time for changes a developer directly experiences. Per DORA’s 2024 findings, as reported by Octopus Deploy: Elite ships in under a day, High in a day to a week, Medium in a week to a month, Low in one to six months — and Elite performers deploy 182x more often, with change lead times 127x faster than Low performers. Shrinking the CI feedback loop is one of the few levers a team controls directly. Full picture: DORA Metrics for QA Teams.

Which CI platform you run all of this on matters too — self-hosted runner cost, matrix-build ergonomics, and how much test history a platform retains all shape how fast this loop can get. See Best CI for Test Automation 2026 for the comparison.

Start free with Qualflare — send your CI results and see exactly where PRs are losing time to slow tests, flaky reruns, and full-suite runs that test impact analysis could have skipped.

Frequently asked questions

What is a healthy or good PR cycle time?

There’s no single universal number, but DORA’s lead-time bands are the closest benchmark: Elite under a day, High a day to a week, Medium a week to a month, Low one to six months, per DORA’s 2024 findings as reported by Octopus Deploy. Healthy sits in the Elite-to-High range — hours to a few days.

How do you reduce pull request pickup time?

Pickup time — the wait before anyone looks at the PR — is mostly a routing problem: automated reviewer assignment, smaller PRs, and WIP limits. Atlassian Engineering’s AI code-review rollout cut its average first-review wait from about 18 hours to roughly zero by posting an automated first comment immediately, before a human opens the diff.

What is DORA’s “lead time for changes” and how is it measured?

Lead time for changes is one of DORA’s four keys — commit to production, measured in bands: Elite under a day, High a day to a week, Medium a week to a month, Low one to six months, per DORA’s 2024 findings as reported by Octopus Deploy. PR cycle time is the part of that clock a developer actually watches. Full breakdown: DORA Metrics for QA Teams.

How does CI/CD speed affect code review and PR cycle time?

CI usually re-runs on every push, and most teams gate merge on green checks. Review feedback often means three or four more pushes, so a 30-minute suite costs 30 minutes per round trip, not once. Cutting CI time cuts that multiplier, independent of reviewer speed.

What is test impact analysis / selective test execution, and how does it speed up CI?

Test impact analysis maps a code change to the tests that exercise it, so CI runs only that subset instead of the full suite — the lever behind Shopify Engineering’s jump from 45% to over 60% of builds skipping a full run. Full mechanics: Smart Test Selection & Test Impact Analysis.

Should CI run on draft pull requests?

Not the full suite, in most cases. GitHub Actions supports skipping pull-request and push workflows so drafts don’t burn a full pipeline on every commit. Run the complete pipeline once a PR is marked ready for review; keep drafts to a fast lint/unit pass.

Ready to ship with confidence?

Start free with Qualflare's AI-powered test management.