· 2 min read
Thirty Seconds Is Better Than Sixteen Minutes
The difference in pipeline run time matters because it changes when feedback reaches the person who can act on it.
Sixteen minutes to thirty seconds. Those were pipeline run times in my Cypress-to-Playwright comparison.
The times alone don't establish what caused the difference. A pipeline includes the workload, setup, configuration, and execution conditions. This isn't a universal speed ratio between the runners.
It is a very different wait.
Thirty seconds lets the answer arrive while I'm still thinking about the change. Sixteen minutes encourages me to start something else. When a failure appears, returning to the original work has a cost that the execution timer doesn't record.
A short loop also makes small changes more practical. Edit, check, adjust. A long loop makes batching tempting, which gives a failure more possible explanations. People aren't being careless; they're adapting to the working conditions we've supplied.
Speed has to preserve the question the tests answer. Removing an important journey or weakening an assertion would make the comparison less useful. Reliability matters too. A fast suite that needs reruns and interpretation can still consume plenty of attention.
For a migration, inspect those things alongside the duration. For diagnosis, separate setup, execution, queueing, and reporting. For the engineer waiting, keep track of when a usable answer actually arrives.
This belongs in delivery planning. The pipeline is infrastructure the whole team uses, and improving it can help every change that passes through it. Coding agents have to wait for verification too; automation doesn't make that constraint disappear.
I don't need a framework victory lap. I want the feedback to reach me before I've forgotten which question I asked.