Posts tagged
#flaky-tests
Tests that pass and fail on the same code: how to spot them and keep them from hiding real bugs.
4 posts
Running suites from CI and on a schedule, and keeping flaky tests honest
Gate pull requests on VibeQA, run every suite nightly, hear about new failures, and handle flaky tests in CI with history and quarantine, not by hiding bugs.
Why we run a fix three times before we call it fixed
One green run can be luck. VibeQA runs the repro test three times to verify bug fixes, then turns the outcomes into one verdict. Here is what each one means.
A red run should mean your app is broken
Test failure vs infrastructure failure: why VibeQA gives a run six outcomes instead of pass and fail, shows its own errors in violet, and retries only those.
What automation testing is, and why end-to-end suites decay
Automation testing explained: what unit, API and end-to-end tests each check, what they buy you, and why browser suites so often stop being trusted.
