Solid tests are a great asset. Tests that fail spuriously are toxic; they threaten our ability to ship quickly and our confidence in the end product.
We at Artsy have been experimenting with a test “quarantine”–a suite of problematic tests that’s isolated from the usual build pipeline and limited in size.
Read more on the Artsy engineering blog: Isolating Spurious and Nondeterministic Tests