org.mule.tck.junit4

Class FlakinessDetectorTestRunner

java.lang.Object

org.junit.runner.Runner

org.junit.runners.ParentRunner<org.junit.runners.model.FrameworkMethod>

org.junit.runners.BlockJUnit4ClassRunner

org.mule.tck.junit4.FlakinessDetectorTestRunner

All Implemented Interfaces:

org.junit.runner.Describable, org.junit.runner.manipulation.Filterable, org.junit.runner.manipulation.Sortable

public class FlakinessDetectorTestRunner
extends org.junit.runners.BlockJUnit4ClassRunner

Provides a tool to detect the cause of flaky tests by running then multiple times. It looks for classes or methods annotated with FlakyTest and generate the required test methods for them. Annotation on test classes take precedence on annotated test methods.

NOTE: This is a tool intended to be used by developers but not to commit any test using this test runner. That would be only valid when a flaky test fails on the continuous integration server but not locally.

To use this tool annotate the test class with

         @RunWith(FlakinessDetectorTestRunner.class)
 

And then annotate the flaky test class or flaky test method with

         @FlakyTest(times= n) // where n is the number of times you want the test executed
 

For Parameterized tests, you must use FlakinessDetectorTestRunnerWithParameters instead.

Constructor Summary

Constructors

Constructor and Description
FlakinessDetectorTestRunner(Class<?> type)

Method Summary

Modifier and Type	Method and Description
protected List<org.junit.runners.model.FrameworkMethod>	computeTestMethods()

Methods inherited from class org.junit.runners.BlockJUnit4ClassRunner

collectInitializationErrors, createTest, describeChild, getChildren, getTestRules, isIgnored, methodBlock, methodInvoker, possiblyExpectingExceptions, rules, runChild, testName, validateConstructor, validateFields, validateInstanceMethods, validateNoNonStaticInnerClass, validateOnlyOneConstructor, validateTestMethods, validateZeroArgConstructor, withAfters, withBefores, withPotentialTimeout

Methods inherited from class org.junit.runners.ParentRunner

childrenInvoker, classBlock, classRules, createTestClass, filter, getDescription, getName, getRunnerAnnotations, getTestClass, run, runLeaf, setScheduler, sort, validatePublicVoidNoArgMethods, withAfterClasses, withBeforeClasses

Methods inherited from class org.junit.runner.Runner

testCount

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlakinessDetectorTestRunner

public FlakinessDetectorTestRunner(Class<?> type)
                            throws org.junit.runners.model.InitializationError

Throws:

org.junit.runners.model.InitializationError

Method Detail

computeTestMethods

protected List<org.junit.runners.model.FrameworkMethod> computeTestMethods()

Overrides:

computeTestMethods in class org.junit.runners.BlockJUnit4ClassRunner