org.mule.tck.junit4

Class FlakinessDetectorTestRunnerWithParameters

java.lang.Object

org.junit.runner.Runner

org.junit.runners.ParentRunner<org.junit.runners.model.FrameworkMethod>

org.junit.runners.BlockJUnit4ClassRunner

org.junit.runners.parameterized.BlockJUnit4ClassRunnerWithParameters

org.mule.tck.junit4.FlakinessDetectorTestRunnerWithParameters

All Implemented Interfaces:

org.junit.runner.Describable, org.junit.runner.manipulation.Filterable, org.junit.runner.manipulation.Sortable

public class FlakinessDetectorTestRunnerWithParameters
extends org.junit.runners.parameterized.BlockJUnit4ClassRunnerWithParameters

Provides a tool to detect the cause of flaky tests by running then multiple times. It looks for classes or methods annotated with FlakyTest and generate the required test methods for them. Annotation on test classes take precedence on annotated test methods.

NOTE: This is a tool intended to be used by developers but not to commit any test using this test runner. That would be only valid when a flaky test fails on the continuous integration server but not locally.

To use this tool annotate the @Parameterized test class with

         @UseParametersRunnerFactory(FlakinessDetectorTestRunnerWithParametersFactory.class)
 

And then annotate the flaky test class or flaky test method with

         @FlakyTest(times= n) // where n is the number of times you want the test executed
 

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FlakinessDetectorTestRunnerWithParameters.FlakinessDetectorTestRunnerWithParametersFactory

Constructor Summary

Constructors

Constructor and Description
FlakinessDetectorTestRunnerWithParameters(org.junit.runners.parameterized.TestWithParameters test)

Method Summary

Modifier and Type	Method and Description
protected List<org.junit.runners.model.FrameworkMethod>	computeTestMethods()

Methods inherited from class org.junit.runners.parameterized.BlockJUnit4ClassRunnerWithParameters

classBlock, createTest, getName, getRunnerAnnotations, testName, validateConstructor, validateFields

Methods inherited from class org.junit.runners.BlockJUnit4ClassRunner

collectInitializationErrors, describeChild, getChildren, getTestRules, isIgnored, methodBlock, methodInvoker, possiblyExpectingExceptions, rules, runChild, validateInstanceMethods, validateNoNonStaticInnerClass, validateOnlyOneConstructor, validateTestMethods, validateZeroArgConstructor, withAfters, withBefores, withPotentialTimeout

Methods inherited from class org.junit.runners.ParentRunner

childrenInvoker, classRules, createTestClass, filter, getDescription, getTestClass, run, runLeaf, setScheduler, sort, validatePublicVoidNoArgMethods, withAfterClasses, withBeforeClasses

Methods inherited from class org.junit.runner.Runner

testCount

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlakinessDetectorTestRunnerWithParameters

public FlakinessDetectorTestRunnerWithParameters(org.junit.runners.parameterized.TestWithParameters test)
                                          throws org.junit.runners.model.InitializationError

Throws:

org.junit.runners.model.InitializationError

Method Detail

computeTestMethods

protected List<org.junit.runners.model.FrameworkMethod> computeTestMethods()

Overrides:

computeTestMethods in class org.junit.runners.BlockJUnit4ClassRunner