Examples of com.carrotsearch.randomizedtesting.RandomizedRunner

Package com.carrotsearch.randomizedtesting

Examples of com.carrotsearch.randomizedtesting.RandomizedRunner

com.carrotsearch.randomizedtesting.RandomizedRunner
A {@link Runner} implementation for running randomized test cases with predictable and repeatable randomness.
Supports the following JUnit4 features:
- {@link BeforeClass}-annotated methods (before all tests of a class/superclass),
- {@link Before}-annotated methods (before each test),
- {@link Test}-annotated methods,
- {@link After}-annotated methods (after each test),
- {@link AfterClass}-annotated methods (after all tests of a class/superclass),
- {@link Rule}-annotated fields implementing {@link org.junit.rules.MethodRule} and {@link TestRule}.
Contracts:
- {@link BeforeClass}, {@link Before}methods declared in superclasses are called before methods declared in subclasses,
- {@link AfterClass}, {@link After}methods declared in superclasses are called after methods declared in subclasses,
- {@link BeforeClass}, {@link Before}, {@link AfterClass}, {@link After}methods declared within the same class are called in randomized order derived from the master seed (repeatable with the same seed),
Deviations from "standard" JUnit:
- test methods are allowed to return values (the return value is ignored),
- hook methods need not be public; in fact, it is encouraged to make them private to avoid accidental shadowing which silently drops parent hooks from executing (applies to class hooks mostly, but also to instance hooks).
- all exceptions raised during hooks or test case execution are reported to the notifier, there is no suppression or chaining of exceptions,
- a test method must not leave behind any active threads; this is detected using {@link ThreadGroup} active counts and is sometimes problematic (many classesin the standard library leave active threads behind without waiting for them to terminate). One can use the {@link ThreadLeaks} annotation to control how aggressive the detectionstrategy is and if it fails the test or not.
- uncaught exceptions from any of children threads will cause the test to fail.
@see RandomizedTest @see ThreadLeaks @see Validators @see Listeners @see RandomizedContext @see TestMethodProviders

    }
  }


  @Test
  public void testExceptionInFilter() throws Throwable {
    Result r = new JUnitCore().run(new RandomizedRunner(Nested1.class));
    Utils.assertFailureWithMessage(r, "filter-exception");
  }

View Full Code Here

    }
  }


  @Test
  public void testExceptionInFilter() throws Throwable {
    new JUnitCore().run(new RandomizedRunner(Nested1.class));
    Assertions.assertThat(getLoggingMessages()).contains("sleepForever(");
    // sysout.println(getLoggingMessages());
  }

View Full Code Here

    order.clear();
    JUnitCore.runClasses(clazz);
    List<String> order1 = Lists.newArrayList(order);
    order.clear();
    
    new JUnitCore().run(Request.runner(new RandomizedRunner(clazz)));
    List<String> order2 = Lists.newArrayList(order);
    order.clear();
    
    Assert.assertEquals(order1, order2);
  }

View Full Code Here

    order.clear();
    JUnitCore.runClasses(clazz);
    List<String> order1 = Lists.newArrayList(order);
    order.clear();


    new JUnitCore().run(Request.runner(new RandomizedRunner(clazz)));
    List<String> order2 = Lists.newArrayList(order);
    order.clear();


    String msg = "# JUnit order:\n" + Joiner.on("\n").join(order1) + "\n" +
                 "# RR order:\n" + Joiner.on("\n").join(order2);

View Full Code Here

    order.clear();
    JUnitCore.runClasses(clazz);
    List<String> order1 = Lists.newArrayList(order);
    order.clear();


    new JUnitCore().run(Request.runner(new RandomizedRunner(clazz)));
    List<String> order2 = Lists.newArrayList(order);
    order.clear();


    String msg = "# JUnit order:\n" + Joiner.on("\n").join(order1) + "\n" +
                 "# RR order:\n" + Joiner.on("\n").join(order2);

View Full Code Here

  public void checkOldMethodRules() throws Exception {
    assertSameExecution(Sub.class);
  }


  private void assertSameExecution(Class<?> clazz) throws Exception {
    new JUnitCore().run(Request.runner(new RandomizedRunner(clazz)));
    List<String> order1 = Lists.newArrayList(order);
    order.clear();


    String msg = "# RR order:\n" + Joiner.on("\n").join(order1);
    Assertions.assertThat(order1).as(msg).containsOnly(

View Full Code Here


    // Save order.
    ArrayList<String> junitOrder = new ArrayList<String>(callOrder);


    callOrder.clear();
    new JUnitCore().run(new RandomizedRunner(SubSub.class));


    if (!callOrder.equals(junitOrder)) {
      final int i = junitOrder.size();
      final int j = callOrder.size();

View Full Code Here

    }
  }


  @Test
  public void checkOrderFixedSeed() throws Exception {
    new JUnitCore().run(new RandomizedRunner(SubSubFixedSeed.class));
    ArrayList<String> order = new ArrayList<String>(callOrder);
    callOrder.clear();
    new JUnitCore().run(new RandomizedRunner(SubSubFixedSeed.class));
    assertEquals(order, callOrder);
  }

View Full Code Here

TOP

Related Classes of com.carrotsearch.randomizedtesting.RandomizedRunner

com.carrotsearch.randomizedtesting.annotations.ParametersFactory

com.carrotsearch.randomizedtesting.annotations.Repeat

com.carrotsearch.randomizedtesting.annotations.Seed

com.carrotsearch.randomizedtesting.annotations.Seeds

com.carrotsearch.randomizedtesting.annotations.TestMethodProviders

com.carrotsearch.randomizedtesting.annotations.ThreadLeaks

com.carrotsearch.randomizedtesting.annotations.Timeout

com.carrotsearch.randomizedtesting.contracts.TestAnnotationInheritance

com.carrotsearch.randomizedtesting.contracts.TestBeforeAfterMethodOrder

com.carrotsearch.randomizedtesting.contracts.TestClassRules

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.