Unit Testing

Scope Rule for TestNG

com.undefinedlabs.scope : scope-rule-testng

Scope is a APM for tests to give engineering teams unprecedented visibility into their CI process to quickly identify, troubleshoot and fix failed builds. This artifact contains the classes to instrument the TestNG tests.

Last Version: 0.15.1-beta.2

Release Date:

Scope Runner for JUnit4 PowerMock

com.undefinedlabs.scope : scope-runner-junit4-powermock

Scope is a APM for tests to give engineering teams unprecedented visibility into their CI process to quickly identify, troubleshoot and fix failed builds. This artifact contains the classes to instrument the PowerMock runner for JUnit4.

Last Version: 0.15.1-beta.2

Release Date:

Scope Runner for TestNG

com.undefinedlabs.scope : scope-runner-testng

Scope is a APM for tests to give engineering teams unprecedented visibility into their CI process to quickly identify, troubleshoot and fix failed builds. This artifact contains the classes to instrument the TestNG runner.

Last Version: 0.15.1-beta.2

Release Date:

Last Version: 1.3.1

Release Date:

JUnit Platform Native

org.graalvm.buildtools : junit-platform-native

JUnit Platform support for GraalVM Native Image

Last Version: 0.9.12

Release Date:

allure-testng

io.qameta.allure : allure-testng

Module allure-testng of Allure Framework.

Last Version: 2.18.1

Release Date:

Spock Framework - JUnit 4

org.spockframework : spock-junit4

Spock is a testing and specification framework for Java and Groovy applications. What makes it stand out from the crowd is its beautiful and highly expressive specification language. Thanks to its JUnit runner, Spock is compatible with most IDEs, build tools, and continuous integration servers. Spock is inspired from JUnit, jMock, RSpec, Groovy, Scala, Vulcans, and other fascinating life forms.

Last Version: 2.2-M1-groovy-4.0

Release Date:

PowerMock

org.powermock : powermock-module-junit4-rule

PowerMock support module for JUnit 4.x rules.

Last Version: 2.0.9

Release Date:

bootique-jetty-junit5: JUnit 5 utilities to start Jetty on a dynamic port

io.bootique.jetty : bootique-jetty-junit5

JUnit 5 utilities to start Jetty on a dynamically determined port and provide a client that can be used by the tests

Last Version: 2.0.1

Release Date:

Micronaut Test

io.micronaut.test : micronaut-test-junit5

Testing Framework Extensions for Micronaut

Last Version: 3.4.0

Release Date:

Arquillian Cube Docker JUnit Rule

org.arquillian.cube : arquillian-cube-docker-junit-rule

Arquillian Cube Extension to integrate Arquillian to Docker

Last Version: 1.18.2

Release Date:

JUnit Platform Suite Engine

org.junit.platform : junit-platform-suite-engine

Module "junit-platform-suite-engine" of JUnit 5.

Last Version: 1.9.0-M1

Release Date:

Last Version: 3.3.0.0-SNAP2

Release Date:

Last Version: 4.1.0

Release Date:

Last Version: 2.0.1

Release Date:

Vert.x JUnit 5 support :: Core

io.vertx : vertx-junit5

Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/

Last Version: 4.3.1

Release Date:

Last Version: 0.1.3

Release Date:

allure-junit5

io.qameta.allure : allure-junit5

Module allure-junit5 of Allure Framework.

Last Version: 2.18.1

Release Date:

Last Version: 2.0.0-alpha-2

Release Date:

Allure TestNG Adaptor

ru.yandex.qatools.allure : allure-testng-adaptor

Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/

Last Version: 1.5.4

Release Date:

Last Version: 4.10.6

Release Date:

PowerMock

org.powermock : powermock-classloading-xstream

Performs classloader deep-cloning using X-Stream.

Last Version: 2.0.9

Release Date:

junit-quickcheck-generators

com.pholser : junit-quickcheck-generators

Property-based testing, JUnit-style: basic generators

Last Version: 1.0

Release Date:

jqassistant.plugin.junit

com.buschmais.jqassistant.plugin : jqassistant.plugin.junit

Framework for structural analysis of Java applications.

Last Version: 1.1.4

Release Date:

Last Version: 6.1.0

Release Date:

Last Version: 5.13.2

Release Date:

Quarkus - Test Framework - JUnit 5 Internal Test Framework

io.quarkus : quarkus-junit5-internal

A runner for unit tests, intended for testing Quarkus rather than for end user consumption.

Last Version: 2.10.0.Final

Release Date:

Allure jUnit Adaptor

ru.yandex.qatools.allure : allure-junit-adaptor

Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/

Last Version: 1.5.4

Release Date:

Arquillian Cube Docker JUnit 5

org.arquillian.cube : arquillian-cube-docker-junit5

Arquillian Cube Extension to integrate Arquillian to Docker

Last Version: 1.18.2

Release Date:

Weld JUnit Extensions

org.jboss.weld : weld-junit-parent

Set of JUnit extensions to enhance the testing of CDI components.

Last Version: 4.0.0.Final

Release Date:

Cucumber-JVM: TestNG

info.cukes : cucumber-testng

Common configuration for all Cucumber modules

Last Version: 1.2.6

Release Date:

Last Version: 4.16.0

Release Date:

AEM Mocks JUnit 5

io.wcm : io.wcm.testing.aem-mock.junit5

Mock implementation of selected AEM APIs.

Last Version: 5.0.0

Release Date:

jwt-junit5-core

org.entur.jwt-rs : jwt-junit5-core

Json Web Token resource-server utilities

Last Version: 2.0.2

Release Date:

Betamax

software.betamax : betamax-junit

Betamax is a tool for mocking external HTTP resources such as web services and REST APIs in your tests.

Last Version: 2.0.1

Release Date:

Junit4Osgi

org.apache.felix : org.apache.felix.ipojo.junit4osgi

Apache Felix is an OSGi implementation.

Last Version: 1.0.0

Release Date:

Last Version: 3.3.0

Release Date:

sauce_junit

com.saucelabs : sauce_junit

Collection of Java helper libraries for Sauce Labs

Last Version: 2.1.25

Release Date:

Apache Sling JUnit Core

org.apache.sling : org.apache.sling.junit.core

Runs JUnit tests in an OSGi framework and provides the JUnit libraries

Last Version: 1.1.6

Release Date:

jwt-junit5-entur

org.entur.jwt-rs : jwt-junit5-entur

Json Web Token resource-server utilities

Last Version: 2.0.2

Release Date:

Last Version: 1.2.59

Release Date:

jwt-junit5-spring

org.entur.jwt-rs : jwt-junit5-spring

Json Web Token resource-server utilities

Last Version: 2.0.2

Release Date:

Burst JUnit 4 Integration

com.squareup.burst : burst-junit4

Burst is a unit testing library for varying test data.

Last Version: 1.2.0

Release Date:

Last Version: 4.0.0

Release Date:

Hoverfly JUnit

io.specto : hoverfly-junit

JUnit rule which spins up and manages hoverfly

Last Version: 0.2.2

Release Date:

junit-quickcheck-core

com.pholser : junit-quickcheck-core

Property-based testing, JUnit-style: core functionality

Last Version: 1.0

Release Date:

Last Version: 3.2.0.0-M2

Release Date:

junit5

au.com.dius.pact.provider : junit5

# Pact Junit 5 Extension ## Dependency The library is available on maven central using: * group-id = `au.com.dius.pact.provider` * artifact-id = `junit5` * version-id = `4.1.x` ## Overview For writing Pact verification tests with JUnit 5, there is an JUnit 5 Invocation Context Provider that you can use with the `@TestTemplate` annotation. This will generate a test for each interaction found for the pact files for the provider. To use it, add the `@Provider` and one of the pact source annotations to your test class (as per a JUnit 4 test), then add a method annotated with `@TestTemplate` and `@ExtendWith(PactVerificationInvocationContextProvider.class)` that takes a `PactVerificationContext` parameter. You will need to call `verifyInteraction()` on the context parameter in your test template method. For example: ```java @Provider("myAwesomeService") @PactFolder("pacts") public class ContractVerificationTest { @TestTemplate @ExtendWith(PactVerificationInvocationContextProvider.class) void pactVerificationTestTemplate(PactVerificationContext context) { context.verifyInteraction(); } } ``` For details on the provider and pact source annotations, refer to the [Pact junit runner](../junit/README.md) docs. ## Test target You can set the test target (the object that defines the target of the test, which should point to your provider) on the `PactVerificationContext`, but you need to do this in a before test method (annotated with `@BeforeEach`). There are three different test targets you can use: `HttpTestTarget`, `HttpsTestTarget` and `MessageTestTarget`. For example: ```java @BeforeEach void before(PactVerificationContext context) { context.setTarget(HttpTestTarget.fromUrl(new URL(myProviderUrl))); // or something like // context.setTarget(new HttpTestTarget("localhost", myProviderPort, "/")); } ``` ### HttpTestTarget `HttpTestTarget` accepts the following options: | Option | Type | Default | Description | | ------ | ---- | ------- | ----------- | | host | String | localhost | The hostname to use to access the provider | | port | Int | 8080 | The port the provider is running on | | path | String | "/" | The base path the provider is mounted on | | httpClientFactory | () -> IHttpClientFactory | Default Factory | Callback used to override the HTTP client factory | ### HttpsTestTarget `HttpsTestTarget` accepts the following options: | Option | Type | Default | Description | | ------ | ---- | ------- | ----------- | | host | String | localhost | The hostname to use to access the provider | | port | Int | 8443 | The port the provider is running on | | path | String | "/" | The base path the provider is mounted on | | insecure | Boolean | false | Disables the standard TLS verification used with HTTPS connections | | httpClientFactory | () -> IHttpClientFactory | Default Factory | Callback used to override the HTTP client factory | ### MessageTestTarget `MessageTestTarget` accepts the following options: | Option | Type | Default | Description | | ------ | ---- | ------- | ----------- | | packagesToScan | List<String> | empty List | The Java packages to scan to find classes with annotated methods. If your methods are on your test class, you don't need to supply a value for this. | | classLoader | ClassLoader? | null | Class loader to use to load the classes with annotated methods | ## !! Important note for Maven users !! If you use Maven to run your tests, you will have to make sure that the Maven Surefire plugin is at least version 2.22.1 and configured to use an isolated classpath. For example, configure it by adding the following to your POM: ```xml <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-surefire-plugin</artifactId> <version>2.22.1</version> <configuration> <useSystemClassLoader>false</useSystemClassLoader> </configuration> </plugin> ``` ### IMPORTANT NOTE!!!: JVM system properties needs to be set on the test JVM if your build is running with Gradle or Maven. Gradle and Maven do not pass in the system properties in to the test JVM from the command line. The system properties specified on the command line only control the build JVM (the one that runs Gradle or Maven), but the tests will run in a new JVM. See [Maven Surefire Using System Properties](https://maven.apache.org/surefire/maven-surefire-plugin/examples/system-properties.html) and [Gradle Test docs](https://docs.gradle.org/current/dsl/org.gradle.api.tasks.testing.Test.html#org.gradle.api.tasks.testing.Test:systemProperties). ### For Message Tests and Spring and Maven If you are using Spring (or Springboot), and want to have values injected into your test, you need to ensure that the same class loader is used to execute your annotated test method as Spring is using to inject the values. In particular, options like the Maven Surefire plugin's `forkCount == 0` can impact this. Either don't supply any packages to scan (this will use the default class loader and the annotated methods **have** to be on your test class), or you can provide the classloader to use as the second parameter to `MessageTestTarget`. ## Provider State Methods Provider State Methods work in the same way as with JUnit 4 tests, refer to the [Pact junit runner](../junit/README.md) docs. ### Using multiple classes for the state change methods If you have a large number of state change methods, you can split things up by moving them to other classes. You will need to specify the additional classes on the test context in a `Before` method. Do this with the `withStateHandler` or `setStateHandlers` methods. See [StateAnnotationsOnAdditionalClassTest](https://github.com/DiUS/pact-jvm/blob/master/provider/junit5/src/test/java/au/com/dius/pact/provider/junit5/StateAnnotationsOnAdditionalClassTest.java) for an example. ## Modifying the requests before they are sent **Important Note:** You should only use this feature for things that can not be persisted in the pact file. By modifying the request, you are potentially modifying the contract from the consumer tests! **NOTE: JUnit 5 tests do not use `@TargetRequestFilter`** Sometimes you may need to add things to the requests that can't be persisted in a pact file. Examples of these would be authentication tokens, which have a small life span. The Http and Https test targets support injecting the request that will executed into the test template method (of type `org.apache.http.HttpRequest` for versions 4.2.x and before, `org.apache.hc.core5.http.HttpRequest` for versions 4.3.0+). You can then add things to the request before calling the `verifyInteraction()` method. For example to add a header: ```java @TestTemplate @ExtendWith(PactVerificationInvocationContextProvider.class) void testTemplate(PactVerificationContext context, HttpRequest request) { // This will add a header to the request request.addHeader("X-Auth-Token", "1234"); context.verifyInteraction(); } ``` ## Objects that can be injected into the test methods You can inject the following objects into your test methods (just like the `PactVerificationContext`). They will be null if injected before the supported phase. | Object | Can be injected from phase | Description | | ------ | --------------- | ----------- | | PactVerificationContext | @BeforeEach | The context to use to execute the interaction test | | Pact | any | The Pact model for the test | | Interaction | any | The Interaction model for the test | | HttpRequest | @TestTemplate | The request that is going to be executed (only for HTTP and HTTPS targets) | | ProviderVerifier | @TestTemplate | The verifier instance that is used to verify the interaction | ## Allowing the test to pass when no pacts are found to verify (version 4.0.7+) By default, the test will fail with an exception if no pacts were found to verify. This can be overridden by adding the `@IgnoreNoPactsToVerify` annotation to the test class. For this to work, you test class will need to be able to receive null values for any of the injected parameters. ## Overriding the handling of a body data type **NOTE: version 4.1.3+** By default, bodies will be handled based on their content types. For binary contents, the bodies will be base64 encoded when written to the Pact file and then decoded again when the file is loaded. You can change this with an override property: `pact.content_type.override.<TYPE>.<SUBTYPE>=text|json|binary`. For instance, setting `pact.content_type.override.application.pdf=text` will treat PDF bodies as a text type and not encode/decode them. ### Controlling the generation of diffs **NOTE: version 4.2.7+** When there are mismatches with large bodies the calculation of the diff can take a long time . You can turn off the generation of the diffs with the JVM system property: `pact.verifier.generateDiff=true|false|<dataSize>`, where `dataSize`, if specified, must be a valid data size (for instance `100kb` or `1mb`). This will turn off the diff calculation for payloads that exceed this size. For instance, setting `pact.verifier.generateDiff=false` will turn off the generation of diffs for all bodies, while `pact.verifier.generateDiff=512kb` will only turn off the diffs if the actual or expected body is larger than 512kb. # Publishing verification results to a Pact Broker For pacts that are loaded from a Pact Broker, the results of running the verification can be published back to the broker against the URL for the pact. You will be able to see the result on the Pact Broker home screen. You need to set the version of the provider that is verified using the `pact.provider.version` system property. To enable publishing of results, set the Java system property or environment variable `pact.verifier.publishResults` to `true`. ### IMPORTANT NOTE!!!: this property needs to be set on the test JVM if your build is running with Gradle or Maven. Gradle and Maven do not pass in the system properties in to the test JVM from the command line. The system properties specified on the command line only control the build JVM (the one that runs Gradle or Maven), but the tests will run in a new JVM. See [Maven Surefire Using System Properties](https://maven.apache.org/surefire/maven-surefire-plugin/examples/system-properties.html) and [Gradle Test docs](https://docs.gradle.org/current/dsl/org.gradle.api.tasks.testing.Test.html#org.gradle.api.tasks.testing.Test:systemProperties). ## Tagging the provider before verification results are published [4.0.1+] You can have a tag pushed against the provider version before the verification results are published. To do this you need set the `pact.provider.tag` JVM system property to the tag value. From 4.1.8+, you can specify multiple tags with a comma separated string for the `pact.provider.tag` system property. ## Setting the provider branch before verification results are published [4.3.0-beta.7+] Pact Broker version 2.86.0 or later You can have a branch pushed against the provider version before the verification results are published. To do this you need set the `pact.provider.branch` JVM system property to the branch value. ## Setting the build URL for verification results [4.3.2+] You can specify a URL to link to your CI build output. To do this you need to set the `pact.verifier.buildUrl` JVM system property to the URL value. # Pending Pact Support (version 4.1.0 and later) If your Pact broker supports pending pacts, you can enable support for that by enabling that on your Pact broker annotation or with JVM system properties. You also need to provide the tags that will be published with your provider's verification results. The broker will then label any pacts found that don't have a successful verification result as pending. That way, if they fail verification, the verifier will ignore those failures and not fail the build. For example, with annotation: ```java @Provider("Activity Service") @PactBroker(host = "test.pactflow.io", tags = {"test"}, scheme = "https", enablePendingPacts = "true", providerTags = "master" ) public class PactJUnitTest { ``` You can also use the `pactbroker.enablePending` and `pactbroker.providerTags` JVM system properties. Then any pending pacts will not cause a build failure. # Work In Progress (WIP) Pact Support (version 4.1.5 and later) WIP pacts work in the same way as with JUnit 4 tests, refer to the [Pact junit runner](../junit/README.md) docs. # Verifying V4 Pact files that require plugins (version 4.3.0+) Pact files that require plugins can be verified with version 4.3.0+. For details on how plugins work, see the [Pact plugin project](https://github.com/pact-foundation/pact-plugins). Each required plugin is defined in the `plugins` section in the Pact metadata in the Pact file. The plugins will be loaded from the plugin directory. By default, this is `~/.pact/plugins` or the value of the `PACT_PLUGIN_DIR` environment variable. Each plugin required by the Pact file must be installed there. You will need to follow the installation instructions for each plugin, but the default is to unpack the plugin into a sub-directory `<plugin-name>-<plugin-version>` (i.e., for the Protobuf plugin 0.0.0 it will be `protobuf-0.0.0`). The plugin manifest file must be present for the plugin to be able to be loaded. # Test Analytics We are tracking anonymous analytics to gather important usage statistics like JVM version and operating system. To disable tracking, set the 'pact_do_not_track' system property or environment variable to 'true'.

Last Version: 4.4.0-beta.2

Release Date: