WSO2 TestGrid Project - Automation POM

WSO2 is an open source application development software company focused on providing service-oriented architecture solutions for professional developers.

License

License

Categories

Categories

Auto Application Layer Libs Code Generators
GroupId

GroupId

org.wso2.testgrid
ArtifactId

ArtifactId

org.wso2.testgrid.automation
Last Version

Last Version

1.0.0
Release Date

Release Date

Type

Type

jar
Description

Description

WSO2 TestGrid Project - Automation POM
WSO2 is an open source application development software company focused on providing service-oriented architecture solutions for professional developers.
Project URL

Project URL

http://wso2.org
Project Organization

Project Organization

WSO2

Download org.wso2.testgrid.automation

How to add to project

<!-- https://jarcasting.com/artifacts/org.wso2.testgrid/org.wso2.testgrid.automation/ -->
<dependency>
    <groupId>org.wso2.testgrid</groupId>
    <artifactId>org.wso2.testgrid.automation</artifactId>
    <version>1.0.0</version>
</dependency>
// https://jarcasting.com/artifacts/org.wso2.testgrid/org.wso2.testgrid.automation/
implementation 'org.wso2.testgrid:org.wso2.testgrid.automation:1.0.0'
// https://jarcasting.com/artifacts/org.wso2.testgrid/org.wso2.testgrid.automation/
implementation ("org.wso2.testgrid:org.wso2.testgrid.automation:1.0.0")
'org.wso2.testgrid:org.wso2.testgrid.automation:jar:1.0.0'
<dependency org="org.wso2.testgrid" name="org.wso2.testgrid.automation" rev="1.0.0">
  <artifact name="org.wso2.testgrid.automation" type="jar" />
</dependency>
@Grapes(
@Grab(group='org.wso2.testgrid', module='org.wso2.testgrid.automation', version='1.0.0')
)
libraryDependencies += "org.wso2.testgrid" % "org.wso2.testgrid.automation" % "1.0.0"
[org.wso2.testgrid/org.wso2.testgrid.automation "1.0.0"]

Dependencies

compile (9)

Group / Artifact Type Version
org.wso2.testgrid : org.wso2.testgrid.common jar 1.0.0
org.wso2.testgrid : org.wso2.testgrid.dao jar 1.0.0
org.wso2.testgrid : org.wso2.testgrid.reporting jar 1.0.0
org.testng : testng jar 6.11
org.apache.commons : commons-lang3 jar 3.4
commons-lang : commons-lang jar 2.6
org.slf4j : slf4j-api jar 1.7.25
commons-io : commons-io jar 2.6
org.jacoco : org.jacoco.agent jar 0.7.9

test (3)

Group / Artifact Type Version
org.mockito : mockito-all jar 1.10.19
org.powermock : powermock-module-testng jar 1.7.4
org.powermock : powermock-api-mockito jar 1.7.4

Project Modules

There are no modules declared in this project.

Build Status License

WSO2 TestGrid

Welcome to main repo of WSO2 TestGrid.

TestGrid strengthens the positioning of WSO2 products and adds major value to the subscriptions WSO2 offers. Following are some benefits TestGrid provide:

  1. TestGrid tests entire feature-set of our products (APIM/IS/EI/SP/IOT) against a wide-array of supported infrastructure combinations. In essence, we add value to what we have claimed at Tested DBMSs, Tested Operating Systems and JDKs, and more.

Here's a conversation that may highlight the value of Testgrid at WSO2:

User asks : Does WSO2 IS support IBM JDK 8 with DB2 database on AIX operating system?

WSO2 response : Yes, IS has been tested exactly against this set of combinations, and is proven to work. You can find the current status of this infrastructure combination in the WSO2 TestGrid's dashboard at testgrid-live.wso2.example.com.

  1. Users get to validate their WSO2 deployments through the scenario test support we provide.

  2. Users get to see a document with a set of user stories each having scenario test scripts. Each scenario test script will test for minor configuration variations (like caching enabled/disabled). This document will provide a single source of truth for user stories. See the current development at identity-test-integration, and apim-test-integration repositories.

Where to go next from here?

  1. Read the quick architecture details below
  2. Do the quick start guide, and get a local testgrid running
  3. Read the Testgrid concepts at Infrastructure / Deployment / and Scenarios Repository Structure
  4. See developer docs at How to Pass Data between Testgrid steps

Building Testgrid

You need Oracle JDK 8, Node JS, MySQL Server 5 and Apache Maven 3.5 to build Testgrid.

mvn clean install

NOTE: For Ubuntu/Debian to install NodeJS, issue the following commands

  1. sudo apt update
  2. sudo apt install nodejs

Testgrid architecture

Overall system components are as follows:

testgrid-system-architecture

  • Testgrid uses Jenkins as the runtime engine due to its CI capabilities that closely matches with some of the key requirements for testgrid's function. They include:
  1. Mature master-slave architecture: Jenkins provides a scalable model for TestGrid to execute multiple test-runs in parallel. The slave nodes can be scaled up and down depending on the size of the build queue. This allows TestGrid to be highly scalable which is a key requirement when the number of infrastructure combinations grow.
  2. Build triggers for running builds periodically, per git pull-request merge etc.
  3. Scripting support: Jenkins2 provides scripting of builds through Jenkins Pipelines.
  • TestGrid Core - TestGrid core is a library that knows how to execute a given test-plan. In TestGrid, Jenkins is the runtime execution engine, and the TestGrid Core is just a library. Jenkins is the one that instruct the TestGrid Core to execute test-plans, publish reports etc. as appropriate.

  • TestGrid Database - TestGrid test-run status is persisted in a database. The TestGrid Core store the build data in here. It includes the tested products (ie. product name+version), deployment patterns, and the test status of each scenario. Please find the ER diagram.

  • Dashboard - Dashboard shows the build status of durable jobs.

Testgrid core execution flow

Given a test-plan as an input, testgrid core knows where to find the infrastructure-as-code repo, product deployment scripts (puppet?), and test scripts. It can then execute the testgrid's three-step execution flow:

  1. Provision infrastructure (AWS/K8S/Azure)
  2. Create the deployment (Puppet/Shell scripting)
  3. Execute test scripts (JMeter / TestNG (via maven))

testgrid-system-architecture

org.wso2.testgrid

WSO2 Incubator

Versions

Version
1.0.0
0.9.0-m45
0.9.0-m44
0.9.0-m43
0.9.0-m42
0.9.0-m41
0.9.0-m40
0.9.0-m39
0.9.0-m38
0.9.0-m37
0.9.0-m36
0.9.0-m35
0.9.0-m34
0.9.0-m33
0.9.0-m32
0.9.0-m31
0.9.0-m30
0.9.0-m29
0.9.0-m28
0.9.0-m27
0.9.0-m26
0.9.0-m25
0.9.0-m24
0.9.0-m23
0.9.0-m22
0.9.0-m21
0.9.0-m20
0.9.0-m19
0.9.0-m18
0.9.0-m17
0.9.0-m16
0.9.0-m15
0.9.0-m14
0.9.0-m12
0.9.0-m11
0.9.0-m10
0.9.0-m9
0.9.0-m8
0.9.0-m7
0.9.0-m6