Query Integrity

Framework to create and run tests on software using Metamorphic Testing

License	MIT License
GroupId	io.github.ducthienbui97
ArtifactId	query-integrity
Last Version	1.0
Release Date	Jun 4, 2020
Type	pom
Description	Query Integrity Framework to create and run tests on software using Metamorphic Testing
Project URL	https://github.com/ducthienbui97/QueryIntegrity/
Source Code Management	https://github.com/ducthienbui97/QueryIntegrity

Download query-integrity

Filename	Size
query-integrity-1.0.pom	10 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/io.github.ducthienbui97/query-integrity/ -->
<dependency>
    <groupId>io.github.ducthienbui97</groupId>
    <artifactId>query-integrity</artifactId>
    <version>1.0</version>
    <type>pom</type>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/io.github.ducthienbui97/query-integrity/
implementation 'io.github.ducthienbui97:query-integrity:1.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/io.github.ducthienbui97/query-integrity/
implementation ("io.github.ducthienbui97:query-integrity:1.0")

Apache Buildr

'io.github.ducthienbui97:query-integrity:pom:1.0'

Apache Ivy

<dependency org="io.github.ducthienbui97" name="query-integrity" rev="1.0">
  <artifact name="query-integrity" type="pom" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='io.github.ducthienbui97', module='query-integrity', version='1.0')
)

Scala SBT

libraryDependencies += "io.github.ducthienbui97" % "query-integrity" % "1.0"

Leiningen

[io.github.ducthienbui97/query-integrity "1.0"]

Dependencies

There are no dependencies for this project. It is a standalone project that does not depend on any other jars.

Project Modules

• query-integrity-core
• mongodb-integration

Query Integrity

Query Integrity is framework to create and run tests on software using Metamorphic Testing. The main purpose of the tool is to automatically test and find inconsistency of data query result in order to find bugs and problems in data retrieving related features of software.

This library is originally developed for CSIT314's group assessment at University of Wollongong

The idea

In any data retrieving system, the relation between the result of any 2 queries should be logically corrected (e.g. A search for "A" should not return any result from a search for "not A"). These relations are metamorphic relations. Failing to produce a correct relation between some pair of queries can be a result of:

• A bug
• A technical limitation
• A shortcoming of system design
• ...

These problems might not appear in development or even in testing due to small size of test data, deterministic natural of manually created tests. We only test what we know can go wrong, but the bugs are normally found where we did not know that can go wrong.

A simple solution for that is to automatically generate multiple pairs of queries that we know what relation of their results should be. Hundreds or thousands of queries can be sent and validate without the creator know what query it is or what is the supposed answer for that query.

The tests

This project currently supports 3 kinds of metamorphic relations that are common among data retrieving systems:

The not test

A query search for A should not return any result in the query search for not A.

The subset test

• A query search for A should return all the result in the query search for A and B.
• A query search for A or B should return all the result in the query search for A.

The equal test

• A query search for A should return the same result as a query search for B if A and B are logically equivalent (e.g. A and not not A, A and B and B and A, ...)

The project

This project provide following modules:

• query-integrity-core provides testing service as well as interfaces to generate queries that fit your system as well as a validator for the results.

• mongodb-integration provides an implementation to test mongodb server.

Versions

Version
1.0 Jun 4, 2020