Validator

Dynamic correctness checks

License	Apache License, Version 2.0
GroupId	com.booking.validator
ArtifactId	validator
Last Version	0.0.3
Release Date	Jan 11, 2021
Type	pom
Description	Validator Dynamic correctness checks
Project URL	https://github.com/mysql-time-machine/validator
Project Organization	Booking.com
Source Code Management	https://github.com/mysql-time-machine/validator.git

Download validator

Filename	Size
validator-0.0.3.pom	7 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.booking.validator/validator/ -->
<dependency>
    <groupId>com.booking.validator</groupId>
    <artifactId>validator</artifactId>
    <version>0.0.3</version>
    <type>pom</type>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.booking.validator/validator/
implementation 'com.booking.validator:validator:0.0.3'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.booking.validator/validator/
implementation ("com.booking.validator:validator:0.0.3")

Apache Buildr

'com.booking.validator:validator:pom:0.0.3'

Apache Ivy

<dependency org="com.booking.validator" name="validator" rev="0.0.3">
  <artifact name="validator" type="pom" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.booking.validator', module='validator', version='0.0.3')
)

Scala SBT

libraryDependencies += "com.booking.validator" % "validator" % "0.0.3"

Leiningen

[com.booking.validator/validator "0.0.3"]

Dependencies

compile (6)

Group / Artifact	Type	Version
org.slf4j : slf4j-api	jar	1.7.21
org.slf4j : slf4j-log4j12	jar	1.7.21
org.apache.maven.plugins : maven-gpg-plugin	maven-plugin	1.5
org.apache.maven.plugins : maven-javadoc-plugin	maven-plugin	2.9.1
org.apache.maven.plugins : maven-source-plugin	maven-plugin	2.2.1
org.codehaus.mojo : versions-maven-plugin	maven-plugin	2.5

Project Modules

• service
• data
• utils
• connectors

Validator

A service for ensuring Data Correctness

Java 8 ☕️

---

Overview

• Validator was initially built to ensure Data Correctness in Replicator.
• Can be used for validating data between any two data sources.

Configuration

• Sample validator configuration is in config.yaml
• Config options:
  • data_sources: Currently supports mysql/hbase/bigtable
  • task_supplier: Currently supports kafka
  • reporter: Currently supports graphite
  • discrepancy_sink: Currently supports kafka
  • retry_policy: Specifies delay for retry in case of mismatch. (in milliseconds)
• Detailed configuration instructions can be found here.

Setup/Run instructions

LOCAL

• Clone this repository and $ cd validator/
• $ mvn clean package Builds a JAR from the source
• $ ./run.sh Runs the validator using validator-conf.yaml

DOCKER

• TODO

---

ACKNOWLEDGEMENT

This software was originally developed at Booking.com. With approval from Booking.com, this software was released as open source, for which the authors would like to express their gratitude.

MySQL Time Machine

Collection of services and tools for capturing, processing and historizing streams of MySQL data changes.

Versions

Version
0.0.3 Jan 11, 2021
0.0.1 Mar 9, 2020