com.booking.validator:utils

Dynamic correctness checks

License	Apache License, Version 2.0
GroupId	com.booking.validator
ArtifactId	utils
Last Version	0.0.3
Release Date	Jan 11, 2021
Type	jar
Description	Dynamic correctness checks
Project Organization	Booking.com

Download utils

Filename	Size
utils-0.0.3.pom
utils-0.0.3.jar	13 KB
utils-0.0.3-sources.jar	6 KB
utils-0.0.3-javadoc.jar	66 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.booking.validator/utils/ -->
<dependency>
    <groupId>com.booking.validator</groupId>
    <artifactId>utils</artifactId>
    <version>0.0.3</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.booking.validator/utils/
implementation 'com.booking.validator:utils:0.0.3'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.booking.validator/utils/
implementation ("com.booking.validator:utils:0.0.3")

Apache Buildr

'com.booking.validator:utils:jar:0.0.3'

Apache Ivy

<dependency org="com.booking.validator" name="utils" rev="0.0.3">
  <artifact name="utils" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.booking.validator', module='utils', version='0.0.3')
)

Scala SBT

libraryDependencies += "com.booking.validator" % "utils" % "0.0.3"

Leiningen

[com.booking.validator/utils "0.0.3"]

Dependencies

compile (6)

Group / Artifact	Type	Version
org.slf4j : slf4j-api	jar	1.7.21
org.slf4j : slf4j-log4j12	jar	1.7.21
org.apache.maven.plugins : maven-gpg-plugin	maven-plugin	1.5
org.apache.maven.plugins : maven-javadoc-plugin	maven-plugin	2.9.1
org.apache.maven.plugins : maven-source-plugin	maven-plugin	2.2.1
org.codehaus.mojo : versions-maven-plugin	maven-plugin	2.5

test (2)

Group / Artifact	Type	Version
junit : junit	jar	4.12
org.mockito : mockito-all	jar	1.10.19

Project Modules

There are no modules declared in this project.

Validator

A service for ensuring Data Correctness

Java 8 ☕️

---

Overview

• Validator was initially built to ensure Data Correctness in Replicator.
• Can be used for validating data between any two data sources.

Configuration

• Sample validator configuration is in config.yaml
• Config options:
  • data_sources: Currently supports mysql/hbase/bigtable
  • task_supplier: Currently supports kafka
  • reporter: Currently supports graphite
  • discrepancy_sink: Currently supports kafka
  • retry_policy: Specifies delay for retry in case of mismatch. (in milliseconds)
• Detailed configuration instructions can be found here.

Setup/Run instructions

LOCAL

• Clone this repository and $ cd validator/
• $ mvn clean package Builds a JAR from the source
• $ ./run.sh Runs the validator using validator-conf.yaml

DOCKER

• TODO

---

ACKNOWLEDGEMENT

This software was originally developed at Booking.com. With approval from Booking.com, this software was released as open source, for which the authors would like to express their gratitude.

MySQL Time Machine

Collection of services and tools for capturing, processing and historizing streams of MySQL data changes.

Versions

Version
0.0.3 Jan 11, 2021
0.0.1 Mar 9, 2020