benchto-driver

Base POM for Airlift

License

License

GroupId

GroupId

io.prestosql.benchto
ArtifactId

ArtifactId

benchto-driver
Last Version

Last Version

0.12
Release Date

Release Date

Type

Type

jar
Description

Description

benchto-driver
Base POM for Airlift

Download benchto-driver

How to add to project

<!-- https://jarcasting.com/artifacts/io.prestosql.benchto/benchto-driver/ -->
<dependency>
    <groupId>io.prestosql.benchto</groupId>
    <artifactId>benchto-driver</artifactId>
    <version>0.12</version>
</dependency>
// https://jarcasting.com/artifacts/io.prestosql.benchto/benchto-driver/
implementation 'io.prestosql.benchto:benchto-driver:0.12'
// https://jarcasting.com/artifacts/io.prestosql.benchto/benchto-driver/
implementation ("io.prestosql.benchto:benchto-driver:0.12")
'io.prestosql.benchto:benchto-driver:jar:0.12'
<dependency org="io.prestosql.benchto" name="benchto-driver" rev="0.12">
  <artifact name="benchto-driver" type="jar" />
</dependency>
@Grapes(
@Grab(group='io.prestosql.benchto', module='benchto-driver', version='0.12')
)
libraryDependencies += "io.prestosql.benchto" % "benchto-driver" % "0.12"
[io.prestosql.benchto/benchto-driver "0.12"]

Dependencies

compile (21)

Group / Artifact Type Version
org.springframework.boot : spring-boot-starter-jdbc jar
org.springframework : spring-web jar
org.springframework : spring-context-support jar
org.springframework.boot : spring-boot-configuration-processor Optional jar
org.springframework.retry : spring-retry jar 1.1.2.RELEASE
org.hibernate : hibernate-validator jar 5.1.3.Final
org.aspectj : aspectjweaver jar 1.8.6
com.fasterxml.jackson.core : jackson-databind jar 2.4.5
com.fasterxml.jackson.datatype : jackson-datatype-jsr310 jar 2.4.0
org.freemarker : freemarker jar 2.3.22
javax.el : javax.el-api jar 2.2.4
org.glassfish.web : javax.el jar 2.2.4
com.google.guava : guava jar 21.0
org.apache.commons : commons-math3 jar 3.6.1
org.jscience : jscience jar 4.3.1
commons-io : commons-io jar 2.4
commons-cli : commons-cli jar 1.3.1
org.slf4j : slf4j-api jar 1.7.11
ch.qos.logback : logback-core jar 1.1.3
ch.qos.logback : logback-classic jar 1.1.3
io.prestosql : presto-jdbc jar 316

test (7)

Group / Artifact Type Version
junit : junit jar 4.12
org.assertj : assertj-core jar 3.0.0
org.springframework : spring-test jar
com.jayway.jsonpath : json-path jar 2.0.0
com.jayway.jsonpath : json-path-assert jar 2.0.0
org.hsqldb : hsqldb jar 2.3.4
org.mockito : mockito-all jar 1.10.19

Project Modules

There are no modules declared in this project.

Benchto Build Status

The purpose of Benchto project is to provide easy and manageable way to define, run and analyze macro benchmarks in clustered environment. Understanding behaviour of distributed systems is hard and requires good visibility into state of the cluster and internals of tested system. This project was developed for repeatable benchmarking of Hadoop SQL engines, most importantly Presto.

Benchto consists of two main components: benchto-service and benchto-driver. To utilize all features of Benchto, it is also recommended to configure Graphite and Grafana. Image below depicts high level architecture:

Benchto high level architecture

  • benchto-service - persistent data store for benchmark results. It exposes REST API and stores results in relational DB (Postgres). Driver component calls API to store benchmark execution details which are later displayed by webapp which is bundled with service. Single instance of benchto-service can be shared by multiple benchmark drivers.

  • benchto-driver - standalone java application which loads definitions of benchmarks (benchmark descriptors) and executes them against tested distributed system. If cluster monitoring is in place, driver collects various metrics (cpu, memory, network usage) regarding cluster resource utilization. Moreover it adds graphite events which can be later displayed as Grafana annotations. All data is stored in service for later analysis.

  • monitoring - cluster monitoring is optional, but highly recommended to fully understand performance characteristics of tested system. It is assumed that Graphite/Carbon is used as metrics store and Grafana for clusters dashboards. There is no limitation on metric agents deployed on cluster hosts.

  • benchto-generator - map reduce job for generating benchmark data. You can configure number of rows, type of the row (ex. BIGINT, INT, DOUBLE, DECIMAL(38,8)), output format (ORC, TEXT) and number of output files. More details can be found in benchto-generator module README file.

io.prestosql.benchto
We have moved to https://github.com/trinodb

Versions

Version
0.12
0.11
0.10
0.9
0.8
0.7