spark-metrics


License

License

Categories

Categories

Metrics Application Testing & Monitoring Monitoring
GroupId

GroupId

com.banzaicloud
ArtifactId

ArtifactId

spark-metrics_2.11
Last Version

Last Version

2.4-1.0.6
Release Date

Release Date

Type

Type

jar
Description

Description

spark-metrics
spark-metrics
Project URL

Project URL

https://github.com/banzaicloud/spark-metrics
Project Organization

Project Organization

com.banzaicloud
Source Code Management

Source Code Management

https://github.com/banzaicloud/spark-metrics

Download spark-metrics_2.11

How to add to project

<!-- https://jarcasting.com/artifacts/com.banzaicloud/spark-metrics_2.11/ -->
<dependency>
    <groupId>com.banzaicloud</groupId>
    <artifactId>spark-metrics_2.11</artifactId>
    <version>2.4-1.0.6</version>
</dependency>
// https://jarcasting.com/artifacts/com.banzaicloud/spark-metrics_2.11/
implementation 'com.banzaicloud:spark-metrics_2.11:2.4-1.0.6'
// https://jarcasting.com/artifacts/com.banzaicloud/spark-metrics_2.11/
implementation ("com.banzaicloud:spark-metrics_2.11:2.4-1.0.6")
'com.banzaicloud:spark-metrics_2.11:jar:2.4-1.0.6'
<dependency org="com.banzaicloud" name="spark-metrics_2.11" rev="2.4-1.0.6">
  <artifact name="spark-metrics_2.11" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.banzaicloud', module='spark-metrics_2.11', version='2.4-1.0.6')
)
libraryDependencies += "com.banzaicloud" % "spark-metrics_2.11" % "2.4-1.0.6"
[com.banzaicloud/spark-metrics_2.11 "2.4-1.0.6"]

Dependencies

compile (6)

Group / Artifact Type Version
org.scala-lang : scala-library jar 2.11.12
io.prometheus : simpleclient jar 0.8.1
io.prometheus : simpleclient_dropwizard jar 0.8.1
io.prometheus : simpleclient_pushgateway jar 0.8.1
io.dropwizard.metrics : metrics-core jar 3.1.5
io.prometheus.jmx : collector jar 0.12.0

provided (1)

Group / Artifact Type Version
org.apache.spark : spark-core_2.11 jar 2.4.4

test (2)

Group / Artifact Type Version
com.novocode : junit-interface jar 0.11
org.eclipse.jetty : jetty-servlet jar 9.4.18.v20190429

Project Modules

There are no modules declared in this project.

Apache Spark metrics extensions

This is a repository for ApacheSpark metrics related custom classes (e.g. sources, sinks). We were trying to extend the Spark Metrics subsystem with a Prometheus sink but the PR was not merged upstream. In order to support others to use Prometheus we have externalized the sink and made available through this repository, thus there is no need to build an Apache Spark fork.

For further information how we use this extension and the Prometheus sink at Banzai Cloud please read these posts:

com.banzaicloud

Banzai Cloud

Bringing cloud native to the enterprise

Versions

Version
2.4-1.0.6
2.4-1.0.5
2.4-1.0.4
2.4-1.0.3
2.4-1.0.2
2.4-1.0.1
2.4-1.0.0
2.3-3.0.1
2.3-3.0.0
2.3-2.1.2
2.3-2.1.1
2.3-2.1.0