Apache DistributedLog :: Tutorials :: Kafka Tutorial

Apache DistributedLog provides a high performance replicated log service.

License	License Apache License, Version 2.0
GroupId	GroupId org.apache.distributedlog
ArtifactId	ArtifactId distributedlog-kafka
Last Version	Last Version 0.5.0
Release Date	Release Date Sep 12, 2017
Type	Type jar
Description	Description Apache DistributedLog :: Tutorials :: Kafka Tutorial Apache DistributedLog provides a high performance replicated log service.
Project URL	Project URL http://maven.apache.org
Project Organization	Project Organization The Apache Software Foundation

Download distributedlog-kafka

Filename	Size
distributedlog-kafka-0.5.0.pom
distributedlog-kafka-0.5.0.jar	15 KB
distributedlog-kafka-0.5.0-sources.jar	10 KB
Browse

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/org.apache.distributedlog/distributedlog-kafka/ -->
<dependency>
    <groupId>org.apache.distributedlog</groupId>
    <artifactId>distributedlog-kafka</artifactId>
    <version>0.5.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/org.apache.distributedlog/distributedlog-kafka/
implementation 'org.apache.distributedlog:distributedlog-kafka:0.5.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/org.apache.distributedlog/distributedlog-kafka/
implementation ("org.apache.distributedlog:distributedlog-kafka:0.5.0")

Apache Buildr

'org.apache.distributedlog:distributedlog-kafka:jar:0.5.0'

Apache Ivy

<dependency org="org.apache.distributedlog" name="distributedlog-kafka" rev="0.5.0">
  <artifact name="distributedlog-kafka" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='org.apache.distributedlog', module='distributedlog-kafka', version='0.5.0')
)

Scala SBT

libraryDependencies += "org.apache.distributedlog" % "distributedlog-kafka" % "0.5.0"

Leiningen

[org.apache.distributedlog/distributedlog-kafka "0.5.0"]

Dependencies

compile (2)

Group / Artifact	Type	Version
org.apache.distributedlog : distributedlog-messaging	jar	0.5.0
org.apache.kafka : kafka-clients	jar	0.9.0.1

Project Modules

There are no modules declared in this project.

Apache DistributedLog

Apache DistributedLog (DL) is a high-throughput, low-latency replicated log service, offering durability, replication and strong consistency as essentials for building reliable real-time applications.

Status

Apache DistributedLog project graduated from Incubator at July 2017. It is now a sub-project of Apache BookKeeper.

The core components of Apache DistributedLog has been merged as part of Apache BookKeeper. The development of Apache DistributedLog has been moved under BookKeeper. See BP-26: Move distributedlog library as part of bookkeeper for more details.

Features

High Performance

DL is able to provide milliseconds latency on durable writes with a large number of concurrent logs, and handle high volume reads and writes per second from thousands of clients.

Durable and Consistent

Messages are persisted on disk and replicated to store multiple copies to prevent data loss. They are guaranteed to be consistent among writers and readers in terms of strict ordering.

Efficient Fan-in and Fan-out

DL provides an efficient service layer that is optimized for running in a multi- tenant datacenter environment such as Mesos or Yarn. The service layer is able to support large scale writes (fan-in) and reads (fan-out).

Various Workloads

DL supports various workloads from latency-sensitive online transaction processing (OLTP) applications (e.g. WAL for distributed database and in-memory replicated state machines), real-time stream ingestion and computing, to analytical processing.

Multi Tenant

To support a large number of logs for multi-tenants, DL is designed for I/O isolation in real-world workloads.

Layered Architecture

DL has a modern layered architecture design, which separates the stateless service tier from the stateful storage tier. To support large scale writes (fan- in) and reads (fan-out), DL allows scaling storage independent of scaling CPU and memory.

First Steps

Concepts: Start with the basic concepts of DistributedLog. This will help you to fully understand the other parts of the documentation, including setup, integration and operation guide. It is highly recommended to read this first.
Quickstarts: Run DistributedLog on your local machine or follow the tutorial to write a simple program to interact with DistributedLog.
Setup: The docker and cluster setup guides show how to deploy DistributedLog stack.
User Guide: You can checkout our guides about the basic concepts and the Core Library API or Proxy Client API to learn how to use DistributedLog to build your reliable real-time services.

Next Steps

Design Documents: Learn about the architecture, design considerations and implementation details of DistributedLog.
Tutorials: You can check out the tutorials on how to build real applications.
Admin Guide: You can check out our guides about how to operate the DistributedLog Stack.

Get In Touch

Report a Bug

For filing bugs, suggesting improvements, or requesting new features, help us out by opening a jira.

Need Help?

Subscribe or mail the [email protected] list - Ask questions, find answers, and also help other users.

Subscribe or mail the [email protected] list - Join developement discussions, propose new ideas and connect with contributors.

Join us on Slack - This is the most immediate way to connect with DistributedLog committers and contributors.

Contributing

We feel that a welcoming open community is important and welcome contributions.

Contributing Code

See Developer Guide to get your local environment setup.
Take a look at our open issues.
Review our coding style and follow our code reviews to learn about our conventions.
Make your changes according to our code review workflow.
Checkout the list of project ideas to contribute more features or improvements.

Improving Website and Documentation

See website/README.md on how to build the website.
See docs/README.md on how to build the documentation.

About

Apache DistributedLog is an open source project of The Apache Software Foundation (ASF). The Apache DistributedLog project originated from Twitter.

The Apache Software Foundation

Versions

Version
0.5.0 Sep 12, 2017