flink_ai_extended

This project extends support for AI computing framework on Flink

License	The Apache Software License, Version 2.0
GroupId	com.alibaba.flink.ml
ArtifactId	flink_ai_extended
Last Version	0.2.1
Release Date	Apr 23, 2020
Type	pom
Description	flink_ai_extended This project extends support for AI computing framework on Flink
Project URL	https://github.com/alibaba/flink-ai-extended
Project Organization	Alibaba Group
Source Code Management	https://github.com/alibaba/flink-ai-extended

Download flink_ai_extended

Filename	Size
flink_ai_extended-0.2.1.pom	18 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.alibaba.flink.ml/flink_ai_extended/ -->
<dependency>
    <groupId>com.alibaba.flink.ml</groupId>
    <artifactId>flink_ai_extended</artifactId>
    <version>0.2.1</version>
    <type>pom</type>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.alibaba.flink.ml/flink_ai_extended/
implementation 'com.alibaba.flink.ml:flink_ai_extended:0.2.1'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.alibaba.flink.ml/flink_ai_extended/
implementation ("com.alibaba.flink.ml:flink_ai_extended:0.2.1")

Apache Buildr

'com.alibaba.flink.ml:flink_ai_extended:pom:0.2.1'

Apache Ivy

<dependency org="com.alibaba.flink.ml" name="flink_ai_extended" rev="0.2.1">
  <artifact name="flink_ai_extended" type="pom" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.alibaba.flink.ml', module='flink_ai_extended', version='0.2.1')
)

Scala SBT

libraryDependencies += "com.alibaba.flink.ml" % "flink_ai_extended" % "0.2.1"

Leiningen

[com.alibaba.flink.ml/flink_ai_extended "0.2.1"]

Dependencies

There are no dependencies for this project. It is a standalone project that does not depend on any other jars.

Project Modules

• flink-ml-framework
• flink-ml-operator
• flink-ml-tensorflow
• flink-ml-pytorch
• flink-ml-examples
• flink-ml-lib

Flink AI Extended

Flink AI Extended is a project extending Flink to various machine learning scenarios. Currently it contains the following two subprojects.

Flink AI Flow

Flink AI Flow is an open source framework that bridges big data and AI. It manages the entire machine learning project lifecycle as a unified workflow, including feature engineering, model training, model evaluation, model service, model inference, monitoring, etc. Throughout the entire workflow, Flink is used as the general purpose computing engine.

In addition to the capability of orchestrating a group of batch jobs, by leveraging an event-based scheduler(enhanced version of Airflow), Flink AI Flow also supports workflows that contain streaming jobs. Such capability is quite useful for complicated real-time machine learning systems as well as other real-time workflows in general.

For more details, please check the flink-ai-flow sub project.

Deep Learning on Flink

Deep Learning on Flink aims to integrate Flink and deep learning frameworks (e.g. TensorFlow, PyTorch, etc). It runs the deep learning tasks inside a Flink operator, so that Flink can help establish a distributed environment, manage the resource, read/write the records and handle the failures.

Currently Deep Learning on Flink only supports TensorFlow.

For more details, please check the deep-learning-on-flink sub project.

Contact Us

For more information, you can join the Flink AI Flow Users Group on DingTalk to contact us. The number of the DingTalk group is 35876083.

You can also join the group by scanning the QR code below:

Alibaba

Alibaba Open Source

Versions

Version
0.2.1 Apr 23, 2020