genie-security


License

License

Categories

Categories

Net Security
GroupId

GroupId

com.netflix.genie
ArtifactId

ArtifactId

genie-security
Last Version

Last Version

4.0.0-rc.31
Release Date

Release Date

Type

Type

jar
Description

Description

genie-security
genie-security
Project URL

Project URL

https://github.com/Netflix/genie
Source Code Management

Source Code Management

https://github.com/Netflix/genie.git

Download genie-security

How to add to project

<!-- https://jarcasting.com/artifacts/com.netflix.genie/genie-security/ -->
<dependency>
    <groupId>com.netflix.genie</groupId>
    <artifactId>genie-security</artifactId>
    <version>4.0.0-rc.31</version>
</dependency>
// https://jarcasting.com/artifacts/com.netflix.genie/genie-security/
implementation 'com.netflix.genie:genie-security:4.0.0-rc.31'
// https://jarcasting.com/artifacts/com.netflix.genie/genie-security/
implementation ("com.netflix.genie:genie-security:4.0.0-rc.31")
'com.netflix.genie:genie-security:jar:4.0.0-rc.31'
<dependency org="com.netflix.genie" name="genie-security" rev="4.0.0-rc.31">
  <artifact name="genie-security" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.netflix.genie', module='genie-security', version='4.0.0-rc.31')
)
libraryDependencies += "com.netflix.genie" % "genie-security" % "4.0.0-rc.31"
[com.netflix.genie/genie-security "4.0.0-rc.31"]

Dependencies

compile (12)

Group / Artifact Type Version
org.springframework.session : spring-session-data-redis jar
com.netflix.genie : genie-common-internal jar 4.0.0-rc.31
com.netflix.genie : genie-web jar 4.0.0-rc.31
com.netflix.genie : genie-ui jar 4.0.0-rc.31
org.bitbucket.b_c : jose4j jar 0.6.3
org.springframework.boot : spring-boot-starter-data-redis jar 2.1.6.RELEASE
org.springframework.boot : spring-boot-starter-security jar 2.1.6.RELEASE
org.springframework.security : spring-security-jwt jar 1.0.10.RELEASE
org.springframework.security.extensions : spring-security-saml2-core jar 1.0.3.RELEASE
org.springframework.security.oauth : spring-security-oauth2 jar 2.3.5.RELEASE
org.springframework.security.oauth.boot : spring-security-oauth2-autoconfigure jar 2.1.6.RELEASE
org.springframework.session : spring-session-core jar 2.1.7.RELEASE

Project Modules

There are no modules declared in this project.

Genie

Download License Issues NetflixOSS Lifecycle

Introduction

Genie is a federated Big Data orchestration and execution engine developed by Netflix.

Genie’s value is best described in terms of the problem it solves.

Big Data infrastructure is complex and ever-evolving.

Data consumers (Data Scientists or other applications) need to jump over a lot of hurdles in order to run a simple query:

  • Find, download, install and configure a number of binaries, libraries and tools
  • Point to the correct cluster, using valid configuration and reasonable parameters, some of which are very obscure
  • Manually monitor the query, retrieve its output

What works today, may not work tomorrow. The cluster may have moved, the binaries may no longer be compatible, etc.

Multiply this overhead times the number of data consumers, and it adds up to a lot of wasted time (and grief!).

Data infrastructure providers face a different set of problems:

  • Users require a lot of help configuring their working setup, which is not easy to debug remotely
  • Infrastructure upgrades and expansion require careful coordination with all users

Genie is designed to sit at the boundary of these two worlds, and simplify the lives of people on either side.

A data scientist can “rub the magic lamp” and just say “Genie, run query ‘Q’ using engine SparkSQL against production data”. Genie takes care of all the nitty-gritty details. It dynamically assembles the necessary binaries and configurations, execute the job, monitors it, notifies the user of its completion, and makes the output data available for immediate and future use.

Providers of Big data infrastructure work with Genie by making resources available for use (clusters, binaries, etc) and plugging in the magic logic that the user doesn’t need to worry about: which cluster should a given query be routed to? Which version of spark should a given query be executed with? Is this user allowed to access this data? etc. Moreover, every job’s details are recorded for later audit or debugging.

Genie is designed from the ground up to be very flexible and customizable. For more details visit the official documentation

Builds

Genie builds are run on Travis CI here.

Branch Build Coverage (coveralls.io) Coverage (codecov.io)
master (4.0.x) Build Status Coverage Status codecov
3.3.x Build Status Coverage Status codecov

Project structure

genie-app

Self-contained Genie service server.

genie-agent-app

Self-contained Genie CLI job executor.

genie-client

Genie client interact with the service via REST API.

genie-web

The main server library, can be rewrapped to inject and override server components.

genie-agent

The main agent library, can be rewrapped to inject and override components.

genie-common, genie-common-internal, genie-common-external

Internal components libraries shared by server, agent, and client modules.

genie-proto

Protobuf messages and gRPC services definition shared by server and agent. This is not a public API meant for use by other clients.

genie-docs, genie-demo

Documentation and demo application.

genie-test, genie-test-web

Testing classes and utilities shared by other modules.

genie-ui

JavaScript UI to search and visualize jobs, clusters, commands.

Artifacts

Genie publishes to Bintray Maven and Docker Hub

Refer to the demo section of the documentations for examples. And to the setup section for more detailed instructions to set up Genie.

Python Client

The Genie Python client is hosted in a different repository.

Further info

For a detailed explanation of Genie architecture, use cases, API documentation, demos, deployment and customization guides, and more, visit the Genie documentation.

Contact

To contact Genie developers with questions and suggestions, please use GitHub Issues

com.netflix.genie

Netflix, Inc.

Netflix Open Source Platform

Versions

Version
4.0.0-rc.31
4.0.0-rc.30
4.0.0-rc.29
4.0.0-rc.28
4.0.0-rc.27
4.0.0-rc.26
4.0.0-rc.25
4.0.0-rc.24
4.0.0-rc.23
4.0.0-rc.22
4.0.0-rc.21
4.0.0-rc.20
4.0.0-rc.19
4.0.0-rc.18
4.0.0-rc.17
4.0.0-rc.16
4.0.0-rc.15
4.0.0-rc.14
4.0.0-rc.13
4.0.0-rc.12
4.0.0-rc.11
4.0.0-rc.10
4.0.0-rc.9
4.0.0-rc.8
4.0.0-rc.5
4.0.0-rc.4
4.0.0-rc.3
4.0.0-rc.2
4.0.0-rc.1