ghdfs

License	Apache-2.0
Categories	Data
GroupId	com.globo.bigdata
ArtifactId	ghdfs_2.11
Last Version	0.0.13
Release Date	Nov 23, 2018
Type	jar
Description	ghdfs ghdfs
Project URL	https://github.com/globocom/ghdfs
Project Organization	Globo.com
Source Code Management	https://github.com/globocom/ghdfs

Download ghdfs_2.11

Filename	Size
ghdfs_2.11-0.0.13.pom
ghdfs_2.11-0.0.13.jar	14 KB
ghdfs_2.11-0.0.13-sources.jar	2 KB
ghdfs_2.11-0.0.13-javadoc.jar	365 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.globo.bigdata/ghdfs_2.11/ -->
<dependency>
    <groupId>com.globo.bigdata</groupId>
    <artifactId>ghdfs_2.11</artifactId>
    <version>0.0.13</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.globo.bigdata/ghdfs_2.11/
implementation 'com.globo.bigdata:ghdfs_2.11:0.0.13'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.globo.bigdata/ghdfs_2.11/
implementation ("com.globo.bigdata:ghdfs_2.11:0.0.13")

Apache Buildr

'com.globo.bigdata:ghdfs_2.11:jar:0.0.13'

Apache Ivy

<dependency org="com.globo.bigdata" name="ghdfs_2.11" rev="0.0.13">
  <artifact name="ghdfs_2.11" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.globo.bigdata', module='ghdfs_2.11', version='0.0.13')
)

Scala SBT

libraryDependencies += "com.globo.bigdata" % "ghdfs_2.11" % "0.0.13"

Leiningen

[com.globo.bigdata/ghdfs_2.11 "0.0.13"]

Dependencies

compile (3)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.11
com.sksamuel.scapegoat : scalac-scapegoat-plugin_2.11	jar	1.3.2
org.apache.hadoop : hadoop-client	jar	[2.7.3,2.9.9]

test (2)

Group / Artifact	Type	Version
org.scalatest : scalatest_2.11	jar	3.0.1
org.scalamock : scalamock-scalatest-support_2.11	jar	3.6.0

Project Modules

There are no modules declared in this project.

GHDFS

Works with HDFS for common operations and Scala compatibility.

Installation

Package is under com.globo.bigdata.ghdfs

• Include in your dependencies:

    "com.globo.bigdata" %% "ghdfs" % "0.0.13"

Usage

    val hdfs = HdfsManager(Properties.envOrNone("HADOOP_CONF_DIR"))
    
    hdfs.write(Path)
    
    hdfs.write(Path, InputStream)

    hdfs.read(Path)
    
    hdfs.status(Path)
    
    hdfs.move(Path, Path)
    
    hdfs.listFiles(Path, recursive = false).foreach(...)
    
    hdfs.delete(Path, recursive = true)

    etc...

Get Filesystem Instance

    hdfs.getFS.exists(hadoopPath)

Contribute

For development and contributing, please follow Contributing Guide and ALWAYS respect the Code of Conduct

Globo.com

Versions

Version
0.0.13 Nov 23, 2018
0.0.12 Nov 19, 2018