action

HDFS browser

License

License

Categories

Categories

Metrics Application Testing & Monitoring Monitoring
GroupId

GroupId

com.ning
ArtifactId

ArtifactId

metrics.action
Last Version

Last Version

0.2.16
Release Date

Release Date

Type

Type

war
Description

Description

action
HDFS browser
Project URL

Project URL

http://github.com/pierre/action-core
Project Organization

Project Organization

Ning, Inc.
Source Code Management

Source Code Management

http://github.com/pierre/action-core/tree/master

Download metrics.action

How to add to project

<!-- https://jarcasting.com/artifacts/com.ning/metrics.action/ -->
<dependency>
    <groupId>com.ning</groupId>
    <artifactId>metrics.action</artifactId>
    <version>0.2.16</version>
    <type>war</type>
</dependency>
// https://jarcasting.com/artifacts/com.ning/metrics.action/
implementation 'com.ning:metrics.action:0.2.16'
// https://jarcasting.com/artifacts/com.ning/metrics.action/
implementation ("com.ning:metrics.action:0.2.16")
'com.ning:metrics.action:war:0.2.16'
<dependency org="com.ning" name="metrics.action" rev="0.2.16">
  <artifact name="metrics.action" type="war" />
</dependency>
@Grapes(
@Grab(group='com.ning', module='metrics.action', version='0.2.16')
)
libraryDependencies += "com.ning" % "metrics.action" % "0.2.16"
[com.ning/metrics.action "0.2.16"]

Dependencies

compile (23)

Group / Artifact Type Version
commons-codec : commons-codec jar 1.5
commons-lang : commons-lang jar 2.6
com.google.inject : guice jar 3.0
com.google.inject.extensions : guice-multibindings jar 3.0
com.google.inject.extensions : guice-servlet jar 3.0
com.google.guava : guava jar 10.0.1
com.ning : compress-lzf jar 0.8.6
com.ning : metrics.goodwill-access jar 0.1.7
com.ning : metrics.serialization-common jar 2.0.4
com.ning : metrics.serialization-hadoop jar 2.0.4
com.ning : metrics.serialization-smile jar 2.0.4
com.ning : metrics.serialization-thrift jar 2.0.4
com.ning.arecibo : arecibo-jmx jar 1.0.3
com.ning.arecibo : arecibo-metrics jar 1.0.1
com.ning.jetty : ning-service-skeleton-base jar 0.0.18
com.sun.jersey : jersey-server jar 1.10
com.yammer.metrics : metrics-guice jar 2.0.0-BETA17
joda-time : joda-time jar 2.0
org.apache.hadoop : hadoop-core jar 0.20.2-cdh3u0
org.codehaus.jackson : jackson-core-asl jar 1.9.2
org.codehaus.jackson : jackson-jaxrs jar 1.9.2
org.codehaus.jackson : jackson-mapper-asl jar 1.9.2
org.skife.config : config-magic jar 0.9

provided (3)

Group / Artifact Type Version
org.eclipse.jetty : jetty-servlet jar 8.0.4.v20111024
javax.servlet : javax.servlet-api jar 3.0.1
org.slf4j : slf4j-api jar 1.6.3

test (2)

Group / Artifact Type Version
org.slf4j : slf4j-simple jar 1.6.3
org.testng : testng jar 6.3

Project Modules

There are no modules declared in this project.

Action core

The Action core exposes HDFS over HTTP. It provides a REST interface as well as a browsing UI. Unlike the browser shipped with the Hadoop namenode, it integrates a de-serialization mechanism to read files content.

More detailed documentation can be found here.

Download

war artifacts can be found at Maven Central.

Build

mvn install

Configuration options

See ActionCoreConfig.java for configuration options.

Run

mvn -Daction.hadoop.namenode.url=hdfs://namenode.company.com:9000 jetty:run

You can now browse HDFS:

http://127.0.0.1:8080/rest/1.0/hdfs?path=/

Query parameters

  • path: path to open in HDFS

  • range: when opening a file, bucket of lines to display (e.g. range=1-50 for the first 51 lines)

  • raw: whether to display the nice, HTML version (raw=true) or plain text (raw=false)

  • recursive: whether to craw a directory recursively. If you want to download all content under /user/pierre:

    curl 'http://127.0.0.1:8080/rest/1.0/hdfs?path=/user/pierre&recursive=true&raw=true'
    

Notes on serialization

You can specify your custom Hadoop serialization classes (which implement org.apache.hadoop.io.serializer.Serialization<T>) on the command line (make sure to escape the comma):

-Daction.hadoop.io.serializations=com.company.HadoopSecretSerialization\,org.apache.hadoop.io.serializer.WritableSerialization

You can also implement custom renderers, see the documentation for more details.

Documenting schemas

When clicking on a row, an exploded content of the row is show as JSON. By default, each column is labeled as “Field_…”. This can be overridden by implementing the Registrar interface.

The Action core supports out of the box Goodwill (see github.com/pierre/goodwill) which is an HTTP based type registrar.

License (see COPYING file for full license)

Copyright 2010-2012 Ning

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Versions

Version
0.2.16
0.2.15
0.2.14
0.2.12
0.2.11
0.2.10
0.2.9
0.2.8
0.2.7
0.2.6
0.2.5
0.2.4
0.2.3
0.2.2
0.2.1
0.2.0
0.1.6
0.1.5
0.1.4
0.1.3
0.1.2
0.1.1
0.1.0-cdh
0.1.0
0.0.8
0.0.7
0.0.6
0.0.5