Maven S3 Wagon

This project is an implementation of a multi-threaded Wagon provider for accessing Amazon's Simple Storage Service (S3). It enables Maven to download files from and deploy files to S3. It draws heavily from code developed by Jeff Caddel at Kuali and Ben Hale at SpringSource

License

License

Categories

Categories

Maven Build Tools
GroupId

GroupId

com.github.nodely
ArtifactId

ArtifactId

maven-s3-wagon
Last Version

Last Version

1.0.0
Release Date

Release Date

Type

Type

jar
Description

Description

Maven S3 Wagon
This project is an implementation of a multi-threaded Wagon provider for accessing Amazon's Simple Storage Service (S3). It enables Maven to download files from and deploy files to S3. It draws heavily from code developed by Jeff Caddel at Kuali and Ben Hale at SpringSource
Project URL

Project URL

https://github.com/seahen/maven-s3-wagon
Source Code Management

Source Code Management

https://github.com/Nodely/maven-s3-wagon

Download maven-s3-wagon

How to add to project

<!-- https://jarcasting.com/artifacts/com.github.nodely/maven-s3-wagon/ -->
<dependency>
    <groupId>com.github.nodely</groupId>
    <artifactId>maven-s3-wagon</artifactId>
    <version>1.0.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.github.nodely/maven-s3-wagon/
implementation 'com.github.nodely:maven-s3-wagon:1.0.0'
// https://jarcasting.com/artifacts/com.github.nodely/maven-s3-wagon/
implementation ("com.github.nodely:maven-s3-wagon:1.0.0")
'com.github.nodely:maven-s3-wagon:jar:1.0.0'
<dependency org="com.github.nodely" name="maven-s3-wagon" rev="1.0.0">
  <artifact name="maven-s3-wagon" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.github.nodely', module='maven-s3-wagon', version='1.0.0')
)
libraryDependencies += "com.github.nodely" % "maven-s3-wagon" % "1.0.0"
[com.github.nodely/maven-s3-wagon "1.0.0"]

Dependencies

compile (9)

Group / Artifact Type Version
com.google.guava : guava jar 15.0
org.kuali.common : kuali-s3 jar 1.0.1
com.amazonaws : aws-java-sdk-s3 jar 1.11.487
org.apache.maven.wagon : wagon-provider-api jar 2.2
commons-io : commons-io jar 2.4
commons-lang : commons-lang jar 2.6
org.kuali.common : kuali-threads jar 1.0.10
org.slf4j : slf4j-log4j12 jar 1.7.5
org.slf4j : jcl-over-slf4j jar 1.7.5

test (1)

Group / Artifact Type Version
junit : junit jar 4.11

Project Modules

There are no modules declared in this project.

Build Status Maven Central javadoc.io license

Maven S3 Wagon

This wagon enables communication between Maven and Amazon S3.

pom's with a reference to this wagon can publish build artifacts (.jar's, .war's, etc) to S3.

When uploading the contents of a directory, API calls to S3 are multi-threaded.

This allows directories with a lot of content (eg when invoking mvn site-deploy) to be published very quickly

Check Maven Central for the latest version

This project is based on https://github.com/jcaddel/maven-s3-wagon/

Documentation

Usage

Configuring Maven to use the wagon is very simple.

You will need 3 things from Amazon:

  1. S3 bucket name - For example, the Kuali S3 bucket is called - maven.kuali.org
  2. AWS Access Key ID - eg - JKCAIZQRXJVCMWNYAZ2Q - for reference only, not a real id.
  3. AWS Secret Access Key - eg - aIKJN9sL9cu3GsHoti0mqcbH4NNLDCthsn0lms1x - for reference only, not a real secret key.

Once you have that information follow these 3 steps to configure Maven to use the wagon.

Add this to the build section of a pom:

<build>
  <extensions>
    <extension>
      <groupId>com.github.seahen</groupId>
      <artifactId>maven-s3-wagon</artifactId>
      <version>[S3 Wagon Version]</version>
   </extension>
  </extensions>
</build>

Add this to the distribution management section:

<distributionManagement>
  <site>
    <id>s3.site</id>
    <url>s3://[S3 Bucket Name]/site</url>
  </site>
  <repository>
    <id>s3.release</id>
    <url>s3://[S3 Bucket Name]/release</url>
  </repository>
  <snapshotRepository>
    <id>s3.snapshot</id>
    <url>s3://[S3 Bucket Name]/snapshot</url>
  </snapshotRepository>
</distributionManagement>

And setup one of the supported authentication techniques (see below)

If things are setup correctly, $ mvn deploy will produce output similar to this:

[INFO] --- maven-deploy-plugin:2.7:deploy (default-deploy) @ kuali-example ---
[INFO] Logged in - maven.kuali.org
Uploading: s3://maven.kuali.org/release/org/kuali/common/kuali-example/1.0.0/kuali-example-1.0.0.jar
[INFO] Logged off - maven.kuali.org
[INFO] Transfers: 1 Time: 2.921s Amount: 7.6M Throughput: 2.6 MB/s
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------

Authentication

The wagon supports 4 methods for authenticating with Amazon S3.

1 - System Properties: aws.accessKeyId + aws.secretKey

2 - Environment Variables: AWS_ACCESS_KEY_ID + AWS_SECRET_KEY

3 - Entries in ~/.m2/settings.xml

<servers>
  <server>
    <id>[repository id]</id>
    <username>[AWS Access Key ID]</username>
    <password>[AWS Secret Access Key]</password>
  </server>
</servers>

4 - The default AWS credential profiles file: typically located at ~/.aws/credentials (location can vary per platform), and shared by many of the AWS SDKs and by the AWS CLI.

5 - Amazon ECS container credentials: loaded from the Amazon ECS if the environment variable AWS_CONTAINER_CREDENTIALS_RELATIVE_URI is set.

6 - Instance profile credentials: used on EC2 instances, and delivered through the Amazon EC2 metadata service.

The priority used when searching for credentials is the same as the order listed on this page. For example, if a set of credentials is found in the system properties, the next three areas are never checked. If no credentials can be found, an exception is thrown.l

Permissions

Files are uploaded with no particular permission set by default (so they will take on the bucket default configuration), but that can be overridden through configuration.

Add <filePermissions> to the configuration for a server in ~/.m2/settings.xml to change the default. For example:

<server>
  <id>s3.snapshot</id>
  <filePermissions>AuthenticatedRead</filePermissions>
</server>

The allowed values for <filePermissions> are:

 Private
 PublicRead
 PublicReadWrite 
 AuthenticatedRead 
 LogDeliveryWrite
 BucketOwnerRead
 BucketOwnerFullControl

The javadoc for CannedAccessControlList has details on what each value means.

com.github.nodely

Nodely

Create your web site for free

Versions

Version
1.0.0