s3-transload

A module that pipe network file into AWS S3. Recommended to use with node 6+, as it is using some ES6 feature.

What this module do?

• GET a file from the provide url and stream to S3

Example

const AWS = require("aws-sdk");
const s3Transload = require("s3-transload");

// setup S3 credential
var credentials = new AWS.SharedIniFileCredentials({profile: 'your-profile'});
AWS.config.credentials = credentials;

const s3 = new AWS.S3({
  apiVersion: "2006-03-01"
});

const { urlToS3 } = s3Transload(s3);
const util = require("util");
const urlToS3Promise = util.promisify(urlToS3);

urlToS3Promise("http://path/to/the/resource", {
  Bucket: "your-bucket-name",
  Key: "your-item-key"
}).then(result => {
  console.log(result);
});

Note

How To setup AWS credential

Under the hood

• It use request to create stream, and pipe it into s3 upload.
• It will stop and return error if HTTP status code not equal to 200.
• This module is inspire by this SO and this SO