cascading.tap
Class S3fs

java.lang.Object
  cascading.tap.Tap
      cascading.tap.Hfs
          cascading.tap.S3fs

All Implemented Interfaces:

FlowElement, Serializable

public class S3fs
extends Hfs

Class S3fs is a Tap class that provides access to the Amazon S3 storage system.

An Amazon AWS id, secret key, and a S3 bucket name are required.

See Also:

Serialized Form

Field Summary

static String	S3FS_BUCKET Field S3FS_BUCKET is the property key for the S3 bucket
static String	S3FS_ID Field S3FS_ID is the property key for the S3 id
static String	S3FS_SECRET Field S3FS_SECRET is the property key for the S3 secret

Constructor Summary

S3fs(Fields sourceFields, String stringPath)
Constructor S3fs creates a new S3fs instance.

S3fs(Fields sourceFields, String id, String secret, String bucket, String stringPath)
Constructor S3fs creates a new S3fs instance.

S3fs(Fields sourceFields, URI uri)
Constructor S3fs creates a new S3fs instance.

S3fs(Fields sourceFields, URI uri, boolean replace)
Constructor S3fs creates a new S3fs instance.

S3fs(Scheme scheme, String stringPath)
Constructor S3fs creates a new S3fs instance.

S3fs(Scheme scheme, String stringPath, boolean replace)
Constructor S3fs creates a new S3fs instance.

S3fs(Scheme scheme, String id, String secret, String bucket, String stringPath)
Constructor S3fs creates a new S3fs instance.

S3fs(Scheme scheme, String id, String secret, String bucket, String stringPath, boolean replace)
Constructor S3fs creates a new S3fs instance.

S3fs(Scheme scheme, URI uri)
Constructor S3fs creates a new S3fs instance.

Method Summary

protected URI	makeURIScheme(JobConf jobConf)
protected void	setStringPath(String stringPath)

Methods inherited from class cascading.tap.Hfs

deletePath, equals, getDefaultFileSystem, getFileSystem, getPath, getPathModified, getQualifiedPath, getTemporaryDirectory, getTempPath, getURIScheme, hashCode, isUseTapCollector, makeDirs, makeTemporaryPathDir, openForRead, openForWrite, pathExists, setTemporaryDirectory, setUriScheme, sinkInit, sourceInit, toString

Methods inherited from class cascading.tap.Tap

flowInit, getScheme, getSinkFields, getSourceFields, isAppend, isKeep, isReplace, isSink, isSource, outgoingScopeFor, resolveFields, resolveIncomingOperationFields, setScheme, setUseTapCollector, sink, source, taps

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

S3FS_ID

public static final String S3FS_ID

Field S3FS_ID is the property key for the S3 id

See Also:

Constant Field Values

S3FS_SECRET

public static final String S3FS_SECRET

Field S3FS_SECRET is the property key for the S3 secret

See Also:

Constant Field Values

S3FS_BUCKET

public static final String S3FS_BUCKET

Field S3FS_BUCKET is the property key for the S3 bucket

See Also:

Constant Field Values

Constructor Detail

S3fs

public S3fs(Fields sourceFields,
            URI uri)

Constructor S3fs creates a new S3fs instance.

Parameters:

sourceFields - of type Fields

uri - of type URI

S3fs

public S3fs(Fields sourceFields,
            URI uri,
            boolean replace)

Constructor S3fs creates a new S3fs instance.

Parameters:

sourceFields - of type Fields

uri - of type URI

replace - of type boolean

S3fs

public S3fs(Fields sourceFields,
            String stringPath)

Constructor S3fs creates a new S3fs instance.

Parameters:

sourceFields - of type Fields

stringPath - of type String

S3fs

public S3fs(Fields sourceFields,
            String id,
            String secret,
            String bucket,
            String stringPath)

Constructor S3fs creates a new S3fs instance.

Parameters:

sourceFields - of type Fields

id - of type String

secret - of type String

bucket - of type String

stringPath - of type String

S3fs

public S3fs(Scheme scheme,
            String id,
            String secret,
            String bucket,
            String stringPath)

Constructor S3fs creates a new S3fs instance.

Parameters:

scheme - of type Scheme

id - of type String

secret - of type String

bucket - of type String

stringPath - of type String

S3fs

public S3fs(Scheme scheme,
            URI uri)

Constructor S3fs creates a new S3fs instance.

Parameters:

scheme - of type Scheme

uri - of type URI

S3fs

public S3fs(Scheme scheme,
            String stringPath)

Constructor S3fs creates a new S3fs instance.

Parameters:

scheme - of type Scheme

stringPath - of type String

S3fs

public S3fs(Scheme scheme,
            String id,
            String secret,
            String bucket,
            String stringPath,
            boolean replace)

Constructor S3fs creates a new S3fs instance.

Parameters:

scheme - of type Scheme

id - of type String

secret - of type String

bucket - of type String

stringPath - of type String

replace - of type boolean

S3fs

public S3fs(Scheme scheme,
            String stringPath,
            boolean replace)

Constructor S3fs creates a new S3fs instance.

Parameters:

scheme - of type Scheme

stringPath - of type String

replace - of type boolean

Method Detail

setStringPath

protected void setStringPath(String stringPath)

Overrides:

setStringPath in class Hfs

makeURIScheme

protected URI makeURIScheme(JobConf jobConf)
                     throws IOException

Overrides:

makeURIScheme in class Hfs

Throws:

IOException