cascading.tap.hadoop
Class MultiInputFormat

java.lang.Object
  cascading.tap.hadoop.MultiInputFormat

public class MultiInputFormat
extends Object

Class MultiInputFormat accepts multiple InputFormat class declarations allowing a single MR job to read data from incompatible file types.

Constructor Summary

MultiInputFormat()

Method Summary

static void	addInputFormat(JobConf toJob, JobConf... fromJobs) Used to set the current JobConf with all sub jobs configurations.
RecordReader	getRecordReader(InputSplit split, JobConf job, Reporter reporter) Method getRecordReader delegates to the appropriate InputFormat.
InputSplit[]	getSplits(JobConf job, int numSplits) Method getSplits delegates to the appropriate InputFormat.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiInputFormat

public MultiInputFormat()

Method Detail

addInputFormat

public static void addInputFormat(JobConf toJob,
                                  JobConf... fromJobs)

Used to set the current JobConf with all sub jobs configurations.

Parameters:

toJob -

fromJobs -

getSplits

public InputSplit[] getSplits(JobConf job,
                              int numSplits)
                       throws IOException

Method getSplits delegates to the appropriate InputFormat.

Parameters:

job - of type JobConf

numSplits - of type int

Returns:

InputSplit[]

Throws:

IOException - when

getRecordReader

public RecordReader getRecordReader(InputSplit split,
                                    JobConf job,
                                    Reporter reporter)
                             throws IOException

Method getRecordReader delegates to the appropriate InputFormat.

Parameters:

split - of type InputSplit

job - of type JobConf

reporter - of type Reporter

Returns:

RecordReader

Throws:

IOException - when