K - The type of the keys.V - The type of the values.public class ReduceFeeder<K,V> extends Object
| Constructor and Description |
|---|
ReduceFeeder(org.apache.hadoop.conf.Configuration conf)
Constructor
|
| Modifier and Type | Method and Description |
|---|---|
List<KeyValueReuseList<K,V>> |
sortAndGroup(List<Pair<K,V>> mapOutputs)
This method takes the outputs from a mapper and return the
corresponding reducer input where keys have been sorted and
grouped according to their natural order.
|
List<KeyValueReuseList<K,V>> |
sortAndGroup(List<Pair<K,V>> mapOutputs,
Comparator<K> keyOrderAndGroupComparator)
This method takes the outputs from a mapper and return the
corresponding reducer input where keys have been sorted and
grouped according to given comparator.
|
List<KeyValueReuseList<K,V>> |
sortAndGroup(List<Pair<K,V>> mapOutputs,
Comparator<K> keyValueOrderComparator,
Comparator<K> keyGroupComparator)
This method takes the outputs from a mapper and return the
corresponding reducer input where keys have been sorted and
grouped according to given comparators.
|
List<KeyValueReuseList<K,V>> |
updateAll(List<Pair<K,List<V>>> inputs)
This method takes a list of (k, v*) and return a list of (k*, v*) where k have been duplicated.
|
KeyValueReuseList<K,V> |
updateInput(K key,
List<V> values)
This method takes a (k, v*) input and return a (k*, v*) where k have been duplicated.
|
KeyValueReuseList<K,V> |
updateInput(Pair<K,List<V>> input)
This method takes a (k, v*) input and return a (k*, v*) where k have been duplicated.
|
public ReduceFeeder(org.apache.hadoop.conf.Configuration conf)
conf - The driver's configuration.public List<KeyValueReuseList<K,V>> sortAndGroup(List<Pair<K,V>> mapOutputs, Comparator<K> keyValueOrderComparator, Comparator<K> keyGroupComparator)
mapOutputs - The outputs from mapperkeyValueOrderComparator - The comparator for ordering keys.keyGroupComparator - The comparator for grouping keyspublic List<KeyValueReuseList<K,V>> sortAndGroup(List<Pair<K,V>> mapOutputs, Comparator<K> keyOrderAndGroupComparator)
mapOutputs - The outputs from mapperkeyOrderAndGroupComparator - The comparator for grouping and ordering keyspublic List<KeyValueReuseList<K,V>> sortAndGroup(List<Pair<K,V>> mapOutputs)
mapOutputs - The outputs from mapperpublic List<KeyValueReuseList<K,V>> updateAll(List<Pair<K,List<V>>> inputs)
inputs - The list of key values pair with one key and multiples valuespublic KeyValueReuseList<K,V> updateInput(Pair<K,List<V>> input)
input - The key values pair with one key for multiple valuesCopyright © 2014 The Apache Software Foundation. All Rights Reserved.