org.supermind.crawl
Class LongPersister

java.lang.Object
  extended by org.supermind.crawl.util.MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>
      extended by org.supermind.crawl.util.LongPersister
Direct Known Subclasses:
MapFileScatterPurger
public class LongPersister
extends MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>

Saves Long values to a MapFile.

Field Summary
 
Fields inherited from class org.supermind.crawl.MapFilePersister
buffer, maxBufferSize, sorter, tmpWriter
 
Constructor Summary
LongPersister()
           
 
Method Summary
 void add(long value)
           
 boolean contains(long value)
           
protected  org.apache.nutch.io.WritableComparator getKeyComparator()
          Get comparator for MapFile key class.
 org.apache.nutch.io.WritableComparable getKeyInstance()
          Return a new instance of the key.
protected  java.lang.Class<? extends org.apache.nutch.io.WritableComparable> getMapFileKeyClass()
          Get key class.
 java.util.Comparator<java.lang.Long> getTypeComparator()
          Get comparator for type.
protected  void writeBufferToTmp()
          Write contents of buffer to tmpfile.
 
Methods inherited from class org.supermind.crawl.MapFilePersister
add, close, flushToDisk, getMapFileValueClass, getValueInstance, init, initTmpWriter, setMapdir, setNfs, setOverwrite, setTmpfile
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

LongPersister

public LongPersister()
Method Detail

add

public void add(long value)
         throws java.io.IOException
Throws:
java.io.IOException

contains

public boolean contains(long value)
                 throws java.io.IOException
Throws:
java.io.IOException

getKeyComparator

protected org.apache.nutch.io.WritableComparator getKeyComparator()
Description copied from class: MapFilePersister
Get comparator for MapFile key class.

Specified by:
getKeyComparator in class MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>
Returns:

getKeyInstance

public org.apache.nutch.io.WritableComparable getKeyInstance()
Description copied from class: MapFilePersister
Return a new instance of the key.

Specified by:
getKeyInstance in class MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>
Returns:

getMapFileKeyClass

protected java.lang.Class<? extends org.apache.nutch.io.WritableComparable> getMapFileKeyClass()
Description copied from class: MapFilePersister
Get key class.

Specified by:
getMapFileKeyClass in class MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>
Returns:

getTypeComparator

public java.util.Comparator<java.lang.Long> getTypeComparator()
Description copied from class: MapFilePersister
Get comparator for type.

Specified by:
getTypeComparator in class MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>
Returns:

writeBufferToTmp

protected void writeBufferToTmp()
                         throws java.io.IOException
Description copied from class: MapFilePersister
Write contents of buffer to tmpfile. Subclasses should use MapFilePersister.tmpWriter to do this.

Specified by:
writeBufferToTmp in class MapFilePersister<java.lang.Long,org.apache.nutch.io.NullWritable>
Throws:
java.io.IOException