A C D F G I J L M N O P Q R S U V W

A

alignSliceEndToIndex(long, long) - Method in class com.hadoop.compression.lzo.LzoIndex

Nudge a given file slice end to the nearest LZO block end no earlier than the current slice end.

alignSliceStartToIndex(long, long) - Method in class com.hadoop.compression.lzo.LzoIndex

Nudge a given file slice start to the nearest LZO block start no earlier than the current slice start.

C

CChecksum - Enum in com.hadoop.compression.lzo

Checksums on compressed block data with header bitmask, Checksum class.

checkOutputSpecs(JobContext) - Method in class com.hadoop.mapreduce.LzoIndexOutputFormat

close() - Method in class com.hadoop.compression.lzo.LzopInputStream

close() - Method in class com.hadoop.compression.lzo.LzopOutputStream

Close the underlying stream and write a null word to the output stream.

close() - Method in class com.hadoop.mapred.DeprecatedLzoLineRecordReader

close(TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoIndexRecordWriter

close() - Method in class com.hadoop.mapreduce.LzoLineRecordReader

close() - Method in class com.hadoop.mapreduce.LzoSplitRecordReader

com.hadoop.compression.lzo - package com.hadoop.compression.lzo

com.hadoop.compression.lzo.util - package com.hadoop.compression.lzo.util

com.hadoop.mapred - package com.hadoop.mapred

com.hadoop.mapreduce - package com.hadoop.mapreduce

com.quicklz - package com.quicklz

CompatibilityUtil - Class in com.hadoop.compression.lzo.util

Provides a compatibility layer for handling API incompatibilities between hadoop 1.x and 2.x via reflection.

CompatibilityUtil() - Constructor for class com.hadoop.compression.lzo.util.CompatibilityUtil

compress() - Method in class com.hadoop.compression.lzo.LzopOutputStream

compress(byte[]) - Static method in class com.quicklz.QuickLZ

createCompressor() - Method in class com.hadoop.compression.lzo.LzoCodec

createDecompressor() - Method in class com.hadoop.compression.lzo.LzoCodec

createDecompressor() - Method in class com.hadoop.compression.lzo.LzopCodec

createIndex(FileSystem, Path) - Static method in class com.hadoop.compression.lzo.LzoIndex

Index an lzo file to allow the input format to split them into separate map jobs.

createIndexedOutputStream(OutputStream, DataOutputStream) - Method in class com.hadoop.compression.lzo.LzopCodec

createIndexedOutputStream(OutputStream, DataOutputStream, Compressor) - Method in class com.hadoop.compression.lzo.LzopCodec

createInputStream(InputStream) - Method in class com.hadoop.compression.lzo.LzoCodec

createInputStream(InputStream, Decompressor) - Method in class com.hadoop.compression.lzo.LzoCodec

createInputStream(InputStream, Decompressor) - Method in class com.hadoop.compression.lzo.LzopCodec

createInputStream(InputStream) - Method in class com.hadoop.compression.lzo.LzopCodec

createKey() - Method in class com.hadoop.mapred.DeprecatedLzoLineRecordReader

createOutputStream(OutputStream) - Method in class com.hadoop.compression.lzo.LzoCodec

createOutputStream(OutputStream, Compressor) - Method in class com.hadoop.compression.lzo.LzoCodec

createOutputStream(OutputStream) - Method in class com.hadoop.compression.lzo.LzopCodec

createOutputStream(OutputStream, Compressor) - Method in class com.hadoop.compression.lzo.LzopCodec

createOutputStream(OutputStream, Compressor) - Method in class org.apache.hadoop.io.compress.LzoCodec

Deprecated.

createRecordReader(InputSplit, TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoSplitInputFormat

createRecordReader(InputSplit, TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoTextInputFormat

createValue() - Method in class com.hadoop.mapred.DeprecatedLzoLineRecordReader

D

DChecksum - Enum in com.hadoop.compression.lzo

Checksums on decompressed block data with header bitmask, Checksum class.

decompress(byte[], int, int) - Method in class com.hadoop.compression.lzo.LzopDecompressor

decompress(byte[], int, int) - Method in class com.hadoop.compression.lzo.LzopInputStream

decompress(byte[]) - Static method in class com.quicklz.QuickLZ

DEFAULT_IGNORE_NONLZO - Static variable in class com.hadoop.compression.lzo.LzoInputFormatCommon

Default value of the lzo.text.input.format.ignore.nonlzo property.

DEFAULT_LZO_BUFFER_SIZE - Static variable in class com.hadoop.compression.lzo.LzoCodec

DEFAULT_LZO_EXTENSION - Static variable in class com.hadoop.compression.lzo.LzopCodec

DeprecatedLzoLineRecordReader - Class in com.hadoop.mapred

DeprecatedLzoTextInputFormat - Class in com.hadoop.mapred

This class conforms to the old (org.apache.hadoop.mapred.*) hadoop API style which is deprecated but still required in places.

DeprecatedLzoTextInputFormat() - Constructor for class com.hadoop.mapred.DeprecatedLzoTextInputFormat

DistributedLzoIndexer - Class in com.hadoop.compression.lzo

DistributedLzoIndexer() - Constructor for class com.hadoop.compression.lzo.DistributedLzoIndexer

F

findNextPosition(long) - Method in class com.hadoop.compression.lzo.LzoIndex

Find the next lzo block start from the given position.

finish() - Method in class com.hadoop.compression.lzo.LzopOutputStream

FULL_LZO_INDEX_SUFFIX - Static variable in class com.hadoop.compression.lzo.LzoInputFormatCommon

Full extension for LZO index files (".lzo.index").

G

getChecksumClass() - Method in enum com.hadoop.compression.lzo.CChecksum

getChecksumClass() - Method in enum com.hadoop.compression.lzo.DChecksum

getChecksumsCount() - Method in class com.hadoop.compression.lzo.LzopDecompressor

Get the number of checksum implementations the current lzo file uses.

getCompressedBytesRead() - Method in class com.hadoop.compression.lzo.LzopInputStream

getCompressedChecksumsCount() - Method in class com.hadoop.compression.lzo.LzopDecompressor

Get the number of compressed checksum implementations the current lzo file uses.

getCompressedData() - Method in class com.hadoop.compression.lzo.LzopInputStream

Read checksums and feed compressed block data into decompressor.

getCompressorType() - Method in class com.hadoop.compression.lzo.LzoCodec

getConf() - Method in class com.hadoop.compression.lzo.LzoCodec

getConfiguration(JobContext) - Static method in class com.hadoop.compression.lzo.util.CompatibilityUtil

Invokes getConfiguration() on JobContext.

getCounter(TaskInputOutputContext, Enum<?>) - Static method in class com.hadoop.compression.lzo.util.CompatibilityUtil

Invoke getCounter() on TaskInputOutputContext.

getCounterValue(Counter) - Static method in class com.hadoop.compression.lzo.util.CompatibilityUtil

Hadoop 1 and 2 compatible counter.getValue()

getCurrentKey() - Method in class com.hadoop.mapreduce.LzoLineRecordReader

getCurrentKey() - Method in class com.hadoop.mapreduce.LzoSplitRecordReader

getCurrentValue() - Method in class com.hadoop.mapreduce.LzoLineRecordReader

getCurrentValue() - Method in class com.hadoop.mapreduce.LzoSplitRecordReader

getDecompressedChecksumsCount() - Method in class com.hadoop.compression.lzo.LzopDecompressor

Get the number of decompressed checksum implementations the current lzo file uses.

getDecompressorType() - Method in class com.hadoop.compression.lzo.LzoCodec

getDecompressorType() - Method in class com.hadoop.compression.lzo.LzopCodec

getDefaultExtension() - Method in class com.hadoop.compression.lzo.LzoCodec

Get the default filename extension for this kind of compression.

getDefaultExtension() - Method in class com.hadoop.compression.lzo.LzopCodec

getHeaderMask() - Method in enum com.hadoop.compression.lzo.CChecksum

getHeaderMask() - Method in enum com.hadoop.compression.lzo.DChecksum

getIgnoreNonLzoProperty(Configuration) - Static method in class com.hadoop.compression.lzo.LzoInputFormatCommon

getNumberOfBlocks() - Method in class com.hadoop.compression.lzo.LzoIndex

Get the total number of blocks in the index file.

getOutputCommitter(TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoIndexOutputFormat

getPos() - Method in class com.hadoop.mapred.DeprecatedLzoLineRecordReader

getPos() - Method in class com.hadoop.mapreduce.LzoLineRecordReader

getPosition(int) - Method in class com.hadoop.compression.lzo.LzoIndex

Get the block offset for a given block.

getProgress() - Method in class com.hadoop.mapred.DeprecatedLzoLineRecordReader

getProgress() - Method in class com.hadoop.mapreduce.LzoLineRecordReader

Get the progress within the split.

getProgress() - Method in class com.hadoop.mapreduce.LzoSplitRecordReader

getRecordReader(InputSplit, JobConf, Reporter) - Method in class com.hadoop.mapred.DeprecatedLzoTextInputFormat

getRecordWriter(TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoIndexOutputFormat

getRevisionHash() - Static method in class com.hadoop.compression.lzo.LzoCodec

getSplits(JobConf, int) - Method in class com.hadoop.mapred.DeprecatedLzoTextInputFormat

getSplits(JobContext) - Method in class com.hadoop.mapreduce.LzoTextInputFormat

GPLNativeCodeLoader - Class in com.hadoop.compression.lzo

GPLNativeCodeLoader() - Constructor for class com.hadoop.compression.lzo.GPLNativeCodeLoader

I

IGNORE_NONLZO_KEY - Static variable in class com.hadoop.compression.lzo.LzoInputFormatCommon

The boolean property lzo.text.input.format.ignore.nonlzo tells the LZO text input format whether it should silently ignore non-LZO input files.

incrementCounter(Counter, long) - Static method in class com.hadoop.compression.lzo.util.CompatibilityUtil

Increment the counter.

index(Path) - Method in class com.hadoop.compression.lzo.LzoIndexer

Index the file given by lzoUri in its default filesystem.

indexOut - Variable in class com.hadoop.compression.lzo.LzopOutputStream

initHeaderFlags(EnumSet<DChecksum>, EnumSet<CChecksum>) - Method in class com.hadoop.compression.lzo.LzopDecompressor

Given a set of decompressed and compressed checksums,

initialize(InputSplit, TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoLineRecordReader

initialize(InputSplit, TaskAttemptContext) - Method in class com.hadoop.mapreduce.LzoSplitRecordReader

isEmpty() - Method in class com.hadoop.compression.lzo.LzoIndex

Return true if the index has no blocks set.

isLzoFile(String) - Static method in class com.hadoop.compression.lzo.LzoInputFormatCommon

Checks if the given filename ends in ".lzo".

isLzoIndexFile(String) - Static method in class com.hadoop.compression.lzo.LzoInputFormatCommon

Checks if the given filename ends in ".lzo.index".

isNativeCodeLoaded() - Static method in class com.hadoop.compression.lzo.GPLNativeCodeLoader

Are the native gpl libraries loaded?

isNativeLzoLoaded(Configuration) - Static method in class com.hadoop.compression.lzo.LzoCodec

Check if native-lzo library is loaded and initialized.

isSplitable(FileSystem, Path) - Method in class com.hadoop.mapred.DeprecatedLzoTextInputFormat

isSplitable(JobContext, Path) - Method in class com.hadoop.mapreduce.LzoSplitInputFormat

isSplitable(JobContext, Path) - Method in class com.hadoop.mapreduce.LzoTextInputFormat

isVersion2x() - Static method in class com.hadoop.compression.lzo.util.CompatibilityUtil

Returns true whether the runtime hadoop version is 2.x, false otherwise.

J

JOB_NAME_KEY - Static variable in class com.hadoop.compression.lzo.DistributedLzoIndexer

Override the default job name which is generated from the arguments.

JOB_NAME_MAX_LENGTH_KEY - Static variable in class com.hadoop.compression.lzo.DistributedLzoIndexer

Override the default length to which the job name will be truncated.

L

LIBRARY_NAME - Static variable in class com.hadoop.compression.lzo.GPLNativeCodeLoader

listStatus(JobConf) - Method in class com.hadoop.mapred.DeprecatedLzoTextInputFormat

listStatus(JobContext) - Method in class com.hadoop.mapreduce.LzoTextInputFormat

LZO_BUFFER_SIZE_KEY - Static variable in class com.hadoop.compression.lzo.LzoCodec

LZO_COMPRESSION_LEVEL_KEY - Static variable in class com.hadoop.compression.lzo.LzoCodec

LZO_COMPRESSOR_KEY - Static variable in class com.hadoop.compression.lzo.LzoCodec

LZO_DECOMPRESSOR_KEY - Static variable in class com.hadoop.compression.lzo.LzoCodec

LZO_INDEX_SUFFIX - Static variable in class com.hadoop.compression.lzo.LzoIndex

LZO_MAGIC - Static variable in class com.hadoop.compression.lzo.LzopCodec

9 bytes at the top of every lzo file

LZO_TMP_INDEX_SUFFIX - Static variable in class com.hadoop.compression.lzo.LzoIndex

LzoCodec - Class in com.hadoop.compression.lzo

A CompressionCodec for a streaming lzo compression/decompression pair.

LzoCodec() - Constructor for class com.hadoop.compression.lzo.LzoCodec

LzoCodec - Class in org.apache.hadoop.io.compress

Deprecated.

LzoCodec() - Constructor for class org.apache.hadoop.io.compress.LzoCodec

Deprecated.

LzoIndex - Class in com.hadoop.compression.lzo

Represents the lzo index.

LzoIndex() - Constructor for class com.hadoop.compression.lzo.LzoIndex

Create an empty index, typically indicating no index file exists.

LzoIndex(int) - Constructor for class com.hadoop.compression.lzo.LzoIndex

Create an index specifying the number of LZO blocks in the file.

LzoIndexer - Class in com.hadoop.compression.lzo

LzoIndexer(Configuration) - Constructor for class com.hadoop.compression.lzo.LzoIndexer

LzoIndexOutputFormat - Class in com.hadoop.mapreduce

LzoIndexOutputFormat() - Constructor for class com.hadoop.mapreduce.LzoIndexOutputFormat

LzoIndexRecordWriter - Class in com.hadoop.mapreduce

LzoIndexRecordWriter(TaskAttemptContext) - Constructor for class com.hadoop.mapreduce.LzoIndexRecordWriter

LzoInputFormatCommon - Class in com.hadoop.compression.lzo

Utilities used by the two LzoInputFormat implementations.

LzoInputFormatCommon() - Constructor for class com.hadoop.compression.lzo.LzoInputFormatCommon

LzoLineRecordReader - Class in com.hadoop.mapreduce

Reads line from an lzo compressed text file.

LzoLineRecordReader() - Constructor for class com.hadoop.mapreduce.LzoLineRecordReader

LZOP_COMPAT_VERSION - Static variable in class com.hadoop.compression.lzo.LzopCodec

Latest verion of lzop this should be compatible with

LZOP_VERSION - Static variable in class com.hadoop.compression.lzo.LzopCodec

Version of lzop this emulates

LzopCodec - Class in com.hadoop.compression.lzo

A CompressionCodec for a streaming lzo compression/decompression pair compatible with lzop.

LzopCodec() - Constructor for class com.hadoop.compression.lzo.LzopCodec

LzopDecompressor - Class in com.hadoop.compression.lzo

LzopDecompressor(int) - Constructor for class com.hadoop.compression.lzo.LzopDecompressor

Create an LzoDecompressor with LZO1X strategy (the only lzo algorithm supported by lzop).

LzopInputStream - Class in com.hadoop.compression.lzo

LzopInputStream(InputStream, Decompressor, int) - Constructor for class com.hadoop.compression.lzo.LzopInputStream

LzopOutputStream - Class in com.hadoop.compression.lzo

LzopOutputStream(OutputStream, Compressor, int, LzoCompressor.CompressionStrategy) - Constructor for class com.hadoop.compression.lzo.LzopOutputStream

LzopOutputStream(OutputStream, DataOutputStream, Compressor, int, LzoCompressor.CompressionStrategy) - Constructor for class com.hadoop.compression.lzo.LzopOutputStream

LzoSplitInputFormat - Class in com.hadoop.mapreduce

LzoSplitInputFormat() - Constructor for class com.hadoop.mapreduce.LzoSplitInputFormat

LzoSplitRecordReader - Class in com.hadoop.mapreduce

LzoSplitRecordReader() - Constructor for class com.hadoop.mapreduce.LzoSplitRecordReader

LzoSplitRecordReader.Counters - Enum in com.hadoop.mapreduce

LzoTextInputFormat - Class in com.hadoop.mapreduce

An InputFormat for lzop compressed text files.

LzoTextInputFormat() - Constructor for class com.hadoop.mapreduce.LzoTextInputFormat

M

main(String[]) - Static method in class com.hadoop.compression.lzo.DistributedLzoIndexer

main(String[]) - Static method in class com.hadoop.compression.lzo.LzoIndexer

Run the LzoIndexer on each argument passed via stdin.

MAX_BLOCK_SIZE - Static variable in class com.hadoop.compression.lzo.LzoCodec

N

newTaskAttemptContext(Configuration, TaskAttemptID) - Static method in class com.hadoop.compression.lzo.util.CompatibilityUtil

Creates TaskAttempContext from a JobConf and jobId using the correct constructor for based on the hadoop version.

next(LongWritable, Text) - Method in class com.hadoop.mapred.DeprecatedLzoLineRecordReader

nextKeyValue() - Method in class com.hadoop.mapreduce.LzoLineRecordReader

nextKeyValue() - Method in class com.hadoop.mapreduce.LzoSplitRecordReader

NOT_FOUND - Static variable in class com.hadoop.compression.lzo.LzoIndex

O

org.apache.hadoop.io.compress - package org.apache.hadoop.io.compress

P

printUsage() - Static method in class com.hadoop.compression.lzo.DistributedLzoIndexer

printUsage() - Static method in class com.hadoop.compression.lzo.LzoIndexer

Q

QLZ_COMPRESSION_LEVEL - Variable in class com.quicklz.QuickLZ

QLZ_MEMORY_SAFE - Variable in class com.quicklz.QuickLZ

QLZ_STREAMING_BUFFER - Variable in class com.quicklz.QuickLZ

QLZ_VERSION_MAJOR - Variable in class com.quicklz.QuickLZ

QLZ_VERSION_MINOR - Variable in class com.quicklz.QuickLZ

QLZ_VERSION_REVISION - Variable in class com.quicklz.QuickLZ

QuickLZ - Class in com.quicklz

QuickLZ() - Constructor for class com.quicklz.QuickLZ

R

readHeader(InputStream) - Method in class com.hadoop.compression.lzo.LzopInputStream

Read and verify an lzo header, setting relevant block checksum options and ignoring most everything else.

readIndex(FileSystem, Path) - Static method in class com.hadoop.compression.lzo.LzoIndex

Read the index of the lzo file.

resetChecksum() - Method in class com.hadoop.compression.lzo.LzopDecompressor

Reset all checksums registered for this decompressor instance.

run(String[]) - Method in class com.hadoop.compression.lzo.DistributedLzoIndexer

S

set(int, long) - Method in class com.hadoop.compression.lzo.LzoIndex

Set the position for the block.

setBufferSize(Configuration, int) - Static method in class com.hadoop.compression.lzo.LzoCodec

setCompressionLevel(Configuration, int) - Static method in class com.hadoop.compression.lzo.LzoCodec

setCompressionStrategy(Configuration, LzoCompressor.CompressionStrategy) - Static method in class com.hadoop.compression.lzo.LzoCodec

setConf(Configuration) - Method in class com.hadoop.compression.lzo.LzoCodec

setDecompressionStrategy(Configuration, LzoDecompressor.CompressionStrategy) - Static method in class com.hadoop.compression.lzo.LzoCodec

setInput(byte[], int, int) - Method in class com.hadoop.compression.lzo.LzopDecompressor

sizeCompressed(byte[]) - Static method in class com.quicklz.QuickLZ

sizeDecompressed(byte[]) - Static method in class com.quicklz.QuickLZ

U

UNDEFINED_COMPRESSION_LEVEL - Static variable in class com.hadoop.compression.lzo.LzoCodec

USE_BINARIES_ON_LIB_PATH - Static variable in class com.hadoop.compression.lzo.GPLNativeCodeLoader

The system property that causes hadoop-lzo to ignore the embedded native library and load it from the normal library path instead.

V

valueOf(String) - Static method in enum com.hadoop.compression.lzo.CChecksum

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.hadoop.compression.lzo.DChecksum

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.hadoop.mapreduce.LzoSplitRecordReader.Counters

Returns the enum constant of this type with the specified name.

values() - Static method in enum com.hadoop.compression.lzo.CChecksum

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.hadoop.compression.lzo.DChecksum

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.hadoop.mapreduce.LzoSplitRecordReader.Counters

Returns an array containing the constants of this enum type, in the order they are declared.

verifyCChecksum(CChecksum, int) - Method in class com.hadoop.compression.lzo.LzopDecompressor

Given a checksum type, verity its value against that observed in compressed data.

verifyDChecksum(DChecksum, int) - Method in class com.hadoop.compression.lzo.LzopDecompressor

Given a checksum type, verify its value against that observed in decompressed data.

W

write(byte[], int, int) - Method in class com.hadoop.compression.lzo.LzopOutputStream

write(Path, LongWritable) - Method in class com.hadoop.mapreduce.LzoIndexRecordWriter

writeLzopHeader(OutputStream, LzoCompressor.CompressionStrategy, int) - Static method in class com.hadoop.compression.lzo.LzopOutputStream

Write an lzop-compatible header to the OutputStream provided.

A C D F G I J L M N O P Q R S U V W