org.apache.lucene.codecs.simpletext

Class SimpleTextBKDReader

java.lang.Object

org.apache.lucene.index.PointValues

org.apache.lucene.codecs.simpletext.SimpleTextBKDReader

All Implemented Interfaces:

Accountable

final class SimpleTextBKDReader
extends PointValues
implements Accountable

Forked from BKDReader and simplified/specialized for SimpleText's usage

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SimpleTextBKDReader.IntersectState Used to track all state for a single call to intersect(org.apache.lucene.index.PointValues.IntersectVisitor).

Nested classes/interfaces inherited from class org.apache.lucene.index.PointValues

PointValues.IntersectVisitor, PointValues.Relation

Field Summary

Fields

Modifier and Type	Field and Description
(package private) int	bytesPerDim
(package private) int	bytesPerIndexEntry
(package private) int	docCount
(package private) IndexInput	in
(package private) long[]	leafBlockFPs
private int	leafNodeOffset
(package private) byte[]	maxPackedValue
(package private) int	maxPointsInLeafNode
(package private) byte[]	minPackedValue
(package private) int	numDataDims
(package private) int	numIndexDims
protected int	packedBytesLength
protected int	packedIndexBytesLength
(package private) long	pointCount
private byte[]	splitPackedValues
(package private) int	version

Fields inherited from class org.apache.lucene.index.PointValues

MAX_DIMENSIONS, MAX_NUM_BYTES

Constructor Summary

Constructors

Constructor and Description
SimpleTextBKDReader(IndexInput in, int numDataDims, int numIndexDims, int maxPointsInLeafNode, int bytesPerDim, long[] leafBlockFPs, byte[] splitPackedValues, byte[] minPackedValue, byte[] maxPackedValue, long pointCount, int docCount)

Method Summary

Modifier and Type	Method and Description
private void	addAll(SimpleTextBKDReader.IntersectState state, int nodeID) Fast path: this is called when the query box fully encompasses all cells under this node.
void	copySplitValue(int nodeID, byte[] splitPackedValue) Copies the split value for this node into the provided byte array
long	estimatePointCount(PointValues.IntersectVisitor visitor) Estimate the number of points that would be visited by PointValues.intersect(org.apache.lucene.index.PointValues.IntersectVisitor) with the given PointValues.IntersectVisitor.
private long	estimatePointCount(SimpleTextBKDReader.IntersectState state, int nodeID, byte[] cellMinPacked, byte[] cellMaxPacked)
int	getBytesPerDimension() Returns the number of bytes per dimension
int	getDocCount() Returns the total number of documents that have indexed at least one point.
SimpleTextBKDReader.IntersectState	getIntersectState(PointValues.IntersectVisitor visitor) Create a new SimpleTextBKDReader.IntersectState
byte[]	getMaxPackedValue() Returns maximum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0
byte[]	getMinPackedValue() Returns minimum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0
int	getNumDataDimensions() Returns how many data dimensions are represented in the values
int	getNumIndexDimensions() Returns how many dimensions are used for the index
void	intersect(PointValues.IntersectVisitor visitor) Finds all documents and points matching the provided visitor.
private void	intersect(SimpleTextBKDReader.IntersectState state, int nodeID, byte[] cellMinPacked, byte[] cellMaxPacked)
boolean	isLeafNode(int nodeID)
private int	parseInt(BytesRefBuilder scratch, BytesRef prefix)
long	ramBytesUsed() Return the memory usage of this object in bytes.
private void	readCommonPrefixes(int[] commonPrefixLengths, byte[] scratchPackedValue, IndexInput in)
private int	readCompressedDim(IndexInput in)
(package private) int	readDocIDs(IndexInput in, long blockFP, int[] docIDs)
private void	readLine(IndexInput in, BytesRefBuilder scratch)
long	size() Returns the total number of indexed points across all documents.
private boolean	startsWith(BytesRefBuilder scratch, BytesRef prefix)
private java.lang.String	stripPrefix(BytesRefBuilder scratch, BytesRef prefix)
private void	visitCompressedDocValues(int[] commonPrefixLengths, byte[] scratchPackedValue, IndexInput in, int[] docIDs, int count, PointValues.IntersectVisitor visitor, int compressedDim)
(package private) void	visitDocIDs(IndexInput in, long blockFP, PointValues.IntersectVisitor visitor)
(package private) void	visitDocValues(int[] commonPrefixLengths, byte[] scratchPackedValue, IndexInput in, int[] docIDs, int count, PointValues.IntersectVisitor visitor)
void	visitLeafBlockValues(int nodeID, SimpleTextBKDReader.IntersectState state) Visits all docIDs and packed values in a single leaf block

Methods inherited from class org.apache.lucene.index.PointValues

estimateDocCount, getDocCount, getMaxPackedValue, getMinPackedValue, size

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.lucene.util.Accountable

getChildResources

Field Detail

splitPackedValues

private final byte[] splitPackedValues

leafBlockFPs

final long[] leafBlockFPs

leafNodeOffset

private final int leafNodeOffset

numDataDims

final int numDataDims

numIndexDims

final int numIndexDims

bytesPerDim

final int bytesPerDim

bytesPerIndexEntry

final int bytesPerIndexEntry

in

final IndexInput in

maxPointsInLeafNode

final int maxPointsInLeafNode

minPackedValue

final byte[] minPackedValue

maxPackedValue

final byte[] maxPackedValue

pointCount

final long pointCount

docCount

final int docCount

version

final int version

packedBytesLength

protected final int packedBytesLength

packedIndexBytesLength

protected final int packedIndexBytesLength

Constructor Detail

SimpleTextBKDReader

public SimpleTextBKDReader(IndexInput in,
                           int numDataDims,
                           int numIndexDims,
                           int maxPointsInLeafNode,
                           int bytesPerDim,
                           long[] leafBlockFPs,
                           byte[] splitPackedValues,
                           byte[] minPackedValue,
                           byte[] maxPackedValue,
                           long pointCount,
                           int docCount)
                    throws java.io.IOException

Throws:

java.io.IOException

Method Detail

intersect

public void intersect(PointValues.IntersectVisitor visitor)
               throws java.io.IOException

Description copied from class: PointValues

Finds all documents and points matching the provided visitor. This method does not enforce live documents, so it's up to the caller to test whether each document is deleted, if necessary.

Specified by:

intersect in class PointValues

Throws:

java.io.IOException

addAll

private void addAll(SimpleTextBKDReader.IntersectState state,
                    int nodeID)
             throws java.io.IOException

Fast path: this is called when the query box fully encompasses all cells under this node.

Throws:

java.io.IOException

getIntersectState

public SimpleTextBKDReader.IntersectState getIntersectState(PointValues.IntersectVisitor visitor)

Create a new SimpleTextBKDReader.IntersectState

visitLeafBlockValues

public void visitLeafBlockValues(int nodeID,
                                 SimpleTextBKDReader.IntersectState state)
                          throws java.io.IOException

Visits all docIDs and packed values in a single leaf block

Throws:

java.io.IOException

visitDocIDs

void visitDocIDs(IndexInput in,
                 long blockFP,
                 PointValues.IntersectVisitor visitor)
          throws java.io.IOException

Throws:

java.io.IOException

readDocIDs

int readDocIDs(IndexInput in,
               long blockFP,
               int[] docIDs)
        throws java.io.IOException

Throws:

java.io.IOException

visitDocValues

void visitDocValues(int[] commonPrefixLengths,
                    byte[] scratchPackedValue,
                    IndexInput in,
                    int[] docIDs,
                    int count,
                    PointValues.IntersectVisitor visitor)
             throws java.io.IOException

Throws:

java.io.IOException

visitCompressedDocValues

private void visitCompressedDocValues(int[] commonPrefixLengths,
                                      byte[] scratchPackedValue,
                                      IndexInput in,
                                      int[] docIDs,
                                      int count,
                                      PointValues.IntersectVisitor visitor,
                                      int compressedDim)
                               throws java.io.IOException

Throws:

java.io.IOException

readCompressedDim

private int readCompressedDim(IndexInput in)
                       throws java.io.IOException

Throws:

java.io.IOException

readCommonPrefixes

private void readCommonPrefixes(int[] commonPrefixLengths,
                                byte[] scratchPackedValue,
                                IndexInput in)
                         throws java.io.IOException

Throws:

java.io.IOException

intersect

private void intersect(SimpleTextBKDReader.IntersectState state,
                       int nodeID,
                       byte[] cellMinPacked,
                       byte[] cellMaxPacked)
                throws java.io.IOException

Throws:

java.io.IOException

estimatePointCount

public long estimatePointCount(PointValues.IntersectVisitor visitor)

Description copied from class: PointValues

Estimate the number of points that would be visited by PointValues.intersect(org.apache.lucene.index.PointValues.IntersectVisitor) with the given PointValues.IntersectVisitor. This should run many times faster than PointValues.intersect(IntersectVisitor).

Specified by:

estimatePointCount in class PointValues

estimatePointCount

private long estimatePointCount(SimpleTextBKDReader.IntersectState state,
                                int nodeID,
                                byte[] cellMinPacked,
                                byte[] cellMaxPacked)

copySplitValue

public void copySplitValue(int nodeID,
                           byte[] splitPackedValue)

Copies the split value for this node into the provided byte array

ramBytesUsed

public long ramBytesUsed()

Description copied from interface: Accountable

Return the memory usage of this object in bytes. Negative values are illegal.

Specified by:

ramBytesUsed in interface Accountable

getMinPackedValue

public byte[] getMinPackedValue()

Description copied from class: PointValues

Returns minimum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0

Specified by:

getMinPackedValue in class PointValues

getMaxPackedValue

public byte[] getMaxPackedValue()

Description copied from class: PointValues

Returns maximum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0

Specified by:

getMaxPackedValue in class PointValues

getNumDataDimensions

public int getNumDataDimensions()

Description copied from class: PointValues

Returns how many data dimensions are represented in the values

Specified by:

getNumDataDimensions in class PointValues

getNumIndexDimensions

public int getNumIndexDimensions()

Description copied from class: PointValues

Returns how many dimensions are used for the index

Specified by:

getNumIndexDimensions in class PointValues

getBytesPerDimension

public int getBytesPerDimension()

Description copied from class: PointValues

Returns the number of bytes per dimension

Specified by:

getBytesPerDimension in class PointValues

size

public long size()

Description copied from class: PointValues

Returns the total number of indexed points across all documents.

Specified by:

size in class PointValues

getDocCount

public int getDocCount()

Description copied from class: PointValues

Returns the total number of documents that have indexed at least one point.

Specified by:

getDocCount in class PointValues

isLeafNode

public boolean isLeafNode(int nodeID)

parseInt

private int parseInt(BytesRefBuilder scratch,
                     BytesRef prefix)

stripPrefix

private java.lang.String stripPrefix(BytesRefBuilder scratch,
                                     BytesRef prefix)

startsWith

private boolean startsWith(BytesRefBuilder scratch,
                           BytesRef prefix)

readLine

private void readLine(IndexInput in,
                      BytesRefBuilder scratch)
               throws java.io.IOException

Throws:

java.io.IOException