org.apache.tika.batch.fs

Class FSListCrawler

java.lang.Object

org.apache.tika.batch.FileResourceCrawler

org.apache.tika.batch.fs.FSListCrawler

All Implemented Interfaces:

java.util.concurrent.Callable<IFileProcessorFutureResult>

public class FSListCrawler
extends FileResourceCrawler

Class that "crawls" a list of files.

Field Summary

Fields

Modifier and Type	Field and Description
private java.io.BufferedReader	reader
private java.nio.file.Path	root

Fields inherited from class org.apache.tika.batch.FileResourceCrawler

ADDED, LOG, SKIPPED, STOP_NOW

Constructor Summary

Constructors

Constructor and Description
FSListCrawler(java.util.concurrent.ArrayBlockingQueue<FileResource> fileQueue, int numConsumers, java.io.File root, java.io.File list, java.lang.String encoding) Deprecated.
FSListCrawler(java.util.concurrent.ArrayBlockingQueue<FileResource> fileQueue, int numConsumers, java.nio.file.Path root, java.nio.file.Path list, java.nio.charset.Charset charset) Constructor for a crawler that reads a list of files to process.

Method Summary

Modifier and Type	Method and Description
private java.lang.String	nextLine()
void	start() Implement this to control the addition of FileResources.

Methods inherited from class org.apache.tika.batch.FileResourceCrawler

call, getAdded, getConsidered, isActive, isQueueEmpty, select, setDocumentSelector, setMaxConsecWaitInMillis, setMaxFilesToAdd, setMaxFilesToConsider, shutDownNoPoison, tryToAdd, wasTimedOut

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

reader

private final java.io.BufferedReader reader

root

private final java.nio.file.Path root

Constructor Detail

FSListCrawler

@Deprecated
public FSListCrawler(java.util.concurrent.ArrayBlockingQueue<FileResource> fileQueue,
                                 int numConsumers,
                                 java.io.File root,
                                 java.io.File list,
                                 java.lang.String encoding)
                          throws java.io.FileNotFoundException,
                                 java.io.UnsupportedEncodingException

Deprecated.

Parameters:

fileQueue -

numConsumers -

root -

list -

encoding -

Throws:

java.io.FileNotFoundException

java.io.UnsupportedEncodingException

See Also:

FSListCrawler(ArrayBlockingQueue, int, Path, Path, Charset)

FSListCrawler

public FSListCrawler(java.util.concurrent.ArrayBlockingQueue<FileResource> fileQueue,
                     int numConsumers,
                     java.nio.file.Path root,
                     java.nio.file.Path list,
                     java.nio.charset.Charset charset)
              throws java.io.IOException

Constructor for a crawler that reads a list of files to process.

The list should be paths relative to the root.

Parameters:

fileQueue - queue for batch

numConsumers - number of consumers

root - root input director

list - text file list (one file per line) of paths relative to the root for processing

charset - charset of the file

Throws:

java.io.IOException

Method Detail

start

public void start()
           throws java.lang.InterruptedException

Description copied from class: FileResourceCrawler

Implement this to control the addition of FileResources. Call FileResourceCrawler.tryToAdd(org.apache.tika.batch.FileResource) to add FileResources to the queue.

Specified by:

start in class FileResourceCrawler

Throws:

java.lang.InterruptedException

nextLine

private java.lang.String nextLine()