org.apache.tika.batch.fs

Class RecursiveParserWrapperFSConsumer

java.lang.Object

org.apache.tika.batch.FileResourceConsumer

org.apache.tika.batch.fs.AbstractFSConsumer

org.apache.tika.batch.fs.RecursiveParserWrapperFSConsumer

All Implemented Interfaces:

java.util.concurrent.Callable<IFileProcessorFutureResult>

public class RecursiveParserWrapperFSConsumer
extends AbstractFSConsumer

Basic FileResourceConsumer that reads files from an input directory and writes content to the output directory.

This tries to catch most of the common exceptions, log them and store them in the metadata list output.

Field Summary

Fields

Modifier and Type	Field and Description
private ContentHandlerFactory	contentHandlerFactory
private OutputStreamFactory	fsOSFactory
private java.lang.String	outputEncoding
private ParserFactory	parserFactory
private TikaConfig	tikaConfig

Fields inherited from class org.apache.tika.batch.FileResourceConsumer

ELAPSED_MILLIS, IO_IS, IO_OS, LOG, OOM, PARSE_ERR, PARSE_EX, TIMED_OUT

Constructor Summary

Constructors

Constructor and Description
RecursiveParserWrapperFSConsumer(java.util.concurrent.ArrayBlockingQueue<FileResource> queue, ParserFactory parserFactory, ContentHandlerFactory contentHandlerFactory, OutputStreamFactory fsOSFactory, TikaConfig tikaConfig)

Method Summary

Modifier and Type	Method and Description
java.lang.String	getOutputEncoding()
boolean	processFileResource(FileResource fileResource) Main piece of code that needs to be implemented.
void	setOutputEncoding(java.lang.String outputEncoding)

Methods inherited from class org.apache.tika.batch.fs.AbstractFSConsumer

getInputStream, getOutputStream

Methods inherited from class org.apache.tika.batch.FileResourceConsumer

call, checkForTimedOutMillis, close, flushAndClose, getCurrentFile, getNumHandledExceptions, getNumResourcesConsumed, getXMLifiedLogMsg, getXMLifiedLogMsg, incrementHandledExceptions, isStillActive, parse, pleaseShutdown

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

parserFactory

private final ParserFactory parserFactory

contentHandlerFactory

private final ContentHandlerFactory contentHandlerFactory

fsOSFactory

private final OutputStreamFactory fsOSFactory

tikaConfig

private final TikaConfig tikaConfig

outputEncoding

private java.lang.String outputEncoding

Constructor Detail

RecursiveParserWrapperFSConsumer

public RecursiveParserWrapperFSConsumer(java.util.concurrent.ArrayBlockingQueue<FileResource> queue,
                                        ParserFactory parserFactory,
                                        ContentHandlerFactory contentHandlerFactory,
                                        OutputStreamFactory fsOSFactory,
                                        TikaConfig tikaConfig)

Method Detail

processFileResource

public boolean processFileResource(FileResource fileResource)

Description copied from class: FileResourceConsumer

Main piece of code that needs to be implemented. Clients are responsible for closing streams and handling the exceptions that they'd like to handle.

Unchecked throwables can be thrown past this, of course. When an unchecked throwable is thrown, this logs the error, and then rethrows the exception. Clients/subclasses should make sure to catch and handle everything they can.

The design goal is that the whole process should close up and shutdown soon after an unchecked exception or error is thrown.

Make sure to call FileResourceConsumer.incrementHandledExceptions() appropriately in your implementation of this method.

Specified by:

processFileResource in class FileResourceConsumer

Parameters:

fileResource - resource to process

Returns:

whether or not a file was successfully processed

getOutputEncoding

public java.lang.String getOutputEncoding()

setOutputEncoding

public void setOutputEncoding(java.lang.String outputEncoding)