org.apache.tika.language

Class LanguageIdentifier

java.lang.Object

org.apache.tika.language.LanguageIdentifier

Deprecated.

use a concrete class of LanguageDetector

@Deprecated
public class LanguageIdentifier
extends java.lang.Object

Identifier of the language that best matches a given content profile. The content profile is compared to generic language profiles based on material from various sources.

Since:

Apache Tika 0.5

See Also:

Europarl: A Parallel Corpus for Statistical Machine Translation, ISO 639 Language Codes

Field Summary

Fields

Modifier and Type	Field and Description
private static double	CERTAINTY_LIMIT Deprecated.
private double	distance Deprecated.
private static java.lang.String	errors Deprecated.
private java.lang.String	language Deprecated.
private static java.lang.String	LANGUAGES_KEY Deprecated.
private static java.lang.String	PROFILE_SUFFIX Deprecated.
private static java.util.Map<java.lang.String,LanguageProfile>	PROFILES Deprecated. The available language profiles.
private static java.lang.String	PROPERTIES_FILE Deprecated.
private static java.lang.String	PROPERTIES_OVERRIDE_FILE Deprecated.
private static java.util.Properties	props Deprecated.

Constructor Summary

Constructors

Constructor and Description
LanguageIdentifier(LanguageProfile profile) Deprecated. Constructs a language identifier based on a LanguageProfile
LanguageIdentifier(java.lang.String content) Deprecated. Constructs a language identifier based on a String of text content

Method Summary

Modifier and Type	Method and Description
private static void	addProfile(java.lang.String language) Deprecated.
static void	addProfile(java.lang.String language, LanguageProfile profile) Deprecated. Adds a single language profile
static void	clearProfiles() Deprecated. Clears the current map of language profiles
static java.lang.String	getErrors() Deprecated. Returns a string of error messages related to initializing language profiles
java.lang.String	getLanguage() Deprecated. Gets the identified language
static java.util.Set<java.lang.String>	getSupportedLanguages() Deprecated. Returns what languages are supported for language identification
static boolean	hasErrors() Deprecated. Tests whether there were errors initializing language config
static void	initProfiles() Deprecated. Builds the language profiles.
static void	initProfiles(java.util.Map<java.lang.String,LanguageProfile> profilesMap) Deprecated. Initializes the language profiles from a user supplied initialized Map.
boolean	isReasonablyCertain() Deprecated. Tries to judge whether the identification is certain enough to be trusted.
java.lang.String	toString() Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

PROFILES

private static final java.util.Map<java.lang.String,LanguageProfile> PROFILES

Deprecated.

The available language profiles.

PROFILE_SUFFIX

private static final java.lang.String PROFILE_SUFFIX

Deprecated.

See Also:

Constant Field Values

props

private static java.util.Properties props

Deprecated.

errors

private static java.lang.String errors

Deprecated.

PROPERTIES_OVERRIDE_FILE

private static final java.lang.String PROPERTIES_OVERRIDE_FILE

Deprecated.

See Also:

Constant Field Values

PROPERTIES_FILE

private static final java.lang.String PROPERTIES_FILE

Deprecated.

See Also:

Constant Field Values

LANGUAGES_KEY

private static final java.lang.String LANGUAGES_KEY

Deprecated.

See Also:

Constant Field Values

CERTAINTY_LIMIT

private static final double CERTAINTY_LIMIT

Deprecated.

See Also:

Constant Field Values

language

private final java.lang.String language

Deprecated.

distance

private final double distance

Deprecated.

Constructor Detail

LanguageIdentifier

public LanguageIdentifier(LanguageProfile profile)

Deprecated.

Constructs a language identifier based on a LanguageProfile

Parameters:

profile - the language profile

LanguageIdentifier

public LanguageIdentifier(java.lang.String content)

Deprecated.

Constructs a language identifier based on a String of text content

Parameters:

content - the text

Method Detail

addProfile

private static void addProfile(java.lang.String language)
                        throws java.lang.Exception

Deprecated.

Throws:

java.lang.Exception

addProfile

public static void addProfile(java.lang.String language,
                              LanguageProfile profile)

Deprecated.

Adds a single language profile

Parameters:

language - an ISO 639 code representing language

profile - the language profile

getLanguage

public java.lang.String getLanguage()

Deprecated.

Gets the identified language

Returns:

an ISO 639 code representing the detected language

isReasonablyCertain

public boolean isReasonablyCertain()

Deprecated.

Tries to judge whether the identification is certain enough to be trusted. WARNING: Will never return true for small amount of input texts.

Returns:

true if the distance is smaller then 0.022, false otherwise

initProfiles

public static void initProfiles()

Deprecated.

Builds the language profiles. The list of languages are fetched from a property file named "tika.language.properties" If a file called "tika.language.override.properties" is found on classpath, this is used instead The property file contains a key "languages" with values being comma-separated language codes

initProfiles

public static void initProfiles(java.util.Map<java.lang.String,LanguageProfile> profilesMap)

Deprecated.

Initializes the language profiles from a user supplied initialized Map. This overrides the default set of profiles initialized at startup, and provides an alternative to configuring profiles through property file

Parameters:

profilesMap - map of language profiles

clearProfiles

public static void clearProfiles()

Deprecated.

Clears the current map of language profiles

hasErrors

public static boolean hasErrors()

Deprecated.

Tests whether there were errors initializing language config

Returns:

true if there are errors. Use getErrors() to retrieve.

getErrors

public static java.lang.String getErrors()

Deprecated.

Returns a string of error messages related to initializing language profiles

Returns:

the String containing the error messages

getSupportedLanguages

public static java.util.Set<java.lang.String> getSupportedLanguages()

Deprecated.

Returns what languages are supported for language identification

Returns:

A set of Strings being the ISO 639 language codes

toString

public java.lang.String toString()

Deprecated.

Overrides:

toString in class java.lang.Object