Difference between revisions of "Apache Tika"
m (added link for tika-eval metrics) |
Ross-spencer (talk | contribs) |
||
| (2 intermediate revisions by one other user not shown) | |||
| Line 4: | Line 4: | ||
|license=Apache License, Version 2.0 | |license=Apache License, Version 2.0 | ||
|platforms=Java | |platforms=Java | ||
| − | |function=Metadata Extraction, File | + | |function=File Format Identification, Metadata Extraction, Text Extraction, Embedded File Extraction |
}} | }} | ||
{{Infobox tool details | {{Infobox tool details | ||
| Line 15: | Line 15: | ||
====Functional notes==== | ====Functional notes==== | ||
[http://tika.apache.org/ Apache Tika] is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content: | [http://tika.apache.org/ Apache Tika] is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content: | ||
| + | |||
* HTML, | * HTML, | ||
* XML and derived formats, | * XML and derived formats, | ||
| Line 38: | Line 39: | ||
* executable programs and libraries, | * executable programs and libraries, | ||
* crypto formats. | * crypto formats. | ||
| + | |||
For detailed information see [http://tika.apache.org/2.1.0/formats.html Apache Tika 2.1.0] . | For detailed information see [http://tika.apache.org/2.1.0/formats.html Apache Tika 2.1.0] . | ||
| Line 52: | Line 54: | ||
* Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler. | * Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler. | ||
* A number of pages on the OPF Wiki [http://wiki.opf-labs.org/dosearchsite.action?queryString=Tika&where=conf_all&type=page&lastModified=&contributor=&contributorUsername= mention Tika]. | * A number of pages on the OPF Wiki [http://wiki.opf-labs.org/dosearchsite.action?queryString=Tika&where=conf_all&type=page&lastModified=&contributor=&contributorUsername= mention Tika]. | ||
| + | * Using Apache Tika to help extract hyperlinks from documentary heritage. OPF blog: [https://openpreservation.org/blogs/hyperlinks-in-your-files-how-to-get-them-out-using-tikalinkextract/ Hyperlinks in your files? How to get them out using tikalinkextract], by Ross Spencer | ||
= Development Activity = | = Development Activity = | ||
The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see [https://cwiki.apache.org/confluence/display/TIKA/Migrating+to+Tika+2.0.0 Migrating to Tika 2.0.0] for notes on upgrading to the 2.x branch. | The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see [https://cwiki.apache.org/confluence/display/TIKA/Migrating+to+Tika+2.0.0 Migrating to Tika 2.0.0] for notes on upgrading to the 2.x branch. | ||
Latest revision as of 16:21, 18 January 2022
Release Feed
Failed to load RSS feed from http://projects.apache.org/feeds/rss/tika.xml: There was a problem during the HTTP request: 404 Not Found
Issues Feed
- 2024-11-22 14:29:09
- ASF GitHub Bot updated a link from ASF GitHub Bot logged '10m' on https://git...
- by ASF GitHub Bothttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=githubbotgithubbothttp://activitystrea.ms/schema/1.0/person
- 2024-11-22 14:28:51
- ASF GitHub Bot created a link from ASF GitHub Bot updated a link from ASF GitHub Bot changed the Labels to 'pull-request-available'...
- by ASF GitHub Bothttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=githubbotgithubbothttp://activitystrea.ms/schema/1.0/person
Description[edit]
Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.
Functional notes[edit]
Apache Tika is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:
- HTML,
- XML and derived formats,
- MS Office document formats,
- ODF,
- iWorks document formats,
- PDF,
- EPUB,
- RTF,
- compression and packaging formats,
- text formats,
- feed and syndication formats,
- CHM,
- audio formats,
- image formats,
- video formats,
- Java class files and archives,
- source code,
- mail formats,
- DWG CAD format,
- font formats,
- scientific formats,
- executable programs and libraries,
- crypto formats.
For detailed information see Apache Tika 2.1.0 .
Apache Tika also processes embedded files and returns text and metadata from embedded files. The best way to see information on embedded files is to run tika-app with the -J option (e.g. java -jar tika-app-2.1.0.jar -J -t myfile.pdf), or if you're running tika-server, use the /rmeta endpoint.
tika-eval[edit]
In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors. This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see tika-eval metrics for the Out-of-Vocabulary statistic.)
See tika-eval wiki
User Experiences[edit]
- Comparing how Apache Tika and DROID perform HTML identification: How much of the UK's HTML is valid?
- Apache Tika is a core component of the Web Archive Discovery indexer and profiler.
- A number of pages on the OPF Wiki mention Tika.
- Using Apache Tika to help extract hyperlinks from documentary heritage. OPF blog: Hyperlinks in your files? How to get them out using tikalinkextract, by Ross Spencer
Development Activity[edit]
The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see Migrating to Tika 2.0.0 for notes on upgrading to the 2.x branch.