Difference between revisions of "Apache Tika"
Jump to navigation
Jump to search
Ross-spencer (talk | contribs) |
|||
| (28 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
| − | {{ | + | {{Infobox tool |
| − | |purpose= | + | |purpose=Java based tool for identifying file formats using signatures and extracting metadata and text content from documents. |
| − | |||
|homepage=http://tika.apache.org/ | |homepage=http://tika.apache.org/ | ||
|license=Apache License, Version 2.0 | |license=Apache License, Version 2.0 | ||
| − | |platforms= | + | |platforms=Java |
| + | |function=File Format Identification, Metadata Extraction, Text Extraction, Embedded File Extraction | ||
}} | }} | ||
| + | {{Infobox tool details | ||
| + | |ohloh_id=tika | ||
| + | |releases_rss=http://projects.apache.org/feeds/rss/tika.xml | ||
| + | |issues_rss=https://issues.apache.org/jira/activity?maxResults=10&streams=key+IS+TIKA | ||
| + | }} | ||
| + | = Description = | ||
| + | Java based tool for identifying file formats using signatures and extracting metadata and text content from documents. | ||
| + | ====Functional notes==== | ||
| + | [http://tika.apache.org/ Apache Tika] is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content: | ||
| − | + | * HTML, | |
| − | + | * XML and derived formats, | |
| − | + | * MS Office document formats, | |
| + | * ODF, | ||
| + | * iWorks document formats, | ||
| + | * PDF, | ||
| + | * EPUB, | ||
| + | * RTF, | ||
| + | * compression and packaging formats, | ||
| + | * text formats, | ||
| + | * feed and syndication formats, | ||
| + | * CHM, | ||
| + | * audio formats, | ||
| + | * image formats, | ||
| + | * video formats, | ||
| + | * Java class files and archives, | ||
| + | * source code, | ||
| + | * mail formats, | ||
| + | * DWG CAD format, | ||
| + | * font formats, | ||
| + | * scientific formats, | ||
| + | * executable programs and libraries, | ||
| + | * crypto formats. | ||
| + | For detailed information see [http://tika.apache.org/2.1.0/formats.html Apache Tika 2.1.0] . | ||
| − | + | Apache Tika also processes embedded files and returns text and metadata from embedded files. The best way to see information on embedded files is to run tika-app with the -J option (e.g. <span style="font-family:Courier;">java -jar tika-app-2.1.0.jar -J -t myfile.pdf</span>), or if you're running tika-server, use the <span style="font-family:Courier;">/rmeta</span> endpoint. | |
| − | |||
| − | == | + | == tika-eval == |
| + | In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors. This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see [https://cwiki.apache.org/confluence/display/TIKA/TikaEvalMetrics tika-eval metrics] for the Out-of-Vocabulary statistic.) | ||
| − | + | See [https://cwiki.apache.org/confluence/display/TIKA/TikaEval tika-eval wiki] | |
= User Experiences = | = User Experiences = | ||
| + | * Comparing how Apache Tika and [[DROID]] perform HTML identification: [http://britishlibrary.typepad.co.uk/webarchive/2014/07/how-much-of-the-uk-html-is-valid.html How much of the UK's HTML is valid?] | ||
| + | * Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler. | ||
| + | * A number of pages on the OPF Wiki [http://wiki.opf-labs.org/dosearchsite.action?queryString=Tika&where=conf_all&type=page&lastModified=&contributor=&contributorUsername= mention Tika]. | ||
| + | * Using Apache Tika to help extract hyperlinks from documentary heritage. OPF blog: [https://openpreservation.org/blogs/hyperlinks-in-your-files-how-to-get-them-out-using-tikalinkextract/ Hyperlinks in your files? How to get them out using tikalinkextract], by Ross Spencer | ||
= Development Activity = | = Development Activity = | ||
| − | + | The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see [https://cwiki.apache.org/confluence/display/TIKA/Migrating+to+Tika+2.0.0 Migrating to Tika 2.0.0] for notes on upgrading to the 2.x branch. | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
Latest revision as of 16:21, 18 January 2022
Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt6759fed5da49b3_29103344
Release Feed
Failed to load RSS feed from http://projects.apache.org/feeds/rss/tika.xml: There was a problem during the HTTP request: 404 Not Found
Issues Feed
- 2024-12-11 21:06:22
- Eric Pugh resolved Eric Pugh resolved Eric Pugh resolved Tamas Cservenak linked 2 issues
- by Tamas Cservenakhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=cstamascstamashttp://activitystrea.ms/schema/1.0/person
- 2024-12-11 21:01:50
- Eric Pugh resolved Description[edit]
Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.
Functional notes[edit]
Apache Tika is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:
- HTML,
- XML and derived formats,
- MS Office document formats,
- ODF,
- iWorks document formats,
- PDF,
- EPUB,
- RTF,
- compression and packaging formats,
- text formats,
- feed and syndication formats,
- CHM,
- audio formats,
- image formats,
- video formats,
- Java class files and archives,
- source code,
- mail formats,
- DWG CAD format,
- font formats,
- scientific formats,
- executable programs and libraries,
- crypto formats.
For detailed information see Apache Tika 2.1.0 .
Apache Tika also processes embedded files and returns text and metadata from embedded files. The best way to see information on embedded files is to run tika-app with the -J option (e.g. java -jar tika-app-2.1.0.jar -J -t myfile.pdf), or if you're running tika-server, use the /rmeta endpoint.
tika-eval[edit]
In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors. This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see tika-eval metrics for the Out-of-Vocabulary statistic.)
See tika-eval wiki
User Experiences[edit]
- Comparing how Apache Tika and DROID perform HTML identification: How much of the UK's HTML is valid?
- Apache Tika is a core component of the Web Archive Discovery indexer and profiler.
- A number of pages on the OPF Wiki mention Tika.
- Using Apache Tika to help extract hyperlinks from documentary heritage. OPF blog: Hyperlinks in your files? How to get them out using tikalinkextract, by Ross Spencer
Development Activity[edit]
The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see Migrating to Tika 2.0.0 for notes on upgrading to the 2.x branch.