Difference between revisions of "Apache Tika"

From COPTR
Jump to navigation Jump to search
m (Added info on 2.x and tika-eval)
 
(3 intermediate revisions by one other user not shown)
Line 4: Line 4:
 
|license=Apache License, Version 2.0
 
|license=Apache License, Version 2.0
 
|platforms=Java
 
|platforms=Java
|function=Metadata Extraction, File Format Identification
+
|function=File Format Identification, Metadata Extraction, Text Extraction, Embedded File Extraction
 
}}
 
}}
 
{{Infobox tool details
 
{{Infobox tool details
Line 15: Line 15:
 
====Functional notes====
 
====Functional notes====
 
[http://tika.apache.org/ Apache Tika]  is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:  
 
[http://tika.apache.org/ Apache Tika]  is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:  
 +
 
* HTML,  
 
* HTML,  
 
* XML and derived formats,  
 
* XML and derived formats,  
Line 38: Line 39:
 
* executable programs and libraries,  
 
* executable programs and libraries,  
 
* crypto formats.  
 
* crypto formats.  
 +
 
For detailed information see [http://tika.apache.org/2.1.0/formats.html Apache Tika 2.1.0] .
 
For detailed information see [http://tika.apache.org/2.1.0/formats.html Apache Tika 2.1.0] .
  
Line 43: Line 45:
  
 
== tika-eval ==
 
== tika-eval ==
In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors.  This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text.
+
In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors.  This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see [https://cwiki.apache.org/confluence/display/TIKA/TikaEvalMetrics tika-eval metrics] for the Out-of-Vocabulary statistic.)
  
 
See [https://cwiki.apache.org/confluence/display/TIKA/TikaEval tika-eval wiki]
 
See [https://cwiki.apache.org/confluence/display/TIKA/TikaEval tika-eval wiki]
Line 52: Line 54:
 
* Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler.
 
* Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler.
 
* A number of pages on the OPF Wiki [http://wiki.opf-labs.org/dosearchsite.action?queryString=Tika&where=conf_all&type=page&lastModified=&contributor=&contributorUsername= mention Tika].
 
* A number of pages on the OPF Wiki [http://wiki.opf-labs.org/dosearchsite.action?queryString=Tika&where=conf_all&type=page&lastModified=&contributor=&contributorUsername= mention Tika].
 +
* Using Apache Tika to help extract hyperlinks from documentary heritage. OPF blog: [https://openpreservation.org/blogs/hyperlinks-in-your-files-how-to-get-them-out-using-tikalinkextract/ Hyperlinks in your files? How to get them out using tikalinkextract], by Ross Spencer
  
 
= Development Activity =
 
= Development Activity =
The Tika team released the 2.x over 2021.  Please see [https://cwiki.apache.org/confluence/display/TIKA/Migrating+to+Tika+2.0.0 Migrating to Tika 2.0.0] for notes on upgrading to the 2.x branch.
+
The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch.  Please see [https://cwiki.apache.org/confluence/display/TIKA/Migrating+to+Tika+2.0.0 Migrating to Tika 2.0.0] for notes on upgrading to the 2.x branch.

Latest revision as of 16:21, 18 January 2022



Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.
Homepage:http://tika.apache.org/
License:Apache License, Version 2.0
Platforms:Java
Function:File Format Identification,Metadata Extraction,Text Extraction,Embedded File Extraction


Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt66216cdb376638_08050062

Release Feed

Failed to load RSS feed from http://projects.apache.org/feeds/rss/tika.xml: There was a problem during the HTTP request: 404 Not Found

Issues Feed

2024-04-18 18:54:51
Laszlo Gaal started progress on Justine Olshan commented on ASF GitHub Bot updated a link from Justine Olshan added the Affects Version 'Yida Wu resolved Description[edit]

Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.

Functional notes[edit]

Apache Tika  is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:

  • HTML,
  • XML and derived formats,
  • MS Office document formats,
  • ODF,
  • iWorks document formats,
  • PDF,
  • EPUB,
  • RTF,
  • compression and packaging formats,
  • text formats,
  • feed and syndication formats,
  • CHM,
  • audio formats,
  • image formats,
  • video formats,
  • Java class files and archives,
  • source code,
  • mail formats,
  • DWG CAD format,
  • font formats,
  • scientific formats,
  • executable programs and libraries,
  • crypto formats.

For detailed information see Apache Tika 2.1.0 .

Apache Tika also processes embedded files and returns text and metadata from embedded files. The best way to see information on embedded files is to run tika-app with the -J option (e.g. java -jar tika-app-2.1.0.jar -J -t myfile.pdf), or if you're running tika-server, use the /rmeta endpoint.

tika-eval[edit]

In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors. This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see tika-eval metrics for the Out-of-Vocabulary statistic.)

See tika-eval wiki

User Experiences[edit]

Development Activity[edit]

The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see Migrating to Tika 2.0.0 for notes on upgrading to the 2.x branch.