Difference between revisions of "Apache Tika"

From COPTR
Jump to navigation Jump to search
 
(20 intermediate revisions by 5 users not shown)
Line 1: Line 1:
−
{{Infobox_tool
+
{{Infobox tool
−
|purpose=Detects and extracts metadata and text content from documents.
+
|purpose=Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.
−
|image=
 
 
|homepage=http://tika.apache.org/
 
|homepage=http://tika.apache.org/
 
|license=Apache License, Version 2.0
 
|license=Apache License, Version 2.0
−
|platforms=
+
|platforms=Java
 +
|function=File Format Identification, Metadata Extraction, Text Extraction, Embedded File Extraction
 
}}
 
}}
 +
{{Infobox tool details
 +
|ohloh_id=tika
 +
|releases_rss=http://projects.apache.org/feeds/rss/tika.xml
 +
|issues_rss=https://issues.apache.org/jira/activity?maxResults=10&streams=key+IS+TIKA
 +
}}
 +
= Description =
 +
Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.
 +
====Functional notes====
 +
[http://tika.apache.org/ Apache Tika]  is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:
  
−
<!-- Delete the Categories that do not apply -->
+
* HTML,
−
[[Category:Metadata Extraction]]
+
* XML and derived formats,
−
[[Category:File Format Identification]]
+
* MS Office document formats,
 +
* ODF,
 +
* iWorks document formats,
 +
* PDF,
 +
* EPUB,
 +
* RTF,
 +
* compression and packaging formats,
 +
* text formats,
 +
* feed and syndication formats,
 +
* CHM,
 +
* audio formats,
 +
* image formats,
 +
* video formats,
 +
* Java class files and archives,
 +
* source code,
 +
* mail formats,
 +
* DWG CAD format,
 +
* font formats,
 +
* scientific formats,
 +
* executable programs and libraries,
 +
* crypto formats.
  
 +
For detailed information see [http://tika.apache.org/2.1.0/formats.html Apache Tika 2.1.0]&nbsp;.
  
−
= Description =
+
Apache Tika also processes embedded files and returns text and metadata from embedded files.  The best way to see information on embedded files is to run tika-app with the -J option (e.g. <span style="font-family:Courier;">java -jar tika-app-2.1.0.jar -J -t myfile.pdf</span>), or if you're running tika-server, use the <span style="font-family:Courier;">/rmeta</span> endpoint.
−
Java based tool for detecting and extracting metadata and text content from documents.
 
  
−
== Searching for Tika on OPF Labs ==
+
== tika-eval ==
 +
In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors.  This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see [https://cwiki.apache.org/confluence/display/TIKA/TikaEvalMetrics tika-eval metrics] for the Out-of-Vocabulary statistic.)
  
−
{search:query=Tikatype=page}
+
See [https://cwiki.apache.org/confluence/display/TIKA/TikaEval tika-eval wiki]
  
 
= User Experiences =
 
= User Experiences =
  
 +
* Comparing how Apache Tika and [[DROID]] perform HTML identification: [http://britishlibrary.typepad.co.uk/webarchive/2014/07/how-much-of-the-uk-html-is-valid.html How much of the UK's HTML is valid?]
 
* Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler.
 
* Apache Tika is a core component of the [[Web Archive Discovery]] indexer and profiler.
 +
* A number of pages on the OPF Wiki [http://wiki.opf-labs.org/dosearchsite.action?queryString=Tika&where=conf_all&type=page&lastModified=&contributor=&contributorUsername= mention Tika].
 +
* Using Apache Tika to help extract hyperlinks from documentary heritage. OPF blog: [https://openpreservation.org/blogs/hyperlinks-in-your-files-how-to-get-them-out-using-tikalinkextract/ Hyperlinks in your files? How to get them out using tikalinkextract], by Ross Spencer
  
 
= Development Activity =
 
= Development Activity =
−
 
+
The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see [https://cwiki.apache.org/confluence/display/TIKA/Migrating+to+Tika+2.0.0 Migrating to Tika 2.0.0] for notes on upgrading to the 2.x branch.
−
{{Infobox_tool_details
 
−
|ohloh_id=tika
 
−
}}
 
−
 
 
−
=== Release Feed ===
 
−
 
 
−
Link to any RSS feed that is updated when new releases occur, if any, e.g:
 
−
<rss max=7>http://projects.apache.org/feeds/rss/tika.xml</rss>
 
−
 
 
−
=== Activity Feed ===
 
−
 
 
−
Link to any RSS feed that is updated when issue or code updates occur, if any, e.g:
 
−
<rss max=7>https://issues.apache.org/jira/activity?maxResults=10&amp;streams=key+IS+TIKA</rss>
 

Latest revision as of 16:21, 18 January 2022



Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.
Homepage:http://tika.apache.org/
License:Apache License, Version 2.0
Platforms:Java
Function:File Format Identification,Metadata Extraction,Text Extraction,Embedded File Extraction


Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt67411be57f6f46_12253795

Release Feed

Failed to load RSS feed from http://projects.apache.org/feeds/rss/tika.xml: There was a problem during the HTTP request: 404 Not Found

Issues Feed

2024-11-22 23:55:15
ASF GitHub Bot created a link from ASF GitHub Bot updated 2 fields of ASF GitHub Bot changed the Labels to 'pull-request-available'...
by ASF GitHub Bothttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=githubbotgithubbothttp://activitystrea.ms/schema/1.0/person
2024-11-22 23:54:39
ASF GitHub Bot created a link from ASF GitHub Bot updated a link from Description[edit]

Java based tool for identifying file formats using signatures and extracting metadata and text content from documents.

Functional notes[edit]

Apache Tika  is able to detect many different file formats. The following list names only the file formats which are supported by the parsers in the current Apache Tika version 1.9 and from which Tika is able to extract metadata and/or textual content:

  • HTML,
  • XML and derived formats,
  • MS Office document formats,
  • ODF,
  • iWorks document formats,
  • PDF,
  • EPUB,
  • RTF,
  • compression and packaging formats,
  • text formats,
  • feed and syndication formats,
  • CHM,
  • audio formats,
  • image formats,
  • video formats,
  • Java class files and archives,
  • source code,
  • mail formats,
  • DWG CAD format,
  • font formats,
  • scientific formats,
  • executable programs and libraries,
  • crypto formats.

For detailed information see Apache Tika 2.1.0 .

Apache Tika also processes embedded files and returns text and metadata from embedded files. The best way to see information on embedded files is to run tika-app with the -J option (e.g. java -jar tika-app-2.1.0.jar -J -t myfile.pdf), or if you're running tika-server, use the /rmeta endpoint.

tika-eval[edit]

In addition to extracting text and metadata from files, Tika also offers a tika-eval module that can be used for profiling content or comparing the results of two different text extractors. This module can be used to identify PDFs, for example, that may require Optical Character Recognition for reasonably reliable text (see tika-eval metrics for the Out-of-Vocabulary statistic.)

See tika-eval wiki

User Experiences[edit]

Development Activity[edit]

The Tika team released the 2.x branch over 2021, and is focusing new development only on the new branch. Please see Migrating to Tika 2.0.0 for notes on upgrading to the 2.x branch.

Retrieved from ‘https://coptr.digipres.org/index.php?title=Apache_Tika&oldid=5559’