Library (xklb) - Revision history

Carl: 4 revisions imported

2025-03-28T12:02:38Z

4 revisions imported

172.104.134.96: remove input formats

2024-04-27T04:56:08Z

remove input formats

172.104.134.96: /* make sentence simpler */

2024-04-27T04:48:22Z

make sentence simpler

172.104.134.96: fix bullet-points

2024-04-27T04:36:55Z

fix bullet-points

172.104.134.96: add library (xklb)

2024-04-27T04:35:22Z

add library (xklb)

New page

{{Infobox tool
|purpose=Media indexing multi-tool with more than 70 CLI subcommands
|sourcecode=https://github.com/chapmanjacobd/library/
|license=BSD 3-Clause
|formats_in=DB, Text
|formats_out=CSV (Comma Separated Values), DB, SQL
|function=File Management, Quality Assurance, Web Capture
}}
{{Infobox tool details}}
== Description ==


Web Capture subcommands:

- web-add: index open web directories using ffprobe and exifTool to fetch additional metadata from remote file headers without downloading the full file into SQLite for later automated selective downloading.
- tube-add: index video site metadata via yt-dlp
- gallery-add: index image gallery site metadata via gallery-dl
- extract-links: extract links from within a webpage, even if the page uses ShadowDOM, postMessage, and nested frames
- links-add: build updatable link-scraping databases for paginated content

Local file management subcommands:

- fs-add: index local files with ffprobe, exifTool, and textract
- cluster-sort: sort lines of text by similarity (a common use for this is to identify similar file paths)
- merge-folders: merge file trees (similar to [https://github.com/chapmanjacobd/journal/blob/main/programming/linux/misconceptions.md#mv-src-vs-mv-src rclone move] but it will print detailed information about overwrites and trumps (future overwrites from multiple source folders) before moving anything)
- relmv: move but preserve parent folder information
- process-image: convert large images as scaled AVIF files as an alternative to file deletion
- process-ffmpeg: convert large video/audio files to AV1/Opus as an alternative to file deletion

Quality Assurance subcommands:

- media-check: check video and audio files for corruption by decoding small sections or the whole file

== User Experiences ==


- [https://old.reddit.com/r/opendirectories/comments/1adbv4b/i_made_a_little_cli_opendirectory_scanner_tool/ Introducing webadd to the /r/opendirectories community]

@@ Line 13: / Line 13: @@
 Web Capture subcommands:
-* web-add: index open web directories using ffprobe and exifTool to fetch additional metadata from remote file headers without downloading the full file into SQLite for later automated selective downloading.
+* web-add: index open web directories using ffprobe and exifTool to fetch additional metadata from remote file headers (without downloading the full file) for later automated selective downloading.
 * tube-add: index video site metadata via yt-dlp
 * gallery-add: index image gallery site metadata via gallery-dl

@@ Line 1: / Line 1: @@
 {{Infobox tool
-|purpose=Media indexing multi-tool with more than 70 CLI subcommands
+|purpose=Media indexing multi-tool
 |sourcecode=https://github.com/chapmanjacobd/library/
 |license=BSD 3-Clause
-|formats_in=DB, Text
+|formats_out=DB
 |function=File Management, Quality Assurance, Web Capture
 }}

@@ Line 13: / Line 13: @@
 Web Capture subcommands:
-- web-add: index open web directories using ffprobe and exifTool to fetch additional metadata from remote file headers without downloading the full file into SQLite for later automated selective downloading.
+* web-add: index open web directories using ffprobe and exifTool to fetch additional metadata from remote file headers without downloading the full file into SQLite for later automated selective downloading.
-- tube-add: index video site metadata via yt-dlp
+* tube-add: index video site metadata via yt-dlp
-- gallery-add: index image gallery site metadata via gallery-dl
+* gallery-add: index image gallery site metadata via gallery-dl
-- extract-links: extract links from within a webpage, even if the page uses ShadowDOM, postMessage, and nested frames
+* extract-links: extract links from within a webpage, even if the page uses ShadowDOM, postMessage, and nested frames
-- links-add: build updatable link-scraping databases for paginated content
+* links-add: build updatable link-scraping databases for paginated content
 Local file management subcommands:
-- fs-add: index local files with ffprobe, exifTool, and textract
+* fs-add: index local files with ffprobe, exifTool, and textract
-- cluster-sort: sort lines of text by similarity (a common use for this is to identify similar file paths)
+* cluster-sort: sort lines of text by similarity (a common use for this is to identify similar file paths)
-- merge-folders: merge file trees (similar to [https://github.com/chapmanjacobd/journal/blob/main/programming/linux/misconceptions.md#mv-src-vs-mv-src rclone move] but it will print detailed information about overwrites and trumps (future overwrites from multiple source folders) before moving anything)
+* merge-folders: merge file trees (similar to [https://github.com/chapmanjacobd/journal/blob/main/programming/linux/misconceptions.md#mv-src-vs-mv-src rclone move] but it will print detailed information about overwrites and trumps (future overwrites from multiple source folders) before moving anything)
-- relmv: move but preserve parent folder information
+* relmv: move but preserve parent folder information
-- process-image: convert large images as scaled AVIF files as an alternative to file deletion
+* process-image: convert large images as scaled AVIF files as an alternative to file deletion
-- process-ffmpeg: convert large video/audio files to AV1/Opus as an alternative to file deletion
+* process-ffmpeg: convert large video/audio files to AV1/Opus as an alternative to file deletion
 Quality Assurance subcommands:
-- media-check: check video and audio files for corruption by decoding small sections or the whole file
+* media-check: check video and audio files for corruption by decoding small sections or the whole file
 == User Experiences ==