zip-stream-cli
v2.0.1
Published
A tool to extract files from remote zip archives over HTTP.
Downloads
3
Readme
🚀 Zip stream CLI
Zip stream CLI is a Node.js library that allows you to extract and display content from various file types inside a zip or tar archive directly in the terminal. The library supports multiple file types such as images, audio files, PDFs, text, spreadsheets, and more, with the option to extend functionality by adding new handlers.
✨ Features
Supports Multiple File Types: Automatically detect and display content from various file types inside both zip and tar archives.
Modular Handler System:
- Easily extend support for new file types by adding custom handlers.
- Handlers for existing file types are dynamically loaded based on the file extension.
🎵 Stream and Display Audio Waveforms: Display waveforms for audio files directly in the terminal.
🖼️ Display Images: View images as pixel art directly in the terminal.
⚙️ Customizable Output: Each file type is displayed using appropriate handlers, allowing you to customize the way content is shown for different types of files.
⚡ Installation dev
Clone this repository to your local machine:
git clone https://github.com/agarrec-vivlio/zip-stream-cli cd zip-stream-cli
Install the required dependencies:
npm install
Link the project globally using npm link:
npm link
⚡ Installation global
You can also install globally using npm:
npm install -g zip-stream-cli
🌐 Global Usage
Once installed globally or linked, you can run the zip-stream-cli
command from anywhere in your terminal.
Example:
zip-stream-cli https://example.com/myarchive.zip
zip-stream-cli https://example.com/myarchive.tar.gz
🛠️ File Type Handlers
The library dynamically loads file handlers based on the file extension. Handlers for various file types are stored in the handlers
directory.
The typeMappings.json
file maps file extensions to their respective handlers. If a file type is not recognized or doesn't have a dedicated handler, it falls back to the textHandler
to display the file as plain text.
Supported File Types
| File Type | Extensions | Handler |
|------------------|------------------------------------------|-------------------|
| Text Files | .txt
, .md
, .html
| textHandler
|
| Audio Files | .mp3
, .wav
, .ogg
| audioHandler
|
| Image Files | .png
, .jpg
, .gif
, .bmp
| imageHandler
|
| PDF Files | .pdf
| pdfHandler
|
| Spreadsheet Files| .xls
, .xlsx
, .csv
| spreadsheetHandler
|
| Code Files | .js
, .py
, .java
, .rb
, etc. | codeHandler
|
| Archive Files | .zip
, .tar
, .gz
| archiveHandler
|
| YAML & JSON Files| .yaml
, .yml
, .json
| jsonYamlHandler
|
Adding a New File Type
The system is designed to be extensible, making it easy to add new handlers for different file types. Follow the steps below to add support for a new file type.
Step 1: Create a New Handler
To add support for a new file type, create a new handler file inside the handlers
directory.
Example: Create customFileHandler.js
to handle a new file type, say .custom
.
// handlers/customFileHandler.js
module.exports = async function handleCustomFile(fileStream) {
const chunks = [];
for await (const chunk of fileStream) {
chunks.push(chunk);
}
const fileContent = Buffer.concat(chunks).toString('utf-8');
console.log('Displaying custom file content:');
console.log(fileContent); // Replace this with your custom logic to handle the file
}
Step 2: Update typeMappings.json
Add the new file extension and map it to the newly created handler in typeMappings.json
.
{
"custom": "customFileHandler",
"txt": "textHandler",
"md": "textHandler",
"json": "jsonYamlHandler",
"yaml": "jsonYamlHandler",
"mp3": "audioHandler",
"wav": "audioHandler",
"png": "imageHandler",
"jpg": "imageHandler"
}
Step 3: Use Your Custom Handler
Now, when a file with the .custom
extension is encountered, the library will use your customFileHandler.js
to process and display the file.
📄 TAR File Streaming
In TAR file handling, the Zip stream CLI employs a streaming approach to efficiently process large archives without requiring the entire file to be downloaded and stored in memory.
How TAR File Streaming Works:
Partial Fetching: For uncompressed TAR files, the CLI fetches small chunks of the file (e.g., a few megabytes at a time). For compressed
.tar.gz
files, compressed chunks are fetched and decompressed on the fly. This allows the CLI to start listing or extracting files without needing the entire archive.Entry-by-Entry Processing: The TAR archive is processed entry by entry, reading file headers and skipping over data unless it is necessary for the current operation. This keeps memory usage low.
File Extraction: When extracting a specific file, the CLI fetches the portion of the TAR file where the file is located and decompresses only that part (if necessary). The rest of the archive is skipped.
Efficient for Large Archives: The CLI uses the
tar-stream
library to process entries without buffering the whole file. Compressed archives usezlib
to decompress data in chunks.
Advantages:
- Memory Efficiency: Only the needed parts of the archive are processed, avoiding the need to load the entire archive into memory.
- Streaming: Files are processed as they are streamed in, improving performance on large files.
- Optimized for Compressed Archives: Compressed TAR files (
.tar.gz
) are streamed and decompressed incrementally.
📸 Screenshots
File Listing:
🖼️ Image file output:
📄 Text file output:
🤝 Contributing
Contributions are welcome! Feel free to fork the repository, create new handlers, fix bugs, or add new features.
To contribute:
- Fork this repository.
- Create a new branch (
git checkout -b feature-new-handler
). - Add your feature or fix.
- Push your branch and submit a pull request.
📜 License
This project is licensed under the MIT License.