@enviro/metadata

v1.5.1

Published

2 years ago

This a port version of ExifTool by Phil Harvey. All credit to the original author(s) for creating such an amazing and powerful tool.

Downloads

134

0High
0Medium
0Low

anas.shakil

metadata exif exiftool tags extract read edit copy write

Node-Metadata

An advanced Node.js interface to the exiftool. 🚀

“An amazing level of senseless perfectionism, which is simply impossible not to respect.”

Exiftool is an amazing tool written by Phil Harvey in Perl which can read and write metadata to a number of file formats. This library supports streams. So, you don't have to handle anything from your end. It also cache network files to save your bandwidth.

Install

npm install @enviro/metadata

Requirements

Exiftool need perl to be installed on your system, Download Perl.
Node.js version >= 16.x
ExifTool is no longer included with this package, Download ExifTool.Read more about seamless ExifTool integration using path option in documentation.

Import & Configure

import Metadata from "@enviro/metadata";

// OPTIONAL
// only required if you are using user-defined tags
async function config() {
    await Metadata.configurator({
        default: true,
        no_cache_cleanup: true,
        tags: [
            {
                name: "CUSTOM_TAG",
                type: "string",
                exifPropGroup: "Exif",
                exifPropSubGroup: "Main",
            },
            {
                name: "CUSTOM_TAG",
                type: "string",
                exifPropGroup: "PDF",
                exifPropSubGroup: "Info",
            },
        ],
    });
}

Options
| Name | Type | Description | | --- | --- | --- | | default | boolean | [Advanced]Default undefinedThe default configuration use hex keys in file. If you want to use key name in file, set this option explicitly false. | | keyCodeEvaluator | number | [Advanced]The value must be greater than 53248. This is the default key for the first user-defined tag. | | no_cache_cleanup | boolean | This will stop auto cache cleaner on node server startup. | | tags | [ExifCustomTag] | Configure Exiftool to add or remove new metadata tags to the file. |
- ExifCustomTag
  | Name | Type | Description | | --- | --- | --- | | name | string | The name of the custom tag. | | type | "string" | Type of the custom tag's value. You can pass custom valid type in here which is supported by exif tag group. | | exifPropGroup | "Exif"|"PDF"| string | The custom tag's belongs to this group. Custom group can be passed as an argument. Read more at Family 0 (Information Type) | | exifPropSubGroup | "Main"|"Info"| string | The custom tag's belongs to this specific sub group. Custom sub-group can be passed as an argument. Read more at Family 1 (Specific Location) |

API

Extract Metadata

Local File

async function read() {
    try {
        const metadata = await Metadata.get("test.pdf", {
            // path not required, since ExifTool is accessible from terminal using exiftool.
            // path: "exiftool",
            tags: [
                {
                    name: "FileName",
                    exclude: true,
                },
            ],
        });
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

Output

[
    {
        FileSize: "89 kB",
        FileModifyDate: "2022:11:11 17:08:58+05:00",
        FileAccessDate: "2022:11:11 17:08:58+05:00",
        FileInodeChangeDate: "2022:11:11 17:08:58+05:00",
        FilePermissions: "-rwxrwxrwx",
        FileType: "PDF",
        FileTypeExtension: "pdf",
        MIMEType: "application/pdf",
        PDFVersion: 1.3,
        Linearized: "No",
        Encryption: "Standard V1.2 (40-bit)",
        UserAccess:
            "Print, Copy, Annotate, Fill forms, Extract, Assemble, Print high-res",
        CreateDate: "2001:10:26 13:39:34",
        Producer: "Acrobat Distiller 4.05 for Windows",
        ModifyDate: "2001:10:26 13:40:41-04:00",
        Title: "PDF Bookmark Sample",
        Author: "Accelio Corporation",
        PageCount: 4,
    },
];

FileName excluded from the result.

File Stream

import { createReadStream } from "node:fs";

async function streamFile() {
    try {
        const rs = createReadStream("sample.pdf");
        const metadata = await Metadata.get(rs, {
            path: "path/to/ExifTool",
        });
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

Network Stream

async function streamURL() {
    try {
        const metadata = await Metadata.get(
            "https://www.w3.org/WAI/ER/tests/xhtml/testfiles/resources/pdf/dummy.pdf",
            {
                no_cache: true,
            }
        );
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

Options

| Name | Type | Description | | --- | --- | --- | | fileName | string | Read: Cache file name. | | no_cache | boolean | This option doesn't work on local file path passed as a parameter. no_cache: true default for stream, read more about Stream caching. no_cache: false default for network file, read more Network stream. | | tags | [ExifReadOPTag] | Filter the output metadata tags either excluded them or only include them. | | all | boolean | Default falseIf true, all the metadata tags will be returned. This will override the tags option.NOTE: This option can cause significant performance issues. Use it only if you need all the metadata tags. | | batch | BatchReadOptions | Options for batch processing. |

ExifReadOPTag
| Name | Type | Description | | --- | --- | --- | | name | string | Name of the metadata tag. | | exclude | boolean | exclude: true exclude this tag from the result. exclude: false make this tag exclusive. | | custom | string | [Advanced]Custom Exiftool reading command can be directly passed to custom.Read more about exiftool commands. |
BatchReadOptions
| Name | Type | Description | | --- | --- | --- | | no_network_cache | boolean|[string] | Default false.If true, the network files will not be cached. If specified list of URLs provided, than that URLs will not be cached. | | no_stream_cache | [string] | Default null.If file name is not valid for stream perspective, then that specific stream will not be cached. [] or null means all streams will be discarded after reading metadata. |

Add/Edit Metadata

Local File

async function write() {
    try {
        const metadata = await Metadata.set("sample.pdf", {
            tags: [
                {
                    name: "CUSTOM_TAG",
                    value: "custom value",
                },
            ],
        });
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

File Stream

async function streamFile() {
    try {
        const rs = createReadStream("sample.pdf");
        const metadata = await Metadata.set(rs, {
            path: "path/to/ExifTool",
            tags: [
                {
                    name: "CUSTOM_TAG",
                    value: null,
                },
            ],
        });
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

An empty tag will delete the tag from the file.

Network Stream

async function streamURL() {
    try {
        // NOTE: This pdf has a size of 26 MB
        const metadata = await Metadata.set(
            "https://research.nhm.org/pdfs/10840/10840.pdf",
            {
                path: "path/to/ExifTool",
                new: true,
                prev: true,
                tags: [
                    {
                        name: "CUSTOM_TAG",
                        value: "NEW VALUE",
                    },
                ],
            }
        );
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

OUTPUT

{
    message: 'File updated successfully!',
    // Path to the file which metadata was edited
    file: '../../dir/to/the/sample.pdf',
    // OR
    // This type of path will be generated for streams
    file: '../../path/to/dir/.tmp/0b00f9b2-cc7d-48b6-8fad-d7e2992de663'
}

Options

| Name | Type | Description | | --- | --- | --- | | fileName | string | Custom cache file name. | | metadata | boolean | Default false.Returns the metadata of the file before modifying metadata will be returned. | | new | boolean | [!] Priority new > metadata.Default false.Returns the metadata of the file after modifying metadata will be returned. | | all | boolean | Default false.If true, all the metadata tags will be returned. This will override the tags option. NOTE: This option can cause significant performance issues. Use it only if you need all the metadata tags. | | delete_all | boolean | :red_circle: [UNSAFE]Default false.If true all the metadata tags will be deleted from the file. New tags will remain unaffected. | | tags | [ExifWriteOPTag] | Add new or edit existing metadata tags to the file. |

ExifWriteOPTag
| Name | Type | Description | | --- | --- | --- | | name | string | The name of the metadata tag. If it's a custom tag, make sure to initialize the Metadata.configurator() | | value | any|null | The value of the metadata tag. If the tag has no value then it will be removed from the file. | | custom | string | [Advanced]Custom Exiftool writing command can be directly passed to custom.Read more about ExifTool commands. | | empty_tag | boolean | :x: [DEPRECATED]Delete the current tag's value without deleting the whole tag from the file. |

Copy Metadata

This function allows to copy the metadata from one file or directory to another file or directory.

async function copyFromFileToStream() {
    try {
        const stream = createReadStream("/path/to/dir/img_2.jpg");
        const result = await Metadata.copy(
            "/path/to/dir/img_1.jpg",
            stream,
            {
                path: "path/to/ExifTool",
                src: {
                    tags: [
                        {
                            name: "Author",
                        },
                    ],
                },
                dst: {
                    tags: [
                        {
                            name: "Author",
                        },
                    ],
                },
            }
        );
        console.log(JSON.stringify(result, null, 2));
    } catch (e) {
        console.error(e);
    }
}

The above code will copy the Author tag from image img_1.jpg and set it to img_2.jpg, but dst overrides the Author tag to be deleted. Hence, the tag will be removed from the image img_2.jpg.

Read/Write Options
These options can be passed to read, write, and copy methods.
- ExifMetadataReadWriteOptions
  | Name | Type | Description | | --- | --- | --- | | path | string | [Required]Default 'exiftool'.The path of the ExifTool binaries.NOTE: If exiftool is callable from CLI as perl exiftool, then path is optional. | | config | string | [Advanced]The path to the config file to use with exiftool. | | del_cache_on_error | boolean | Default falseIf true, the temporary file will be deleted if an error occurs.Recommended to use with stream cache. | | stream | boolean | [Advanced]Default false.If true, instead of returning metadata in a JSON compatible object, an instance of readable stream containing metadata string will be returned.NOTE: This option will return raw metadata instead of JSON, custom parser will be required to parse JSON. JSON.parse() will always throw an error with fast: true. |

Cache

Manually remove all cache.

Metadata.clear();

Disable network caching.

async function streamURL() {
    const metadata = await Metadata.get("https://example.com/imagine.pdf", {
        no_cache: true,
    });
    console.log(metadata);
}

Explicitly set no_cache: true to disable caching for network file.

Enable stream caching.

async function streamFile() {
    const rs = createReadStream("sample.pdf");
    const metadata = await Metadata.get(rs, {
        no_cache: false,
    });
}

Explicitly set 'no_cache' to false to enable caching for stream.

Advanced

Custom Configuration

If Metadata.configurator does not meet the requirements. You can provide a custom configuration file with Metadata.get() or Metadata.set() function options.

sample.cfg

# Example config file
%Image::ExifTool::UserDefined = (
    'Image::ExifTool::Exif::Main' => {
        d000 => {
            Name => 'CUSTOM_TAG',
            Writable => 'string',
        },
    },
    'Image::ExifTool::PDF::Info' => {
        CUSTOM_TAG => {
            Name => 'CUSTOM_TAG',
            Writable => 'string',
        },
    },
);
1; #end

Read more: https://exiftool.org/config.html

Use custom configuration

async function read() {
    try {
        const metadata = await Metadata.get("image.jpg", {
            config: "../path/to/sample.cfg",
        });
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

Custom cache file name
This library does not support caching for stream passed as a parameter in such case you should provide something that could identify the cache file later. If you do not provide a cache file name a random name will be generated.no_cache: false will be ignored for stream passed as a parameter, if fileName is not provided.
```
import { createReadStream } from "node:fs";

const rs = createReadStream("sample.pdf");
const metadata = await Metadata.get(rs, {
    fileName: "sample.pdf",
    no_cache: false,
});
console.log(metadata);
```

Performance

There is a significant overhead in loading ExifTool, so performance may be greatly improved by taking advantage of ExifTool's batch processing capabilities.

Batch Processing
This allows to process multiple files in one function call, and helps to reduce the startup overhead. Sample batch processing code can be found in the examples/batch directory.

Read Metadata

async function readMultipleFromDisk() {
    try {
        const metadata = await Metadata.get([
            "/path/to/dir/samples/img_1.jpg",
            "/path/to/dir/samples/img_2.jpg",
            ...
        ]);
        console.log(metadata);
    } catch (e) {
        console.error(e);
    }
}

Edit/Write Metadata

async function writeMultipleFromDirectory() {
    try {
        const metadata = await Metadata.set("../../path/to/dir", {
            new: true,
            metadata: true,
            tags: [
                {
                    name: "Author",
                    value: "John Doe",
                },
            ],
        });
        console.log(JSON.stringify(metadata, null, 4));
    } catch (e) {
        console.error(e);
    }
}

CLI
To execute complex or direct access to ExifTool use CLI method.
```
const command = `-j ~/path/to/file`;
const subscriberId = Metadata.CLI.run(command || commands, (err, data) => {
        console.log(err || data);
        Metadata.CLI.stop(subscriberId);
    }, {
        path: exifToolPath
    });
```
- :warning: NOTE: If the command contains arbitrary spaces, use array syntax to avoid confusion.Example:
```
const command = [
    '-j',
    '-Author="Foo Bar"',
    '"~path/to/file/containing spaces/file name.pdf"'
]
```
Remove CLI events listener
Remove the current CLI events listener once the task is finished to avoid receiving metadata for additional CLI tasks. Use "queue" option, which will handle everything for you.
```
Metadata.CLI.stop(subscriberId);
```
Exit CLI
This will automatically terminate the CLI process and all events listeners.
```
Metadata.CLI.kill();
```
More examples: examples/raw.js
- Options
| Name | Type | Description | |------|------|-------------| | path | string | [Required]The path to the ExifTool binary.NOTE: path is optional, if ExifTool is callable from the CLI as perl exiftool. | | config | string | The configuration file path. | | raw | boolean | [Advanced]Default falseIf true, the child process will be returned. | | streams | boolean | [Advanced]Default falseIf true, raw streams will be returned. | | queue | boolean | [Advanced]Default falseIf true, the stream observer will serve streams in queued order and will remove the callback from the stream observer once the command is fulfilled successfully or not. |
:warning: Experimental Features
Experimental features can be unstable or maybe subject to change, using them in a production environment is not recommended.
| Name | Type | Description | | -------------------- | --------- | ----------------------------------------------------------------------------------------------------------------------------------------- | | fast | boolean | [Advanced]Default falseIf true, a dedicated process will be started for the binaries. This can significantly increase performance.To exit fast mode, use Metadata.stop(); |

NOTE

The package is pure ESM. It cannot be require() from CommonJS.
Future version might break backward compatibility.
Check release notes for breaking changes.

Future

This library is currently rewritten in TypeScript.
fast mode will be enabled by default.

Examples

Examples can be found inside example directory.

Tools

Comming Soon

Known Issues

If you discover any bug, create an issue.

Sponsor

Support this project.

License

MIT

Published

Vulnerabilities

Links

Maintainers

Keywords

Readme

Node-Metadata

Table of Contents

Install

Requirements

Import & Configure

Options

ExifCustomTag

API

Extract Metadata

Local File

Output

File Stream

Network Stream

Options

ExifReadOPTag

BatchReadOptions

Add/Edit Metadata

Local File

File Stream

Network Stream

OUTPUT

Options

ExifWriteOPTag

Copy Metadata

Read/Write Options

ExifMetadataReadWriteOptions

Cache

Manually remove all cache.

Disable network caching.

Enable stream caching.

Advanced

Custom Configuration

sample.cfg

Use custom configuration

Custom cache file name

Performance

Batch Processing

Read Metadata

Edit/Write Metadata

CLI

Remove CLI events listener

Exit CLI

Options

:warning: Experimental Features

NOTE

Future

Examples

Tools

Known Issues

Sponsor

License