XML to MongoDB Importer

xml-to-mongodb-importer is a Node.js module that handle large XML files by splitting into smaller chunks and imports the data into a MongoDB database.

Features

• Chunk Splitting: Breaks large XML files into smaller, more manageable chunks.
• Data Import: Imports XML data into MongoDB seamlessly.
• Automatic Cleanup: Cleans up temporary chunk files after import.

Installation

Install the package using npm:

npm install xml-to-mongodb-importer

Usage

Here's an example of how to use xml-to-mongodb-importer:

const { runImporter } = require('xml-to-mongodb-importer');

const params = {
    xmlUrl: 'path/to/your/file.xml',
    openingTag: '<item>',
    closingTag: '</item>',
    connection: {
        mongoURI: 'mongodb://localhost:27017',
        databaseName: 'yourDatabaseName',
        collectionName: 'yourCollectionName'
    },
    chunkSize: 2500 // optional, default is 2500
};

runImporter(params)
    .then(() => {
        console.log('Import completed successfully!');
    })
    .catch((error) => {
        console.error('Import failed:', error);
    });

Example

Here's Github code example

Parameters

| Parameter | Type | Description | |------------------|----------|-----------------------------------------------------------------------------------------------| | xmlUrl | string | The path to your XML file. It must end with .xml. | | openingTag | string | The opening tag of the XML elements to be split, enclosed in angle brackets (e.g., <item>). | | closingTag | string | The closing tag of the XML elements to be split, enclosed in angle brackets (e.g., </item>). | | connection | object | An object containing MongoDB connection details: | | connection.mongoURI | string | The MongoDB connection URI. | | connection.databaseName | string | The name of the MongoDB database where data will be imported. | | connection.collectionName | string | The name of the MongoDB collection where data will be imported. | | chunkSize | number | (Optional) The number of XML elements per chunk. Default is 2500. |

Contributing

If you find any issues or have suggestions for improvement, feel free to open an issue or submit a pull request on GitHub.