Data Bridge

Get Started

npm install with-data-bridge

import { ElasticsearchConnector, RssFeedConnector } from 'with-data-bridge';

const sourceConnector = new RssFeedConnector(
  'https://feeds.bbci.co.uk/news/rss.xml',
);

const destinationConnector = new ElasticsearchConnector(client, 'items');

let records = await sourceConnector.read();

while (records.length) {
  await destinationConnector.write(records);

  records = await sourceConnector.read();
}

await sourceConnector.dispose();

await destinationConnector.dispose();

Supported Connectors

• Airtable (Source)
• Azure Blob Storage (Coming Soon)
• Azure Table Storage (Coming Soon)
• Elasticsearch (Destination)
• Firebase Auth (Source)
• Google Cloud Firestore (Source)
• Jotform (Coming Soon)
• Mixpanel (Source)
• MongoDB (Source & Destination)
• RSS Feed (Source)

Contribute

Thank you for your interest in contributing to Data Bridge! We welcome contributions from everyone, whether it's through submitting bug reports, suggesting improvements, adding documentation, or contributing code. Here's how you can contribute:

Reporting Bugs

If you find a bug in the project:

1. Use the GitHub Issues page to search for existing issues related to your problem.
2. If the issue is new, click the "New Issue" button and fill out the form with as much detail as possible.
3. Provide a clear and descriptive title as well as a detailed description of the issue. Include any relevant code samples or error messages.

Suggesting Enhancements

Have an idea for an improvement or new feature? We'd love to hear it! Please:

1. Check the GitHub Issues page to see if someone else has already suggested the same enhancement.
2. If it's a new idea, open a new issue, choosing the "Feature Request" template if available.
3. Provide a succinct title and detailed description of your proposed enhancement. Explain why you believe it would be beneficial to the project.

Pull Requests

Ready to contribute code or documentation? Follow these steps:

1. Fork the repository on GitHub.
2. Clone your fork to your local machine.
3. Create a new branch for your contribution (git checkout -b feature/AmazingFeature).
4. Make your changes in the new branch.
5. Commit your changes, ensuring your commit messages are concise and descriptive.
6. Push the branch to your fork (git push origin feature/AmazingFeature).
7. Open a pull request from your fork to the main project. Include a clear title and description of your changes.
8. Wait for feedback or approval from the project maintainers.

Code of Conduct

Please note that this project is released with a Contributor Code of Conduct. By participating in this project, you agree to abide by its terms.

We're excited to welcome you to our community and look forward to your contributions!