Saxophone-TS 🎷

Fast and lightweight event-driven streaming XML parser in pure JavaScript.

Saxophone is inspired by SAX parsers such as sax-js and EasySax: unlike most XML parsers, it does not create a Document Object Model (DOM) tree as a result of parsing documents. Instead, it emits events for each tag or text node encountered as the parsing goes on, which makes it an online algorithm. This means that Saxophone has a low memory footprint, can easily parse large documents, and can parse documents as they come from a stream.

The parser does not keep track of the document state while parsing and, in particular, does not check whether the document is well-formed or valid, making it super-fast (see the benchmark below).

This library is best suited when you need to extract simple data out of an XML document that you know is well-formed. The parser will not report precise errors in case of syntax problems. An example would be reading data from an API endpoint.

Installation

This library works both in Node.JS ≥6.0 and recent browsers. To install with npm:

npm install --save saxophone-ts

Benchmark

This benchmark compares the performance of four of the most popular SAX parsers against Saxophone’s performance while parsing a 21 KB document. Below are the results when run on a Intel® Core™ i7-7500U processor (2.70GHz, 2 physical cores with 2 logical cores each).

| Library | Version | Operations per second (higher is better) | | ------------------ | ------: | ---------------------------------------: | | Saxophone | 0.5.0 | 6,797 ±2.99% | | EasySax | 0.3.2 | 7,919 ±1.21% | | node-expat | 2.3.18 | 904 ±1.77% | | libxmljs.SaxParser | 0.19.7 | 869 ±0.98% | | sax-js | 1.2.4 | 634 ±2.01% |

git clone https://github.com/matteodelabre/saxophone.git
cd saxophone
npm install
npm install --no-save easysax node-expat libxmljs sax
npm run benchmark

Tests and coverage

To run tests and check coverage, use the following commands:

git clone https://github.com/matteodelabre/saxophone.git
cd saxophone
npm install
npm test

Examples

Simple example

import { Saxophone } from 'saxophone-ts';

const parser = new Saxophone();

// Called whenever an opening tag is found in the document,
// such as <example id="1" /> - see below for a list of events
parser.on('tagopen', tag => {
  console.log(
    `Open tag "${tag.name}" with attributes: ${JSON.stringify(Saxophone.parseAttrs(tag.attrs))}.`
  );
});

// Called when we are done parsing the document
parser.on('finish', () => {
  console.log('Parsing finished.');
});

// Triggers parsing - remember to set up listeners before
// calling this method
parser.parse('<root><example id="1" /><example id="2" /></root>');

Output:

Open tag "root" with attributes: {}.
Open tag "example" with attributes: {"id":"1"}.
Open tag "example" with attributes: {"id":"2"}.
Parsing finished.

Streaming example

Same example as above but with Streams.

import { Saxophone } from 'saxophone-ts';
const parser = new Saxophone();

// Called whenever an opening tag is found in the document,
// such as <example id="1" /> - see below for a list of events
parser.on('tagopen', tag => {
  console.log(
    `Open tag "${tag.name}" with attributes: ${JSON.stringify(Saxophone.parseAttrs(tag.attrs))}.`
  );
});

// Called when we are done parsing the document
parser.on('finish', () => {
  console.log('Parsing finished.');
});

// stdin is '<root><example id="1" /><example id="2" /></root>'
process.stdin.setEncoding('utf8');
process.stdin.pipe(parser);

Output:

Open tag "root" with attributes: {}.
Open tag "example" with attributes: {"id":"1"}.
Open tag "example" with attributes: {"id":"2"}.
Parsing finished.

Documentation

new Saxophone()

Creates a new Saxophone parser instance. This object is a writable stream that will emit an event for each tag or node parsed from the incoming data. See the list of events below.

Saxophone#on(), Saxophone#removeListener()

Manage event listeners just like with any other event emitter. Saxophone inherits from all EventEmitter methods. See the relevant Node documentation.

Saxophone#parse(xml)

Trigger the parsing of a whole document. This method will fire registered listeners, so you need to set them up before calling it. This is equivalent to writing xml to the stream and closing it.

Note: the parser cannot be reused afterwards, you need to create a new instance.

Arguments:

• xml is an UTF-8 string or a Buffer containing the XML that you want to parse.

This method returns the parser instance.

Saxophone#write(xml)

Parse a chunk of a XML document. This method will fire registered listeners so you need to set them up before calling it.

Note: an event is emitted for a tag or a node only when it has been closed. If the chunk starts a tag but does not close it, the tag will not be reported until it is closed by a later chunk.

Arguments:

• xml is an UTF-8 string or a Buffer containing a chunk of the XML that you want to parse.

Saxophone#end(xml = "")

Write an optional last chunk then close the stream. After the stream is closed, a final finish event is emitted and no other event will be emitted afterwards. No more data may be written into the stream after closing it.

Arguments:

• xml is an UTF-8 string or a Buffer containing a chunk of the XML that you want to parse.

Saxophone.parseAttrs(attrs)

Parse a string list of XML attributes, as produced by the main parsing algorithm. This is not done automatically because it may not be required for every tag and it takes some time.

The result is an object associating the attribute names (as object keys) to their attribute values (as object values).

Saxophone.parseEntities(text)

Parses a piece of XML text and expands all XML entities inside it to the character they represent. Just like attributes, this is not parsed automatically because it takes some time.

This ignores invalid entities, including unrecognized ones, leaving them as-is.

Events

tagopen

Emitted when an opening tag is parsed. This encompasses both regular tags and self-closing tags. An object is passed with the following data:

• name: name of the parsed tag.
• attrs: attributes of the tag (as a string). To parse this string, use Saxophone.parseAttrs.
• isSelfClosing: true if the tag is self-closing.

tagclose

Emitted when a closing tag is parsed. An object containing the name of the tag is passed.

processinginstruction

Emitted when a processing instruction (such as <? contents ?>) is parsed. An object with the contents of the processing instruction is passed.

text

Emitted when a text node between two tags is parsed. An object with the contents of the text node is passed. You might need to expand XML entities inside the contents of the text node, using Saxophone.parseEntities.

cdata

Emitted when a CDATA section (such as <![CDATA[ contents ]]>) is parsed. An object with the contents of the CDATA section is passed.

comment

Emitted when a comment (such as <!-- contents -->) is parsed. An object with the contents of the comment is passed.

error

Emitted when a parsing error is encountered while reading the XML stream such that the rest of the XML cannot be correctly interpreted:

• when a DOCTYPE node is found (not supported yet);
• when a comment node contains the -- sequence;
• when opening and closing tags are mismatched or missing;
• when a tag name starts with white space;
• when nodes are unclosed (missing their final >).

Because this library's goal is not to provide accurate error reports, the passed error will only contain a short description of the syntax error (without giving the position, for example).

finish

Emitted after all events, without arguments.

Contributions

This is free and open source software. All contributions (even small ones) are welcome. Check out the contribution guide to get started!

Thanks to:

• Norman Rzepka for implementing the streaming API and the check for opening and closing tags mismatch.
• winston01 for spotting and fixing an error in the parser when a tag sits astride two chunks.

License

Released under the MIT license. See the full license text.