csvw model

This library provides tools for RDF-generation and validation of csv-files against schemas according to W3Cs specifications.

Installing

npm install @entryscape/csvm-js

Usage

The following two validation-commands can be executed from the command line:

validatecsv csv schema rows

Or if the library has not been installed globally:

node bin/validateCSV.js csv schema rows

This command validates given csv-data against a given schema. The parameter "csv" accepts a filepath to csv-data and the parameter "schema" accepts a filepath to a schema-file. The parameter "rows" is optional and accepts a number that specifies the maximum amount of csv rows to validate. It also accepts "undefined" meaning unlimited, this is the default value. The command returns a report table with potential invalidations and/or warnings.

An example of how the report table looks is found below.

generateRDF csv schema options

This commands generates RDF from given csv-data and a given schema. The parameter "csv" accepts a filepath to csv-data and the parameter "schema" accepts a filepath toa schema-file. the parameter "options" is optional and accepts an object with "dontIgnoreInvalidRows" and "dontIgnoreWarningRows". GenerateRDF will return with only a report table if any row was invalid and "dontIgnoreInvalidRows" is true or any row has warnings and "dontIgnoreWarningRows" is true. The default value for both is false.

The command return an array with three elements: rdfxml, graph and report. Rdfxml is the generated RDF in the form of RDF/XML, graph is the generated RDF as a graph. The command also validates the data the same way as the command "validate does. The third element is therefore a report table identical to the one described earlier.

In order to view all possible parameters for a command, type:

validate -h

or

generateRDF -h

Examples

A report table may look like this:

=== Invalids ===
┌─────────┬────────────┬─────────────────────────────────┬───────────┬────────┐
│ (index) │   Source   │             Message             │    Row    │ Column │
├─────────┼────────────┼─────────────────────────────────┼───────────┼────────┤
│    0    │ 'Datatype' │ 'length not equal to 5, got 10' │     1     │ 'date' │
└─────────┴────────────┴─────────────────────────────────┴───────────┴────────┘


=== Warnings ===
┌─────────┐
│ (index) │
├─────────┤
└─────────┘

A validation command may look like this:

validatecsv ./test/skoldata-test.csv ./test/skoldata-test.json

An RDF-generation-command may look like this:

generateRDF ./example.csv ./example.json --dontIgnoreInvalidRows

Future improvements

Here are some potential improvements to the library:

• clear more tests from W3C
• implement ability to generate rdf from multiple different csv-files
• improve flexibility within RDF-generation, example: -option to switch case-sensitivity on and off for specific columns
• support RDF-generation for relative URIs
• allow different character encoding standards besides utf-8
• implement browser support

Testing the library

Tests are downloaded from the W3C CSVW repository on GitHub via the following command:

yarn synctests

After the tests are downloaded they can be run by executing the following command:

yarn test

Note that at the time of writing 87 tests fail while 301 test pass.