npm package discovery and stats viewer.

Discover Tips

  • General search

    [free text search, go nuts!]

  • Package details

    pkg:[package-name]

  • User packages

    @[username]

Sponsor

Optimize Toolset

I’ve always been into building performant and accessible sites, but lately I’ve been taking it extremely seriously. So much so that I’ve been building a tool to help me optimize and monitor the sites that I build to make sure that I’m making an attempt to offer the best experience to those who visit them. If you’re into performant, accessible and SEO friendly sites, you might like it too! You can check it out at Optimize Toolset.

About

Hi, 👋, I’m Ryan Hefner  and I built this site for me, and you! The goal of this site was to provide an easy way for me to check the stats on my npm packages, both for prioritizing issues and updates, and to give me a little kick in the pants to keep up on stuff.

As I was building it, I realized that I was actually using the tool to build the tool, and figured I might as well put this out there and hopefully others will find it to be a fast and useful way to search and browse npm packages as I have.

If you’re interested in other things I’m working on, follow me on Twitter or check out the open source projects I’ve been publishing on GitHub.

I am also working on a Twitter bot for this site to tweet the most popular, newest, random packages from npm. Please follow that account now and it will start sending out packages soon–ish.

Open Software & Tools

This site wouldn’t be possible without the immense generosity and tireless efforts from the people who make contributions to the world and share their work via open source initiatives. Thank you 🙏

© 2024 – Pkg Stats / Ryan Hefner

@sugarcube/plugin-csv

v0.42.1

Published

CSV based input and output for SugarCube.

Downloads

37

Readme

@sugarcube/plugin-csv

Convert sugarcube data from and to csv.

Installation

npm install --save @sugarcube/plugin-csv

Plugins

csv_export

Export sugarcube data in csv format to a file.

Configuration:

  • csv.delimiter (defaults to ,) Specify the csv delimiter.
  • csv.filename (defaults to out.csv). Specify the target file.
  • csv.skip_empty Use this option to only export data pipelines that contain any data.
$(npm bin)/sugarcube -c config.json -p google_search,csv_export --csv.filename data.csv

csv_export_queries

Export the queries of an envelope to a file.

Configuration:

  • csv.delimiter (defaults to ,)

    Specify the csv delimiter.

  • csv.queries_filename (defaults to out.csv). Specify the target queries file.

$(npm bin)/sugarcube -c config.json \
                     -p sheets_queries,csv_export_queries \
                     --csv.queries_filename queries.csv

csv_import

Import a csv file, and turn it into sugarcube data.

Configuration:

Uses glob_pattern as query type.

  • csv.delimiter (defaults to ,)

    Specify the csv delimiter.

  • csv.id_fields (required). Specify one or several field names (separated by a comma), that are used to determine the identity of a record

$(npm bin)/sugarcube -Q glob_pattern:data/**/*.csv -p csv_import,tap_printf --csv.id_fields firstName,lastName

csv_diff

Create diff stats of the current envelope with data parsed from csv files.

Configuration:

Uses diff_glob_pattern as query type.

  • csv.delimiter Specify the csv delimiter. Defaults to ,.
  • csv.id_fields (required). Specify one or several field names (separated by a comma), that are used to determine the identity of a record

The following example compares csv files from today and yesterday.

$(npm bin)/sugarcube -d \
  -Q glob_pattern:data/dump-$(date -d "today" +%Y-%m-%d).csv \
  -Q diff_glob_pattern:data/dump-$(date -d "yesterday" +%Y-%m-%d).csv \
  -p csv_import,csv_diff \
  --csv.id_fields name

csv_export_failed

Export any failure stats of a pipeline run to a CSV file. The file is named failed-stats-<marker>.csv.

Configuration:

  • csv.delimiter: Specify the csv delimiter. Defaults to ,.
  • csv.data_dir: Specify the directory location to write the file to. Defaults to ./data.
  • csv.label: Specify an additional label to add to the file name of the exported CSV file.

Instruments

csv_failures_file

Export failures to a CSV file. The name of the file is <data-dir>/failed-stats-<marker>.csv. If the label is configured, the filename is <data-dir>/failed-stats-<label>-<marker>.csv.

Configuration:

  • csv.delimiter: Specify the csv delimiter. Defaults to ,.
  • csv.data_dir: Specify the directory location to write the file to. Defaults to ./data.
  • csv.label: Specify an additional label to add to the file name of the exported CSV file.
  • csv.append: Append failures to a CSV file if that file already exists. The default behavior is to overwrite any CSV file if it has the same name.

Example:

sugarcube -I csv_failures_file --csv.data_dir ./csv -p youtube_channel -c config.json
{
  "instruments": ["csv_failures_file"],
  "plugins": ["youtube_channel"],
  "csv": {
    "data_dir": "./csv"
  },
  "queries": [{"type": "youtube_channel", "term": "non-existing"}]
}

License

GPL3 @ Christo