npm package discovery and stats viewer.

Discover Tips

  • General search

    [free text search, go nuts!]

  • Package details

    pkg:[package-name]

  • User packages

    @[username]

Sponsor

Optimize Toolset

I’ve always been into building performant and accessible sites, but lately I’ve been taking it extremely seriously. So much so that I’ve been building a tool to help me optimize and monitor the sites that I build to make sure that I’m making an attempt to offer the best experience to those who visit them. If you’re into performant, accessible and SEO friendly sites, you might like it too! You can check it out at Optimize Toolset.

About

Hi, 👋, I’m Ryan Hefner  and I built this site for me, and you! The goal of this site was to provide an easy way for me to check the stats on my npm packages, both for prioritizing issues and updates, and to give me a little kick in the pants to keep up on stuff.

As I was building it, I realized that I was actually using the tool to build the tool, and figured I might as well put this out there and hopefully others will find it to be a fast and useful way to search and browse npm packages as I have.

If you’re interested in other things I’m working on, follow me on Twitter or check out the open source projects I’ve been publishing on GitHub.

I am also working on a Twitter bot for this site to tweet the most popular, newest, random packages from npm. Please follow that account now and it will start sending out packages soon–ish.

Open Software & Tools

This site wouldn’t be possible without the immense generosity and tireless efforts from the people who make contributions to the world and share their work via open source initiatives. Thank you 🙏

© 2024 – Pkg Stats / Ryan Hefner

@ndn/repo

v0.0.20240630

Published

NDNts: Data Repository

Downloads

12

Readme

@ndn/repo

This package is part of NDNts, Named Data Networking libraries for the modern web.

This package implements a Data repository. The repo is primarily designed to be embedded into Node and web applications, rather than running as a standalone daemon process. Data ingestion is mainly supported through APIs, not command packets. Data retrieval is on par with other repo implementations.

import { makeInMemoryDataStore, RepoProducer, PrefixRegShorter } from "@ndn/repo";

// other imports for examples
import { consume } from "@ndn/endpoint";
import { Name, Interest, Data } from "@ndn/packet";
import { delay } from "@ndn/util";
import assert from "node:assert/strict";

DataStore

DataStore is a Data packet storage, based on an abstract-level compatible key-value database. It implements most of DataStore interfaces defined in @ndn/repo-api package, offering APIs to insert and delete Data packets.

DataStore.create() function creates a DataStore instance, but it's more convenient to use a helper function:

  • makeInMemoryDataStore() creates an in-memory DataStore, backed by memory-level.
  • makePersistentDataStore(location) creates a persistent DataStore, backed by level.
    • location is a directory path (relative or absolute) in Node.js, or an IDB database name in browser.

The DataStore type implements AsyncDisposable interface. With await using keyword (TypeScript only), the DataStore is closed when the variable goes out of scope. Alternatively, you can invoke await store[Symbol.asyncDispose]() explicitly.

await using store = await makeInMemoryDataStore();

The DataStore type supports Data insertion, Data deletion, and Data lookup. During insertion, you can set an expiration time upon which the packet disappears.

// Insert Data packets.
await store.insert(new Data("/A/0"));
// You can totally insert multiple Data packets in one command.
// This is even preferred, because it bundles them into one LevelDB transaction and runs faster.
await store.insert(new Data("/A/1"), new Data("/A/2"));
// You can also pass the result of fetch() function from @ndn/segmented-object package directly to
// insert() function, because it accepts AsyncIterable<Data> and Iterable<Data> types.

// You can set an expiration time during insertion. Packets disappear upon expiration.
await store.insert({ expireTime: Date.now() + 50 }, new Data("/A/3"));
await delay(50); // Poof, it's gone.
// Inserting new Data packet with same name would overwrite previous packet, even if their implicit
// digests differ. You cannot store two packets with same name.

// Delete Data packets.
await store.delete(new Name("/A/0"), new Name("/A/4"));
// It's harmless to delete non-existent packets, such as /A/4 above.

// Now let's retrieve them.
const rA1 = await store.find(new Interest("/A/1"));
assert.equal(`${rA1?.name}`, "/8=A/8=1");
// Prefix name is supported too.
const rA = await store.find(new Interest("/A", Interest.CanBePrefix));
assert(["/8=A/8=1", "/8=A/8=2"].includes(`${rA?.name}`));
// /A/3 has disappeared because it is expired.
const rA3 = await store.find(new Interest("/A/3"));
assert.equal(rA3, undefined);

RepoProducer

RepoProducer makes packets in a DataStore available for retrieval.

RepoProducer.create() function creates a RepoProducer instance, serving Data from an existing DataStore instance.

The reg option passed to this function controls what name prefixes should be registered:

  • PrefixRegStatic(new Name("/A"), new Name("/B")) registers a fixed set of prefixes.
  • PrefixRegShorter(1) registers prefixes that are 1-component shorter than each Data name.
  • See test cases for more options.

These registrations are effectively within NDNts logical forwarder. Typically you'll combine them with a prefix readvertise module such as @ndn/nfdmgmt to propagate the prefix registration to remote forwarders.

The RepoProducer type implements Disposable interface. With using keyword (TypeScript only), the producer is closed when the variable goes out of scope. Alternatively, you can invoke repoProducer[Symbol.dispose]() explicitly.

// Construct a RepoProducer.
using repoProducer = RepoProducer.create(store, { reg: PrefixRegShorter(1) });
await delay(10); // prefix registration is asynchronous so we delay a little bit

// Try to retrieve Data.
const retrieved = await consume("/A/2");
assert.equal(`${retrieved?.name}`, "/8=A/8=2");