npm package discovery and stats viewer.

Discover Tips

  • General search

    [free text search, go nuts!]

  • Package details

    pkg:[package-name]

  • User packages

    @[username]

Sponsor

Optimize Toolset

I’ve always been into building performant and accessible sites, but lately I’ve been taking it extremely seriously. So much so that I’ve been building a tool to help me optimize and monitor the sites that I build to make sure that I’m making an attempt to offer the best experience to those who visit them. If you’re into performant, accessible and SEO friendly sites, you might like it too! You can check it out at Optimize Toolset.

About

Hi, 👋, I’m Ryan Hefner  and I built this site for me, and you! The goal of this site was to provide an easy way for me to check the stats on my npm packages, both for prioritizing issues and updates, and to give me a little kick in the pants to keep up on stuff.

As I was building it, I realized that I was actually using the tool to build the tool, and figured I might as well put this out there and hopefully others will find it to be a fast and useful way to search and browse npm packages as I have.

If you’re interested in other things I’m working on, follow me on Twitter or check out the open source projects I’ve been publishing on GitHub.

I am also working on a Twitter bot for this site to tweet the most popular, newest, random packages from npm. Please follow that account now and it will start sending out packages soon–ish.

Open Software & Tools

This site wouldn’t be possible without the immense generosity and tireless efforts from the people who make contributions to the world and share their work via open source initiatives. Thank you 🙏

© 2024 – Pkg Stats / Ryan Hefner

with-remote-state-caching

v1.3.9

Published

A wrapper that makes it simple to add caching to any function

Downloads

81

Readme

with-remote-state-caching

ci_on_commit deploy_on_tag

Easily add powerful, declarative, and intuitive caching over remote-state resources to maximize performance without loosing accuracy.

Notable features:

  • Leverages remote-state domain knowledge to maximize ease of use
  • Declarative cache invalidation, updates, and optimistic updates
  • Customizable cache data store (localstorage, s3, dynamodb, on-disk, etc)
  • Wrapper pattern for simple and clean usage
  • Built off of battle-tested with-simple-caching

Install

npm install --save with-remote-state-caching

Examples

These examples will start at the basics and progress to the advanced features you're looking for.

Imagine, if you will, this example

Imagine that you're creating a website which lets users search and upload recipes.

If you're using typescript, lets say the recipe looks something like this:

/**
 * a recipe
 */
type Recipe = {
  uuid?: string;
  title: string;
  description: string;
  ingredients: string[];
  steps: string[]
}

To let users search recipes, you'll probably have a function that looks something like this:

/**
 * a function which calls the remote-state api and looks up recipes, without caching
 */
const getRecipes = ({ searchFor }: { searchFor: string }): Promise<Recipe[]> => {
  // ...
}

To let users add new recipes, you'll probably have a function that looks something like this:

/**
 * a function which saves a recipe to the database
 */
const saveRecipe = ({ recipe }: { recipe: Recipe }): Promise<Required<Recipe>> => {
  // ...
}

Setup remote-state caching

Before being able to use remote-state caching, we'll need to set up a remote-state caching context within which the queries and mutations will be registered

This is the glue that provides the additional information, i.e., the context, needed for the remote-state caching to power the internal cache interactions which make it so useful.

Let's get started

import { setupRemoteStateCaching } from 'with-remote-state-caching';
import { createCache } from 'simple-localstorage-cache';

// creates a shared context that all registered queries and mutations will be able to interact within
const { withRemoteStateQueryCaching, withRemoteStateMutationRegistration } = createRemoteStateCachingContext({
  cache: createCache({ namespace: 'recipes-api' }), // creates a localstorage cache, namespaced by this key, to use for all operations
})

note, in this particular example we're using simple-localstorage-cache, but you can use any async cache which works with with-simple-caching, for example

Cache the response of a query

Lets add a cache on top of your query, so that subsequent calls resolve instantly without hitting the api, to speed up the results.

import { createCache } from 'simple-localstorage-cache';
import { withRemoteStateQueryCaching } from 'with-remote-state-caching';

// add remote-state caching to the query `getRecipesFromApi`
const queryGetRecipes = withRemoteStateQueryCaching(getRecipes) });

// now, when you execute that query, the result will be cached
await queryGetRecipes.execute({ searchFor: 'chocolate' }); // calls api
await queryGetRecipes.execute({ searchFor: 'chocolate' }); // does not call the api, fetches from cache
await queryGetRecipes.execute({ searchFor: 'bananas' }); // calls api
await queryGetRecipes.execute({ searchFor: 'bananas' }); // does not call the api, fetches from cache

Manually invalidate the cached response of a query

Now, lets say you find out that the remote-state was updated and you want to make sure you hit the api the next time you call the query. (Maybe your friend just told you he added another "banana" recipe 🙂)

You can easily do this by invalidating the cached value for a particular input, like this:

// before invalidation, the result for this input will still come from the cache
await queryGetRecipes.execute({ searchFor: 'bananas' }); // does not call the api, fetches from cache

// invalidate it
await queryGetRecipes.invalidate({ searchFor: 'bananas' })

// after invalidation, nothing will be cached for this input, and will call the api
await queryGetRecipes.execute({ searchFor: 'bananas' }); // calls api

Manually update the cached response of a query

Now, lets say you you know exactly how the remote state for a query changed, and instead of invalidating the cached response you would like to update it instead.

You can easily do this by updating the cached value for a particular input, like this:

// before the update, show that there were only 2 recipes
const foundRecipes = await queryGetRecipes.execute({ searchFor: 'bananas' });

// now, update the cached response for "bananas", since we know that we just added another "bananas" recipe
const newBananasRecipe: Recipe = {/** ... */}
await queryGetRecipes.update({
  forInput: { searchFor: 'bananas' },
  toValue: ({ cachedValue: cachedRecipes }) => [...currentRecipes, newBananasRecipe], // add the new bananas recipe to the end of the list
})

Automatically invalidate the cached response of a query

Given that we have a mutation in our app which updates the recipes in the remote-state, it's natural to wonder, can we just use that as a trigger for invalidating our cache? For example, can we trigger invalidating our getRecipes query whenever a new recipe is saved with the saveRecipe mutation?

Oh boy can we 😄

Not only can we trigger the invalidation automatically, but we can also narrow the invalidation to the specific set of cache keys that were affected.

First, we must first register the mutation with our remote-state caching system, so that it can detect when the mutation is called. This is easy to do:

// registers the mutation with our remote-state caching system, does not apply any caching to it
const mutationSaveRecipe = withRemoteStateMutationRegistration(saveRecipe);

Finally, you can add this invalidatedBy trigger by calling the addTrigger method exposed by the wrapped query, like so:

// add a trigger which updates the cache when the `mutationSaveRecipe` mutation is called
queryGetRecipes.addTrigger({
  invalidatedBy: {
    mutation: mutationSaveRecipe,
    affects: ({ mutationInput, mutationOutput, cachedQueryKeys }) => ({
      keys: cachedQueryKeys.filter((cachedQueryKey) =>
        cachedQueryKey.includes(mutationInput[0].title), // invalidate all of the keys which included the new recipe's title (new recipe being defined in the mutationInput)
      ),
    }),
  },
});

Easy peasy.

Automatically update the cached response of a query

Now you may be thinking, if we can invalidate the cache based on a mutation firing, can we just update the cache based on the input and output of the mutation?

Spot on 🤓

We can easily automatically update the cached value of certain keys of a query triggered by a mutation, preventing the additional api call that invalidation would have produced 🚀

You can define these updatedBy triggers, just like the invalidateBy triggers, with the addTrigger method exposed on the wrapped query.

// add a trigger which updates the cache when the `mutationSaveRecipe` mutation is called
queryGetRecipes.addTrigger({
  updatedBy: {
    mutation: mutationSaveRecipe,
    affects: ({ mutationInput, mutationOutput, cachedQueryKeys }) => ({
      keys: cachedQueryKeys.filter((cachedQueryKey) =>
        cachedQueryKey.includes(mutationInput[0].title), // update all of the cached values from keys which included the new recipe's title (new recipe being defined in the mutationInput)
      ),
    }),
    update: ({ from: { cachedQueryOutput }, with: { mutationInput, mutationOutput } }) => {
      const cachedRecipes = cachedQueryOutput; // rename this for clarity
      const newRecipe = mutationInput[1];
      return [newRecipe, ...cachedRecipes] // update the cache to stick the new recipe at the beginning of the list
    }
  },
})

Upcoming Features

  • domain-object reference caching
  • mutation optimistic-response caching, resolution, and triggered updates
  • remote-state update event subscriptions

FAQ

can i define triggers through the wrapper options?

We've disabled that feature, in favor of the addTrigger method, to standardize on one way of adding triggers.

The reason we've standardized on addTrigger instead of through the wrapper config is primarily because typescript is not able to infer the type of both the query and the mutation involved in the operation. Meaning, when trying to define these triggers through the wrapper config, you wont have type saftey or autocomplete on the mutationInput or mutationOutput arguments, which is a pretty big problem.

The addTrigger method does not have this issue, since it operates on one mutation + query combination at a time. Further, it can be collocated with the mutation that you want to trigger the query update from, allowing for greater flexibility in how you want to structure your code base.