@lit-labs/virtualizer
v2.0.14
Published
Viewport-based virtualization (virtual scrolling) for Lit
Downloads
248,860
Maintainers
Keywords
Readme
@lit-labs/virtualizer
@lit-labs/virtualizer
provides viewport-based virtualization (including virtual scrolling) for Lit.
⚠️ @lit-labs/virtualizer
is in late prerelease. Its API is intended to remain quite stable going forward, but you should expect (increasingly minor) changes before 1.0. Some of these changes may be technically breaking, but we anticipate that they will be mechanical and straightforward to make.
Getting Started
Get this package:
npm i @lit-labs/virtualizer
Like Lit itself, the @lit-labs/virtualizer
package is published as ES2021, using ES modules. The Lit packages use bare specifiers to refer to their dependencies.
Shipping packages this way lets you control how whether and how they (along with your own source code) are bundled and transpiled for delivery to your users. However, it does require that you use a development server (or alternative tool chain) capable of resolving bare specifiers on the fly, since browsers don't natively support them.
For more information and specific guidance, see the Tools and Workflows docs on lit.dev.
Documentation
What is a virtualizer?
A virtualizer is an element that renders its own children, applying the provided renderItem
template function to each item in the provided items
array.
Instead of immediately rendering a child element for every item in the array, a virtualizer renders only enough elements to fill the viewport. As the viewport scrolls or resizes, the virtualizer automatically removes elements that are no longer visible and adds elements that have come into view.
By default, a virtualizer is not itself a scroller. Rather, it is a block-level element that sizes itself to take up enough space for all of its children, including those that aren't currently present in the DOM. It adds and removes child elements as needed whenever the window (or some other scrollable ancestor of the virtualizer) is scrolled or resized. It is possible, however, to make a virtualizer into a scroller.
<lit-virtualizer>
element
The most common way to make a virtualizer is to use the <lit-virtualizer>
element. Here's how you would use <lit-virtualizer>
inside a Lit element's render
method:
render() {
return html`
<h2>My Contacts</h2>
<lit-virtualizer
.items=${this.contacts}
.renderItem=${contact => html`<div>${contact.name}: ${contact.phone}</div>`}
></lit-virtualizer>
`;
}
Note: The examples throughout this documentation focus on the <lit-virtualizer>
element, but the virtualize
directive provides an alternative that may be useful in certain cases.
Making a virtualizer a scroller
If you want to make a virtualizer that is itself a scroller, just add the scroller
attribute to the <lit-virtualizer>
element, or add scroller: true
to the options object for the virtualize
directive:
render() {
return html`
<lit-virtualizer
scroller
.items=${this.contacts}
.renderItem=${contact => html`<div>${contact.name}: ${contact.phone}</div>`}
></lit-virtualizer>
`;
}
When you make a virtualizer a scroller, you should explicitly size it to suit the needs of your layout. (By default, it has a min-height
of 150 pixels to prevent it from collapsing to a zero-height block, but this default will rarely be what you want in practice.)
Choosing a layout
@lit-labs/virtualizer
currently supports two basic layouts, flow
(the default) and grid
, which together cover a wide range of common use cases.
If you just want a vertical flow layout, then there's no need to do anything; that's what a virtualizer does out of the box. But if you want to select the grid
layout instead, or if you want to set an option on the flow
layout, then you'll use the virtualizer's layout
property to do so. Here's an example:
// First, import the layout you want to use. The reference returned
// is a function that takes an optional configuration object.
import {grid} from '@lit-labs/virtualizer/layouts/grid.js';
// Inside your element's `render` function, use the imported function
// to set the virtualizer's `layout` property. In this case, we omit
// the configuration object so we'll get `grid`'s default options.
render() {
return html`
<lit-virtualizer
.layout=${grid()}
.items=${this.photos}
.renderItem=${photo => html`<img src=${photo.url}>`}
></lit-virtualizer>
`;
}
The layout system in @lit-labs/virtualizer
is pluggable; custom layouts will eventually be supported via a formal layout authoring API. However, the layout authoring API is currently undocumented and less stable than other parts of the API. It is likely that official support of custom layouts will be a post-1.0 feature.
Using the flow
layout
By default, a virtualizer lays out its children using the flow
layout, a simplified form of the browser's own default layout.
The flow
layout's primary (and significant) simplification is that it expects all child elements to be styled as block-level elements and lays them out accordingly. Child elements will never be laid out "next to each other" inline, even if there were enough space to do so.
Child element size is determined "naturally"—that is, the size of each child element will depend on the data you provide in the items
array, the nature of your renderItem
template, and any CSS rules that apply to the child.
Internally, a virtualizer uses a native ResizeObserver
to detect whenever child elements resize, and the flow
layout automatically updates item positions as needed, behaving just like the browser's native flow layout in this respect.
Spacing child elements
To control the spacing of child elements, use standard CSS techniques to set margins on the elements.
Note that the flow
layout offers limited support for margin-collapsing: margins set explicitly on child elements will be collapsed, but any margins on elements contained within child elements are not considered.
Specifying layout direction
The flow
layout works vertically by default. However, it also supports laying out child elements horizontally, via its direction
property:
render() {
return html`
<lit-virtualizer
.layout=${flow({
direction: 'horizontal'
})}
.items=${this.photos}
.renderItem=${photos => html`<img src=${photo.url}>`}
></lit-virtualizer>
`;
}
Using shorthand to specify flow
options
Because flow
is the default layout, you don't need to import it explicitly, even if you want to set options on it. Just pass an options object directly to your virtualizer's layout
property, without wrapping it in the flow()
function:
// This shorthand form...
html`
<lit-virtualizer
.layout=${{
direction: 'horizontal'
}}
></lit-virtualizer>
`
// ...is equivalent to this:
html`
<lit-virtualizer
.layout=${flow(
direction: 'horizontal'
)}
></lit-virtualizer>
`
Using the grid
layout
TODO
Scrolling
As much as possible, @lit-labs/virtualizer
strives to "just work" with all of the native scrolling APIs (the scrollTo()
method, the scrollTop
and scrollLeft
properties, and so on). When you need to scroll, just use native APIs directly on the window
, on any scrolling element that happens to be an ancestor of your virtualizer in the DOM tree, or on your virtualizer itself (if it is a scroller).
Besides the native scrolling APIs, there are a couple of virtualizer-specific APIs that you may find useful in certain circumstances: a method for scrolling "virtual" child elements into view, and a declarative way to frame a given child element within the viewport. These APIs are described in the sections below.
Finally, there one quirk to be aware of when smoothly scrolling a view containing a virtualizer.
Scrolling a child element into view
If you want to scroll one of a virtualizer's children into view and that element is currently present in the DOM because it is within the viewport or just outside, you can use the native web API: get a reference to the element, and then call myElement.scrollIntoView()
with whatever options you desire.
However, this method won't work if the child element you want to scroll into view is currently "virtualized" (i.e., is not currently present in the DOM because it is too far outside the viewport). For this reason, a virtualizer exposes the element()
method, which takes a numeric index (specifying an item in the items
array) and returns a simple proxy object representing the corresponding child element (whether the element is present in the DOM or not). This proxy currently exposes just one method: scrollIntoView()
, which matches the behavior of the native method. Here's an example:
// Get a reference to the virtualizer, using any method
const virtualizer = this.shadowRoot.querySelector('<lit-virtualizer>');
// Then use the `element()` method to get a proxy and call `scrollIntoView()`
virtualizer.element(42).scrollIntoView({
block: 'center',
behavior: 'smooth',
});
Note:
- The proxy's
scrollIntoView()
method supports same options as the native API, but theinline
option has no effect at present, because all currently available layouts virtualize along a single axis and keep child elements within view along the secondary axis at all times. - If you're using the
virtualize
directive, getting a reference to the virtualizer so you can callelement()
requires one extra step—see Getting a reference to the virtualizer.
Framing a child element within the viewport
Whereas scrollIntoView()
lets you imperatively scroll a given child element into view, the pin
property on a virtualizer layout provides a declarative way to frame an element within the viewport. This is especially useful if you want a specific element to be in view when you initially render a virtualizer. Here's an example:
render() {
// In this toy example, we pin the layout to a hard-coded position. In
// reality, you'll almost always want to maintain some state of your
// own to keep track of whether the layout should be pinned, and to
// which child element. See the note below about the `unpinned` event.
return html`
<h2>My Contacts</h2>
<lit-virtualizer
.items=${this.contacts}
.renderItem=${contact => html`<div>${contact.name}: ${contact.phone}</div>`}
.layout=${{
pin: {
index: 42,
block: 'start'
}
}}
></lit-virtualizer>
`;
}
The pin
property takes an option called index
to specify (by number) which child element you want to frame in the viewport. If you want, you can also use the block
option to indicate how the element should be framed relative to the viewport; block
behaves identically to the same option in the scrollIntoView()
method.
When you pin a layout, it remains pinned until the user intentionally scrolls the view, at which point it is automatically "unpinned". When this occurs, the virtualizer fires an unpinned
event. Unless you're sure you'll only render your virtualizer once, you should listen for the unpinned
event so you can omit the pin
property when you re-render the virtualizer and avoid snapping the view back to the previously pinned position. [TODO: link to an example]
A note on smooth scrolling
As noted above, @lit-labs/virtualizer
essentially "just works" with the browser's native scrolling APIs, including smooth scrolling (as specified via the behavior: 'smooth'
option).
That said, depending on what layout you're using and what browser you're scrolling in, you may sometimes notice a slight "hitch" in the scrolling animation, where it momentarily slows—usually shortly before reaching its destination.
This only occurs with the flow
layout and is noticeable mainly (perhaps only) in Chromium-based browsers. It happens when the layout has been estimating the sizes of child elements it hasn't yet measured and needs to correct errors in its estimates while a smooth scrolling animation is in progress.
This is a known limitation which, unless smooth scrolling in Chromium evolves to behave more like other browsers, probably can't be addressed without changing @lit-labs/virtualizer
to use JavaScript-based scrolling in place of native scrolling.
virtualize
directive
An alternative way to use @lit-labs/virtualizer
is via the virtualize
directive; this directive turns its parent element into a virtualizer.
The virtualize
directive is useful primarily if your project utilizes Lit templates but not the LitElement
base class and you want to keep your imports to a minimum.
It can also be useful in cases like the one below, where we want to virtualize an unordered list (<ul>
) element and don't want or need a separate container for its <li>
children:
render() {
return html`
<ul>
${virtualize({
items: this.contacts,
renderItem: contact => html`<li>${contact.name}</li>`
})}
</ul>
`;
}
The capabilities of the virtualizer
directive are the same as those of the <lit-virtualizer>
element. The configuration APIs are the same as well, except that features expressed as properties and attributes on the <lit-virtualizer>
element are instead expressed as properties in an options object passed as the single argument to the virtualize
directive.
Getting a reference to the virtualizer
In addition to its declarative configuration options, a virtualizer exposes a handful of imperative APIs. The <lit-virtualizer>
element exposes these APIs directly, but to use them with the virtualize
directive you need to get a reference to the virtualizer. You do this by first getting a reference to the virtualizer's host element (the element within which you rendered the directive) and then using the virtualizerRef
symbol to get a reference to the virtualizer itself. For example:
import {html, LitElement} from 'lit';
import {customElement, property, query} from 'lit/decorators.js';
// Import the `virtualizerRef` symbol along with the directive
import {virtualize, virtualizerRef} from '@lit-labs/virtualizer/virtualize.js';
@customElement('my-items')
export class MyItems extends LitElement {
data = new Array(100).fill('').map((i, n) => ({text: `Item ${n}`}));
@query('ul')
list: HTMLUListElement;
render() {
return html`
<ul>
${virtualize({
items: this.data,
renderItem: (i) => html`<li>${i.text}</li>`,
})}
</ul>
`;
}
scrollToListItem(idx) {
// Use the `virtualizerRef` symbol as a property key on the
// host element to access the virtualizer reference
this.list[virtualizerRef].element(idx).scrollIntoView();
}
}
ResizeObserver dependency
Virtualizer depends on the standard ResizeObserver
API, which is supported in all modern browsers. In case your browser support matrix includes older browsers that don't implement ResizeObserver
, the Virtualizer package includes a ResizeObserver
polyfill that is known to be compatible with Virtualizer. This is a forked version of Denis Rul's resize-observer-polyfill
package, which we modified to extend its observations into shadow roots.
Using the default loader
The package also includes a simple mechanism for loading the ResizeObserver
polyfill. This mechanism uses feature detection to determine whether the polyfill is required; if it is, then the polyfill is automatically loaded and provided directly to Virtualizer.
You need to invoke the loader—which is asynchronous—and await its return before running any code that would cause a virtualizer to be instantiated. The simplest way to do this is to load virtualizer itself with a dynamic import()
statement. For example:
import {loadPolyfillIfNeeded} from '@lit-labs/virtualizer/polyfillLoaders/ResizeObserver.js';
async function load() {
await loadPolyfillIfNeeded();
await import('@lit-labs/virtualizer');
}
Writing a custom loader
In case you want to make the ResizeObserver
polyfill available for use outside of Virtualizer or have other specialized polyfill-loading requirements, you can alternatively import the polyfill directly and write your own custom code for loading and exposing it.
If you choose this option, there are two ways you can make the polyfill available for Virtualizer to use:
- Expose the polyfill via
window.ResizeObserver
so that Virtualizer can access it just as it would the native implementation. - Pass the polyfill constructor to Virtualizer's
provideResizeObserver()
function.
Either way, you should do so before instantiating any virtualizers, just as when you use the provided loader.
Here's how you would import the polyfill and the provideResizeObserver()
function statically:
import ResizeObserverPolyfill from '@lit-labs/virtualizer/polyfills/resize-observer-polyfill/ResizeObserver.js';
import {provideResizeObserver} from '@lit-labs/virtualizer/polyfillLoaders/ResizeObserver.js';
More typically, though, you'd import them dynamically:
async function myCustomLoader() {
// Write whatever custom logic you need, using feature detection, etc...
// If you need to load the polyfill, do it like this:
const ResizeObserverPolyfill = await import(
'@lit-labs/virtualizer/polyfills/resize-observer-polyfill/ResizeObserver.js'
).default;
// To install the polyfill globally, do something like this:
window.ResizeObserver = ResizeObserverPolyfill;
// Or to provide it to Virtualizer, do something like this:
const {provideResizeObserver} = await import(
'@lit-labs/virtualizer/polyfillLoaders/ResizeObserver.js'
);
provideResizeObserver(ResizeObserverPolyfill);
}
"ResizeObserver loop limit exceeded" errors
When using Virtualizer, you may see this error in your console and depending on your testing framework, it may be causing your tests to fail. The error itself is benign and only means that the ResizeObserver was not able to deliver all observations within a single animation frame. It may be safely ignored, but it may be necessary to instruct your framework to ignore it as well to prevent unnecessary side-effects and error-handling.
To assist with this, a few functions are provided in the support folder. These functions are independent of each other and you will need to choose which best fits to your situation.
window.onerror patches
Testing frameworks like Mocha define an onerror
handler directly on window
which catch any unhandled exceptions and report them as failures. The following two solutions wrap this handler to ignore the loop limit errors specifically.
setupIgnoreWindowResizeObserverLoopErrors()
The simplest approach is to use this function to wrap and unwrap the onerror handler before and after each test. With a Mocha setup you would use it like this:
import {setupIgnoreWindowResizeObserverLoopErrors} from '@lit-labs/virtualizer/support/resize-observer-errors.js';
describe('My virtualized collection', () => {
setupIgnoreWindowResizeObserverLoopErrors(beforeEach, afterEach);
it('does this and that', () => {
/* test stuff */
});
});
By handing setupIgnoreWindowResizeObserverLoopErrors
the beforeEach
and afterEach
callbacks, it is able to define the appropriate setup and teardown for you. The only case where this may not work is if you are for some reason patching window.onerror
as well; if the teardown step does not see the expected handler in place before restoring the original handler it will throw and error to alert you to an "out-of-sequence interceptor teardown." In the rare case you have competing patches of window.onerror
you can use the next option, ignoreWindowResizeObserverLoopErrors
.
ignoreWindowResizeObserverLoopErrors()
This method allows you to be specific about the timing/ordering that the window.onerror
patch is removed, which may be necessary if you have more complicated setups and/or multiple patches to window.onerror
. ignoreWindowResizeObserverLoopErrors
returns a function that restores onerror
to its original form prior to the patch. Notice that multiple patches generally need to removed in reverse order.
import {ignoreWindowResizeObserverLoopErrors} from '@lit-labs/virtualizer/support/resize-observer-errors.js';
describe('My virtualized collection', () => {
let teardown;
beforeEach(() => (teardown = ignoreWindowResizeObserverLoopErrors()));
beforeEach(() => applyOtherWindowOnErrorPatch());
afterEach(() => removeOtherWindowOnErrorPatch());
afterEach(() => teardown());
it('does this and that', () => {
// etc
});
});
preventResizeObserverLoopErrorEventDefaults()
If an explicit window.onerror
handler function has not been defined, you may be able to swallow up the loop limit errors with an event listener. This function adds that event listener to window and attempts to ignore and prevent any further event propogation or behaviors as a result.
import {preventResizeObserverLoopErrorEventDefaults} from '@lit-labs/virtualizer/support/resize-observer-errors.js';
preventResizeObserverLoopErrorEventDefaults();
If you need to remove the event listener that this function adds at some point, you can assign the return of the function, which is a function that removes the listener, to a variable for later use:
const teardown = preventResizeObserverLoopErrorEventDefaults();
/* some time later... */
teardown();
Note that for this to be effective, you'll need to call it to add the event listener to window as early as you can, to ensure it is in place prior to any other event listeners who would otherwise receive the event first.
API Reference
items
property
Type: Array<T>
An array of items (JavaScript values, typically objects) representing the child elements of the virtualizer.
The types of values you use to represent your items are entirely up to you, as long as your renderItem
function can transform each value into a child element.
renderItem
property
Type: (item: T, index?: number) => TemplateResult
A function that returns a Lit TemplateResult
. It will be used to generate a child element for each item in the items
array.
scroller
attribute / property
Type: Boolean
Optional. If this attribute is present (or, in the case of the virtualize
directive, if this property has a truthy value), then the virtualizer itself will be a scroller. Otherwise, the virtualizer will not scroll but will size itself to take up enough space for all of its children, including those that aren't currently present in the DOM.
scrollToIndex
method
Type: (index: number, position?: string) => void
where position is: 'start'|'center'|'end'|'nearest'
Scroll to the item at the given index. Place the item at the given position within the viewport. For example, if index is 100
and position is end
, then the bottom of the item at index 100 will be at the bottom of the viewport. Position defaults to start
.
Note: Details of the scrollToIndex
API are likely to change before the 1.0 release, but changes required to your existing code should be minimal and mechanical in nature.
Example usage:
// Where `myVirtualizer` is a reference to a <lit-virtualizer> instance, this
// will scroll to the 100th item and put it in the center of the viewport.
myVirtualizer.scrollToIndex(100, 'center');
visibilityChanged
event
Fired whenever a change to the viewport (due to scrolling or resizing) affects the set of virtualizer child elements that are currently visible. The first
property represents the index of the first visible element; the last
property represents the index of the last visible element.
rangeChanged
event
Fired whenever a virtualizer adds child elements to the DOM, or removes child elements from the DOM. The first
property represents the index of the first element currently present in the DOM; the last
property represents the index of the last element currently present in the DOM.
Note that a virtualizer maintains a "buffer" of elements that are in the DOM but just outside the viewport, so the set of elements in the DOM will be somewhat larger than the set of visible elements.