@jellyfin/libass-wasm
v4.2.3
Published
libass Subtitle Renderer and Parser library for browsers
Downloads
4,553
Maintainers
Readme
SubtitlesOctopus displays subtitles in .ass format and easily integrates with HTML5 videos. Since it uses libass, SubtitlesOctopus supports most SSA/ASS features and enables you to get consistent results in authoring and web-playback, provided libass is also used locally.
ONLINE DEMO / other examples with demo
Features
- Supports most SSA/ASS features (everything libass supports)
- Supports all OpenType- and TrueType-fonts (including woff2 fonts)
- Works fast (because uses WebAssembly with fallback to asm.js if it's not available)
- Uses Web Workers thus video and interface doesn't lag even on "heavy" subtitles (working in background)
- Doesn't use DOM manipulations and render subtitles on single canvas
- Fully compatible with libass' extensions (but beware of compatability to other ASS-renderers when using them)
- Easy to use - just connect it to video element
Included Libraries
- libass
- expat
- fontconfig
- freetype
- fribidi
- harfbuzz
- brotli
Usage
To start using SubtitlesOctopus you only need to instantiate a new instance of
SubtitlesOctopus
and specify its Options.
var options = {
video: document.getElementById('video'), // HTML5 video element
subUrl: '/test/test.ass', // Link to subtitles
fonts: ['/test/font-1.ttf', '/test/font-2.ttf'], // Links to fonts (not required, default font already included in build)
workerUrl: '/libassjs-worker.js', // Link to WebAssembly-based file "libassjs-worker.js"
legacyWorkerUrl: '/libassjs-worker-legacy.js' // Link to non-WebAssembly worker
};
var instance = new SubtitlesOctopus(options);
After that SubtitlesOctopus automatically "connects" to your video and it starts to display subtitles. You can use it with any HTML5 player.
Using only with canvas
You're also able to use it without any video. However, that requires you to set the time the subtitles should render at yourself:
var options = {
canvas: document.getElementById('canvas'), // canvas element
subUrl: '/test/test.ass', // Link to subtitles
fonts: ['/test/font-1.ttf', '/test/font-2.ttf'], // Links to fonts (not required, default font already included in build)
workerUrl: '/libassjs-worker.js' // Link to file "libassjs-worker.js"
};
var instance = new SubtitlesOctopus(options);
// And then...
instance.setCurrentTime(15); // Render subtitles at 00:15 on your canvas
Changing subtitles
You're not limited to only display the subtitle file you referenced in your options. You're able to dynamically change subtitles on the fly. There's three methods that you can use for this specifically:
setTrackByUrl(url)
: works the same as thesubUrl
option. It will set the subtitle to display by its URL.setTrack(content)
: works the same as thesubContent
option. It will set the subtitle to dispaly by its content.freeTrack()
: this simply removes the subtitles. You can use the two methods above to set a new subtitle file to be displayed.
var instance = new SubtitlesOctopus(options);
// ... we want to change the subtitles to the Railgun OP
instance.setTrackByUrl('/test/railgun_op.ass');
Cleaning up the object
After you're finished with rendering the subtitles. You need to call the
instance.dispose()
method to correctly dispose of the object.
var instance = new SubtitlesOctopus(options);
// After you've finished using it...
instance.dispose();
Options
When creating an instance of SubtitleOctopus, you can set the following options:
video
: The video element to attach listeners to. (Optional)canvas
: The canvas to render the subtitles to. If none is given it will create a new canvas and insert it as a sibling of the video element (only if the video element exists). (Optional)subUrl
: The URL of the subtitle file to play. (Require eithersubUrl
orsubContent
to be specified)subContent
: The content of the subtitle file to play. (Require eithersubContent
orsubUrl
to be specified)workerUrl
: The URL of the worker. (Default:libassjs-worker.js
)fonts
: An array of links to the fonts used in the subtitle. (Optional)availableFonts
: Object with all available fonts - Key is font name in lower case, value is link:{"arial": "/font1.ttf"}
(Optional)fallbackFont
: URL to override fallback font, for example, with a CJK one. Default fallback font is Liberation Sans (Optional)lazyFileLoading
: A boolean, whether to load files in a lazy way via FS.createLazyFile(). RequiresAccess-Control-Expose-Headers
forAccept-Ranges, Content-Length, and Content-Encoding
. If encoding is compressed or length is not set, file will be fully fetched instead of just a HEAD request.timeOffset
: The amount of time the subtitles should be offset from the video. (Default:0
)onReady
: Function that's called when SubtitlesOctopus is ready. (Optional)onError
: Function called in case of critical error meaning the subtitles wouldn't be shown and you should use an alternative method (for instance it occurs if browser doesn't support web workers). (Optional)debug
: Whether performance info is printed in the console. (Default:false
)renderMode
: Rendering mode. (If not set, the deprecated optionlossyRender
is evaluated)js-blend
- JS Blendingwasm-blend
- WASM Blending, currently the defaultlossy
- Lossy Render Mode (EXPERIMENTAL)
targetFps
: Target FPS (Default:24
)libassMemoryLimit
: libass bitmap cache memory limit in MiB (approximate) (Default:0
- no limit)libassGlyphLimit
: libass glyph cache memory limit in MiB (approximate) (Default:0
- no limit)prescaleFactor
: Scale down (< 1.0
) the subtitles canvas to improve performance at the expense of quality, or scale it up (> 1.0
). (Default:1.0
- no scaling; must be a number > 0)prescaleHeightLimit
: The height beyond which the subtitles canvas won't be prescaled. (Default:1080
)maxRenderHeight
: The maximum rendering height of the subtitles canvas. Beyond this subtitles will be upscaled by the browser. (Default:0
- no limit)dropAllAnimations
: Remove all animation tags, such as karaoke, move, fade, etc. (Default:false
)renderAhead
: How many MiB (approximate) of subtitles to render ahead and store. (Default:0
- don't render ahead)resizeVariation
: The resize threshold at which the cache of pre-rendered events is cleared. (Default:0.2
)
Rendering Modes
JS Blending
To use this mode set renderMode
to js-blend
upon instance creation.
This will do all the processing of the bitmaps produced by libass outside of WebAssembly.
WASM Blending
To use this mode set renderMode
to wasm-blend
upon instance creation.
This will blend the bitmaps of the different events together in WebAssembly,
so the JavaScript-part only needs to process a single image.
If WebAssembly-support is available this will be faster than the default mode,
especially for many and/or complex simultaneous subtitles.
Without WebAssembly-support it will fallback to asm.js and
should at least not be slower than the default mode.
Lossy Render Mode (EXPERIMENTAL)
To use this mode set renderMode
to lossy
upon instance creation.
The Lossy Render mode has been created by @no1d as a suggestion for fix browser
freezing when rendering heavy subtitles (#46), it uses
createImageBitmap
to render the bitmap in the Worker, using Promises instead of direct render on
canvas in the Main Thread. When the browser start to hang, it will not lock main
thread, instead will run Async, so if the function createImageBitmap fail, it
will not stop the rendering process at all and may cause some bitmap loss or
simply will not draw anything in canvas, mostly on low end devices.
WARNING: Experimental, not stable and not working in some browsers
Render Ahead (WASM Blending with pre-rendering) (EXPERIMENTAL)
Upon creating the SubtitleOctopus instance, set renderAhead
in the options to a positive value to use this mode.
In this mode, SubtitleOctopus renders events in advance (using WASM blending) so that they are ready in time.
The amount of pre-rendered events is controlled by the renderAhead
option.
Each pre-rendered event is provided with information about its start time, end time, and end time of the gap after (if any).
This mode will analyse the events to avoid rendering empty sections or rerendering non-animated events.
Resizing the video player clears the cache of pre-rendered events (the threshold is set by resizeVariation
).
The
renderMode
andlossyRender
options are ignored.
WARNING: Experimental, may stall on heavily animated subtitles This mode tries to render every transition - at worst, every frame - in advance. If the rendering of many frames takes too long and the cache of prepared frames gets depleted (e.g. during a long section with heavy animations), the current subtitle-frame will continue to be displayed until the prerendering can catch up again. Adjusting
prescaleFactor
,prescaleHeightLimit
andmaxRenderHeight
to lower the resolution of the rendering canvas can work around this at the expense of visual quality.
Brotli Compressed Subtitles (DEPRECATED)
Manual support for brotli-compressed subtitles is tentatively deprecated and may be removed with the next release.
Instead use HTTP's Content-Encoding:
header to transmit files compressed and
let the browser handle decompression before it reaches JSO. This supports more
compression algorithms and is likely faster.
Do not use a .br
file extension if you use Content-Ecoding:
as this will
conflict with the still existing manual support which tries to decompress any data
with a .br
extension.
How to build?
Dependencies
- git
- emscripten (Configure the enviroment)
- make
- python3
- cmake
- pkgconfig
- patch
- libtool
- autotools (autoconf, automake, autopoint)
- gettext
- ragel - Required by Harfbuzz
- itstool - Required by Fontconfig
- python3-ply - Required by WebIDL
- gperf - Required by Fontconfig
- licensecheck
Get the Source
Run git clone --recursive https://github.com/jellyfin/JavascriptSubtitlesOctopus.git
Build inside a Container
Docker
- Install Docker
./run-docker-build.sh
- Artifacts are in /dist/js
Buildah
- Install Buildah and a suitable backend for
buildah run
likecrun
orrunc
./run-buildah-build.sh
- Artifacts are in /dist/js
Build without Containers
- Install the dependency packages listed above
make
- If on macOS with libtool from brew,
LIBTOOLIZE=glibtoolize make
- If on macOS with libtool from brew,
- Artifacts are in /dist/js
Why "Octopus"?
How am I an Octopus? Ba da ba da ba!