walkie_talkie
v1.2.0
Published
A small module to tokenize sentences
Downloads
3
Maintainers
Readme
Walkie Talkie
A simple module to tokenize strings.
Installation
npm install walkie_talkie
Usage
const walkietalkie = require('walkie_talkie');
walkietalkie.process('I have been dreaming of this');
walkietalkie.process('J\'ai reve de ca', 'fr', true);
// last parameter is appostrophe, if words like "j'ai" should be kept together