trigrams

Trigrams for 460+ languages.

Contents

• What is this?
• When should I use this?
• Install
• Use
• API
  • top()
  • min()
• Data
• Types
• Compatibility
• Contribute
• Security
• License

What is this?

This package exposes all trigrams for natural languages. Based on the most translated copyright-free document on this planet: UDHR.

When should I use this?

When you are dealing with natural language detection.

Install

This package is ESM only. In Node.js (version 14.14+, 16.0+), install with npm:

npm install trigrams

In Deno with esm.sh:

import {top, min} from 'https://esm.sh/trigrams@5'

In browsers with esm.sh:

<script type="module">
  import {top, min} from 'https://esm.sh/trigrams@5?bundle'
</script>

Use

import {top, min} from 'trigrams'

console.log((await top()).pam)
console.log((await min()).nld)

Yields:

{ // 300 top trigrams.
  'isa': 6,
  'upa': 6,
  'i k': 6,
  // …
  'ang': 273,
  'ing': 282,
  'ng ': 572 // Most common trigram with how often it was found.
}

[ // 300 top trigrams.
  ' ar',
  'eer',
  'tij',
  // …
  'de ',
  'an ',
  'en ' // Most common trigram.
]

API

This package exports the identifiers top and min. There is no default export.

top()

Get top trigrams to occurrence counts.

Returns

Returns a promise resolving to an object mapping UDHR in Unicode codes to objects mapping the top 300 trigrams to occurrence counts (Promise<Record<string, Record<string, number>>>).

min()

Get top trigrams.

Returns

Returns a promise resolving to arrays containing the top 300 trigrams sorted from least occurring to most occurring (Promise<Record<string, Array<string>>>).

Data

The trigrams are based on the unicode versions of the universal declaration of human rights.

The files are created from all paragraphs made available by wooorm/udhr and do not include headings and such.

Before creating trigrams,

• the unicode characters from \u0021 to \u0040 (both including) are removed
• one or more white space characters (\s+) are replaced with a single space
• alphabetic characters are lower cased ([A-Z])

Additionally, the input is padded with two spaces on both sides.

| Code | Name | | - | - | | 007 | Sãotomense | | 008 | Crioulo, Upper Guinea (008) | | 009 | Mbundu (009) | | 010 | Tetun Dili | | 011 | Umbundu (011) | | 013 | (Mijisa) | | 014 | (Maiunan) | | 016 | (Minjiang, spoken) | | 017 | (Minjiang, written) | | 020 | Drung | | 021 | (Muzzi) | | 022 | (Klau) | | 025 | (Bizisa) | | 026 | (Yeonbyeon) | | 027 | Gumuz | | 028 | Kafa | | 029 | Sidamo | | 030 | Kituba (2) | | 032 | South Azerbaijani | | 041 | Latvian (2) | | 042 | Spanish (resolution) | | 043 | Zarma | | aar | Afar | | abk | Abkhaz | | ace | Aceh | | acu | Achuar-Shiwiar | | acu_1 | Achuar-Shiwiar (1) | | ada | Dangme | | ady | Adyghe | | afr | Afrikaans | | agr | Aguaruna | | aii | Assyrian Neo-Aramaic | | ajg | Aja | | aka_akuapem | Twi (Akuapem) | | aka_asante | Twi (Asante) | | aka_fante | Fante | | als | Albanian, Tosk | | alt | Altai, Southern | | amc | Amahuaca | | ame | Yaneshaʼ | | amh | Amharic | | ami | Amis | | amr | Amarakaeri | | arb | Arabic, Standard | | arl | Arabela | | arn | Mapudungun | | ast | Asturian | | auc | Waorani | | auv | Occitan (Auvergnat) | | ayr | Aymara, Central | | azj_cyrl | Azerbaijani, North (Cyrillic) | | azj_latn | Azerbaijani, North (Latin) | | bam | Bamanankan | | ban | Bali | | bax | Bamun | | bba | Baatonum | | bci | Baoulé | | bcl | Bicolano, Central | | bel | Belarusan | | bem | Bemba | | ben | Bengali | | bfa | Bari | | bho | Bhojpuri | | bin | Edo | | bis | Bislama | | blt | Tai Dam | | blu | Hmong Njua | | boa | Bora | | bod | Tibetan, Central | | bos_cyrl | Bosnian (Cyrillic) | | bos_latn | Bosnian (Latin) | | bre | Breton | | btb | Bulu | | buc | Bushi | | bug | Bugis | | bul | Bulgarian | | cab | Garifuna | | cak | Kaqchikel, Central | | cat | Catalan-Valencian-Balear | | cbi | Chachi | | cbr | Cashibo-Cacataibo | | cbs | Cashinahua | | cbt | Chayahuita | | cbu | Candoshi-Shapra | | ccx | Zhuang, Yongbei | | ceb | Cebuano | | ces | Czech | | cha | Chamorro | | chj | Chinantec, Ojitlán | | chk | Chuukese | | chr_cased | Cherokee (cased) | | chr_uppercase | Cherokee (uppercase) | | chv | Chuvash | | cic | Chickasaw | | cjk | Chokwe | | cjk_AO | Chokwe (Angola) | | cjs | Shor | | ckb | Kurdish, Central | | cnh | Chin, Haka | | cni | Asháninka | | cnr | Montenegrin | | cof | Colorado | | cos | Corsican | | cot | Caquinte | | cpu | Ashéninka, Pichis | | crh | Crimean Tatar | | crs | Seselwa Creole French | | csa | Chinantec, Chiltepec | | csw | Cree, Swampy | | ctd | Chin, Tedim | | cym | Welsh | | dag | Dagbani | | dan | Danish | | ddn | Dendi | | deu_1901 | German, Standard (1901) | | deu_1996 | German, Standard (1996) | | dga | Dagaare, Southern | | dip | Dinka, Northeastern | | div | Maldivian | | dyo | Jola-Fonyi | | dyu | Jula | | dzo | Dzongkha | | ell_monotonic | Greek (monotonic) | | ell_polytonic | Greek (polytonic) | | emk | Maninkakan, Eastern | | eml | Romagnolo | | eng | English | | epo | Esperanto | | ese | Ese Ejja | | est | Estonian | | eus | Basque | | eve | Even | | evn | Evenki | | ewe | Éwé | | fao | Faroese | | fij | Fijian | | fin | Finnish | | fkv | Finnish, Kven | | flm | Chin, Falam | | fon | Fon | | fra | French | | fri | Frisian, Western | | fuf | Pular | | fur | Friulian | | fuv | Fulfulde, Nigerian | | fuv2 | Fulfulde, Nigerian (2) | | fvr | Fur | | gaa | Ga | | gag | Gagauz | | gax | Oromo, Borana-Arsi-Guji | | gjn | Gonja | | gkp | Kpelle, Guinea | | gla | Gaelic, Scottish | | gld | Nanai | | gle | Gaelic, Irish | | glg | Galician | | glv | Manx | | gsw1 | Alemannisch (Elsassisch) | | guc | Wayuu | | gug | Guaraní, Paraguayan | | guj | Gujarati | | guu | Yanomamö | | gyr | Guarayu | | hat_kreyol | Haitian Creole French (Kreyol) | | hat_popular | Haitian Creole French (Popular) | | hau_NE | Hausa (Niger) | | hau_NG | Hausa (Nigeria) | | hau_3 | Hausa | | haw | Hawaiian | | hea | Hmong, Northern Qiandong | | heb | Hebrew | | hil | Hiligaynon | | hin | Hindi | | hlt | Chin, Matu | | hms | Hmong, Southern Qiandong | | hna | Gen | | hni | Hani | | hns | Hindustani, Sarnami | | hrv | Croatian | | hsb | Sorbian, Upper | | hsf | Huastec (Sierra de Otontepec) | | hun | Hungarian | | hus | Huastec (Veracruz) | | huu | Huitoto, Murui | | hva | Huastec (San Luís Potosí) | | hye | Armenian | | ibb | Ibibio | | ibo | Igbo | | ido | Ido | | idu | Idoma | | ijs | Ijo, Southeast | | ike | Inuktitut, Eastern Canadian | | ilo | Ilocano | | ina | Interlingua | | ind | Indonesian | | isl | Icelandic | | ita | Italian | | jav | Javanese (Latin) | | jav_java | Javanese (Javanese) | | jiv | Shuar | | jpn | Japanese | | jpn_osaka | Japanese (Osaka) | | jpn_tokyo | Japanese (Tokyo) | | kaa | Karakalpak | | kal | Inuktitut, Greenlandic | | kan | Kannada | | kat | Georgian | | kaz | Kazakh | | kbd | Kabardian | | kbp | Kabiyé | | kde | Makonde | | kdh | Tem | | kea | Kabuverdianu | | kek | Q'eqchi' | | kha | Khasi | | khk | Mongolian, Halh (Cyrillic) | | khm | Khmer, Central | | kin | Rwanda | | kir | Kirghiz | | kjh | Khakas | | kkh_lana | Khün | | kmb | Mbundu | | kmr | Kurdish, Northern | | knc | Kanuri, Central | | kng | Koongo | | kng_AO | Koongo (Angola) | | koi | Komi-Permyak | | koo | Konjo | | kor | Korean | | kqn | Kaonde | | kqs | Kissi, Northern | | kri | Krio | | krl | Karelian | | ktu | Kituba | | kwi | Awa-Cuaiquer | | lad | Ladino | | lao | Lao | | lat | Latin | | lat_1 | Latin (1) | | lav | Latvian | | lia | Limba, West-Central | | lij | Ligurian | | lin | Lingala | | lin_tones | Lingala (tones) | | lit | Lithuanian | | lld | Ladin | | lnc | Occitan (Languedocien) | | lns | Lamnso' | | lob | Lobi | | lot | Otuho | | loz | Lozi | | ltz | Luxembourgeois | | lua | Luba-Kasai | | lue | Luvale | | lug | Ganda | | lun | Lunda | | lus | Mizo | | mad | Madura | | mag | Magahi | | mah | Marshallese | | mai | Maithili | | mal | Malayalam | | mal_chillus | Malayalam | | mam | Mam, Northern | | mar | Marathi | | maz | Mazahua Central | | mcd | Sharanahua | | mcf | Matsés | | men | Mende | | mfq | Moba | | mic | Micmac | | min | Minangkabau | | miq | Mískito | | mkd | Macedonian | | mlt | Maltese | | mly_arab | Malay (Arabic) | | mly_latn | Malay (Latin) | | mnw | Mon | | mor | Moro | | mos | Mòoré | | mri | Maori | | mto | Mixe, Totontepec | | mxi | Mozarabic | | mxv | Mixtec, Metlatónoc | | mya | Burmese | | mzi | Mazatec, Ixcatlán | | nav | Navajo | | nba | Nyemba | | nbl | Ndebele | | ndo | Ndonga | | nds | Saxon, Low | | nep | Nepali | | nhn | Nahuatl, Central | | nio | Nganasan | | niu | Niue | | niv | Gilyak | | njo | Naga, Ao | | nku | Kulango, Bouna | | nld | Dutch | | nno | Norwegian, Nynorsk | | nob | Norwegian, Bokmål | | not | Nomatsiguenga | | nso | Sotho, Northern | | nya_chechewa | Nyanja (Chechewa) | | nya_chinyanja | Nyanja (Chinyanja) | | nym | Nyamwezi | | nyn | Nyankore | | nzi | Nzema | | oaa | Orok | | oci_1 | Occitan (Francoprovençal, Fribourg) | | oci_2 | Occitan (Francoprovençal, Savoie) | | oci_3 | Occitan (Francoprovençal, Vaud) | | oci_4 | Occitan (Francoprovençal, Valais) | | ojb | Ojibwa, Northwestern | | oki | Okiek | | orh | Oroqen | | oss | Osetin | | ote | Otomi, Mezquital | | pam | Pampangan | | pan | Panjabi, Eastern | | pap | Papiamentu | | pau | Palauan | | pbb | Páez | | pbu | Pashto, Northern | | pcd | Picard | | pcm | Pidgin, Nigerian | | pes_1 | Farsi, Western | | pes_2 | Dari | | pis | Pijin | | piu | Pintupi-Luritja | | plt | Malagasy, Plateau | | pnb | Panjabi, Western | | pol | Polish | | pon | Pohnpeian | | por_BR | Portuguese (Brazil) | | por_PT | Portuguese (Portugal) | | pov | Crioulo, Upper Guinea | | ppl | Pipil | | prv | Occitan | | quc | K'iche', Central | | qud | Quechua (Unified Quichua, old Hispanic orthography) | | qug | Quichua, Chimborazo Highland | | quy | Quechua, Ayacucho | | quz | Quechua, Cusco | | qva | Quechua, Ambo-Pasco | | qvc | Quechua, Cajamarca | | qvh | Quechua, Huamalíes-Dos de Mayo Huánuco | | qvm | Quechua, Margos-Yarowilca-Lauricocha | | qvn | Quechua, North Junín | | qwh | Quechua, Huaylas Ancash | | qxa | Quechua, South Bolivian | | qxn | Quechua, Northern Conchucos Ancash | | qxu | Quechua, Arequipa-La Unión | | rar | Rarotongan | | rmn | Romani, Balkan | | rmn_1 | Romani, Balkan (1) | | rmy | Aromanian | | roh | Romansch | | roh_puter | Romansch (Puter) | | roh_rumgr | Romansch (Grischun) | | roh_surmiran | Romansch (Surmiran) | | roh_sursilv | Romansch (Sursilvan) | | roh_sutsilv | Romansch (Sutsilvan) | | roh_vallader | Romansch (Vallader) | | ron_1953 | Romanian (1953) | | ron_1993 | Romanian (1993) | | ron_2006 | Romanian (2006) | | run | Rundi | | rus | Russian | | sag | Sango | | sah | Yakut | | san | Sanskrit | | sco | Scots | | sey | Secoya | | shk | Shilluk | | shn | Shan | | shp | Shipibo-Conibo | | sin | Sinhala | | skr | Seraiki | | slk | Slovak | | slr | Salar | | slv | Slovenian | | sme | Saami, North | | smo | Samoan | | sna | Shona | | snk | Soninke | | snn | Siona | | som | Somali | | sot | Sotho, Southern | | spa | Spanish | | src | Sardinian, Logudorese | | srp_cyrl | Serbian (Cyrillic) | | srp_latn | Serbian (Latin) | | srr | Serer-Sine | | ssw | Swati | | suk | Sukuma | | sun | Sunda | | sus | Susu | | swb | Comorian, Maore | | swe | Swedish | | swh | Swahili | | tah | Tahitian | | tam | Tamil | | tam_LK | Tamil (Sri Lanka) | | tat | Tatar | | tbz | Ditammari | | tca | Ticuna | | tel | Telugu | | tem | Themne | | tet | Tetun | | tgk | Tajiki | | tgl | Tagalog | | tha | Thai | | tha2 | Thai (2) | | tir | Tigrigna | | tiv | Tiv | | tly | Talysh | | tob | Toba | | toi | Tonga | | toj | Tojolabal | | ton | Tongan | | top | Totonac, Papantla | | tpi | Tok Pisin | | tsn | Tswana | | tso_MZ | Tsonga (Mozambique) | | tso_ZW | Tsonga (Zimbabwe) | | tsz | Purepecha | | tuk_cyrl | Turkmen (Cyrillic) | | tuk_latn | Turkmen (Latin) | | tur | Turkish | | tyv | Tuva | | tzc | Tzotzil (Chamula) | | tzh | Tzeltal, Oxchuc | | tzm | Tamazight, Central Atlas | | udu | Uduk | | uig_arab | Uyghur (Arabic) | | uig_latn | Uyghur (Latin) | | ukr | Ukrainian | | umb | Umbundu | | ura | Urarina | | urd | Urdu | | urd_2 | Urdu (2) | | uzn_cyrl | Uzbek, Northern (Cyrillic) | | uzn_latn | Uzbek, Northern (Latin) | | vai | Vai | | vec | Venetian | | ven | Venda | | ven2 | Venda | | vep | Veps | | vie | Vietnamese | | vmw | Makhuwa | | war | Waray-Waray | | wln | Walloon | | wol | Wolof | | wwa | Waama | | xho | Xhosa | | xsm | Kasem | | yad | Yagua | | yao | Yao | | yap | Yapese | | ydd | Yiddish, Eastern | | ykg | Yukaghir, Northern | | yor | Yoruba | | yrk | Nenets | | yua | Maya, Yucatán | | zam | Zapotec, Miahuatlán | | zdj | Comorian, Ngazidja | | zgh | Tamazight, Standard Morocan | | zro | Záparo | | ztu | Zapotec, Güilá | | zul | Zulu |

Types

This package is fully typed with TypeScript. It exports no additional types.

Compatibility

This package is at least compatible with all maintained versions of Node.js. As of now, that is Node.js 14.14+ and 16.0+. It also works in Deno and modern browsers.

Contribute

Yes please! See How to Contribute to Open Source.

Security

This package is safe.

License

MIT © Titus Wormer