stopwords-iso v1.1.0
stopwords-iso
The most comprehensive collection of stopwords for multiple languages.
The collection follows the ISO 639-1 language code.
If you only need stopwords for a specific language, there is a separate collection for each.
Usage
The collection is in JSON format. You are free to use this collection any way you like. It is only currently published on npm, bower, and pip.
Node/JavaScript
$ npm install stopwords-iso
$ bower install stopwords-iso
// Node
const stopwords = require('stopwords-iso'); // object of stopwords for multiple languages
const english = stopwords.en; // English stopwords
Contributing
If you wish to remove or update some of the stopwords, please file an issue first before sending a PR on the repo of the specific language.
If you would like to add a stopword or a new set of stopwords, please add them as a new text file on the repo of the corresponding language.
Credits
All stopwords sources are listed here.
List of Included Languages
This table lists the entire set of ISO 639-1:2002 codes, with a check
mark indicating those language codes that are found in stopwords-iso.json
.
The list of codes itself is from www.loc.gov, which is the official "language codes list" and is linked to from www.iso.org.
ISO 639-1 Code | Language | Included Here |
---|---|---|
aa | Afar | |
ab | Abkhazian | |
af | Afrikaans | ✓ |
ak | Akan | |
sq | Albanian | |
am | Amharic | |
ar | Arabic | ✓ |
an | Aragonese | |
hy | Armenian | ✓ |
as | Assamese | |
av | Avaric | |
ae | Avestan | |
ay | Aymara | |
az | Azerbaijani | |
ba | Bashkir | |
bm | Bambara | |
eu | Basque | ✓ |
be | Belarusian | |
bn | Bengali | ✓ |
bh | Bihari languages | |
bi | Bislama | |
bo | Tibetan | |
bs | Bosnian | |
br | Breton | ✓ |
bg | Bulgarian | ✓ |
my | Burmese | |
ca | Catalan; Valencian | ✓ |
cs | Czech | ✓ |
ch | Chamorro | |
ce | Chechen | |
zh | Chinese | ✓ |
cu | Church Slavic; Old Slavonic; Church Slavonic; Old Bulgarian; Old Church Slavonic | |
cv | Chuvash | |
kw | Cornish | |
co | Corsican | |
cr | Cree | |
cy | Welsh | |
da | Danish | ✓ |
de | German | ✓ |
dv | Divehi; Dhivehi; Maldivian | |
nl | Dutch; Flemish | ✓ |
dz | Dzongkha | |
el | Greek, Modern (1453-) | ✓ |
en | English | ✓ |
eo | Esperanto | ✓ |
et | Estonian | ✓ |
ee | Ewe | |
fo | Faroese | |
fa | Persian | ✓ |
fj | Fijian | |
fi | Finnish | ✓ |
fr | French | ✓ |
fy | Western Frisian | |
ff | Fulah | |
ka | Georgian | |
gd | Gaelic; Scottish Gaelic | |
ga | Irish | ✓ |
gl | Galician | ✓ |
gv | Manx | |
gn | Guarani | |
gu | Gujarati | |
ht | Haitian; Haitian Creole | |
ha | Hausa | ✓ |
he | Hebrew | ✓ |
hz | Herero | |
hi | Hindi | ✓ |
ho | Hiri Motu | |
hr | Croatian | ✓ |
hu | Hungarian | ✓ |
ig | Igbo | |
is | Icelandic | |
io | Ido | |
ii | Sichuan Yi; Nuosu | |
iu | Inuktitut | |
ie | Interlingue; Occidental | |
ia | Interlingua (International Auxiliary Language Association) | |
id | Indonesian | ✓ |
ik | Inupiaq | |
it | Italian | ✓ |
jv | Javanese | |
ja | Japanese | ✓ |
kl | Kalaallisut; Greenlandic | |
kn | Kannada | |
ks | Kashmiri | |
kr | Kanuri | |
kk | Kazakh | |
km | Central Khmer | |
ki | Kikuyu; Gikuyu | |
rw | Kinyarwanda | |
ky | Kirghiz; Kyrgyz | |
kv | Komi | |
kg | Kongo | |
ko | Korean | ✓ |
kj | Kuanyama; Kwanyama | |
ku | Kurdish | ✓ |
lo | Lao | |
la | Latin | ✓ |
lv | Latvian | ✓ |
li | Limburgan; Limburger; Limburgish | |
ln | Lingala | |
lt | Lithuanian | ✓ |
lb | Luxembourgish; Letzeburgesch | |
lu | Luba-Katanga | |
lg | Ganda | |
mk | Macedonian | |
mh | Marshallese | |
ml | Malayalam | |
mi | Maori | |
mr | Marathi | ✓ |
ms | Malay | ✓ |
mg | Malagasy | |
mt | Maltese | |
mn | Mongolian | |
na | Nauru | |
nv | Navajo; Navaho | |
nr | Ndebele, South; South Ndebele | |
nd | Ndebele, North; North Ndebele | |
ng | Ndonga | |
ne | Nepali | |
nn | Norwegian Nynorsk; Nynorsk, Norwegian | |
nb | Bokmål, Norwegian; Norwegian Bokmål | |
no | Norwegian | ✓ |
ny | Chichewa; Chewa; Nyanja | |
oc | Occitan (post 1500) | |
oj | Ojibwa | |
or | Oriya | |
om | Oromo | |
os | Ossetian; Ossetic | |
pa | Panjabi; Punjabi | |
pi | Pali | |
pl | Polish | ✓ |
pt | Portuguese | ✓ |
ps | Pushto; Pashto | |
qu | Quechua | |
rm | Romansh | |
ro | Romanian; Moldavian; Moldovan | ✓ |
rn | Rundi | |
ru | Russian | ✓ |
sg | Sango | |
sa | Sanskrit | |
si | Sinhala; Sinhalese | |
sk | Slovak | ✓ |
sl | Slovenian | ✓ |
se | Northern Sami | |
sm | Samoan | |
sn | Shona | |
sd | Sindhi | |
so | Somali | ✓ |
st | Sotho, Southern | ✓ |
es | Spanish; Castilian | ✓ |
sc | Sardinian | |
sr | Serbian | |
ss | Swati | |
su | Sundanese | |
sw | Swahili | ✓ |
sv | Swedish | ✓ |
ty | Tahitian | |
ta | Tamil | |
tt | Tatar | |
te | Telugu | |
tg | Tajik | |
tl | Tagalog | ✓ |
th | Thai | ✓ |
ti | Tigrinya | |
to | Tonga (Tonga Islands) | |
tn | Tswana | |
ts | Tsonga | |
tk | Turkmen | |
tr | Turkish | ✓ |
tw | Twi | |
ug | Uighur; Uyghur | |
uk | Ukrainian | ✓ |
ur | Urdu | ✓ |
uz | Uzbek | |
ve | Venda | |
vi | Vietnamese | ✓ |
vo | Volapük | |
wa | Walloon | |
wo | Wolof | |
xh | Xhosa | |
yi | Yiddish | |
yo | Yoruba | ✓ |
za | Zhuang; Chuang | |
zu | Zulu | ✓ |