gensimで英語の分かち書き[gensim][Python]

11月 6, 20187月 27, 2020

from gensim.utils import tokenize
list(tokenize("i am happy"))
>> ['i', 'am', 'happy']