
正文
python去除停用词(结巴分词下)
提示:扫一扫查出行【扫一扫了解最新限行尾号】
复制提示
python 去除停用词 结巴分词
import jieba
#stopwords = {}.fromkeys([ line.rstrip() for line in open('stopword.txt') ])
stopwords = {}.fromkeys(['的', '附近'])
segs = jieba.cut('北京附近的租房', cut_all=False)
final = ''
for seg in segs:
seg = seg.encode('gbk')
if seg not in stopwords:
final += seg
print final







