zoukankan      html  css  js  c++  java
  • LibShortText 怎么处理中文文档

    LibShortText 是林智仁老师继 libsvm、liblinear 之后的另一力作,主要有几大特征:

    • It is more efficient than general text-mining packages. On a typical computer, processing and training 10 million short texts takes only around half an hour.
    • The fast training and testing is built upon the linear classifier LIBLINEAR
    • Default options often work well without tedious tuning.
    • An interactive tool for error analysis is included. Based on the property that each short text contains few words, LibShortText provides details in predicting each text.
    这么一个工具,如何使用在中文处理呢?
    尝试了一下中文的unigram feature的自动生成,发现中文character 没有count进unigram中=。=

    于是我发信问了作者
    作者回复:
    Unfortunately I don't think our code can now support Chinese
    documents.
    Chih-Jen

    但是,这完全是水平有限,对python不熟悉的后果,http://guoze.me/2014/09/25/libshorttext-introduction/ 这个链接里面,作者提出可以自己定制中文分词器来使程序work在中文上。
  • 相关阅读:
    c语言中统计字符串中数字出现的次数
    tyvj1294 小v的舞会
    tyvj1114 搭建双塔
    tyvj1193 括号序列
    tyvj1113 魔族密码
    tyvj1102 单词的划分
    tyvj1097 mm不哭
    tyvj1189 盖房子
    tyvj1098 任务安排
    tyvj1144 股票
  • 原文地址:https://www.cnblogs.com/zklidd/p/4079668.html
Copyright © 2011-2022 走看看