import_cidian() 函数,用于将 SCEL、QCEL、QPYD、BDICT 和 BCD 输入法字典中的单词导入到现有
worker 中。read_cidian() 函数,用于将支持的输入法词典读取到包含条目和编码组件的数据框中。stopwords_cn、stopwords_en 和 stopwords_full 三份停用词表。
停用词过滤默认情况下仍处于禁用状态。get_tuple() 函数;请使用 count_ngrams() 函数进行 n-gram 计数。import_cidian() to import words from SCEL, QCEL, QPYD, BDICT, and BCD input-method dictionaries
into an existing worker.read_cidian() to read supported input-method dictionaries into a data frame of entries and
coding components.stopwords_cn, stopwords_en, and stopwords_full stopwords datasets are now available for
explicit use; stopword filtering remains disabled by default.get_tuple(); use count_ngrams() for n-gram counting.jiebaR 的旧版 word tag 条目。worker() 现在接受 min_keyword_length 参数,用于控制 TF-IDF 和 TextRank 关键词提取返回的词项的最小
Unicode 长度。worker() 现在接受通过 user 参数传入的一个或多个用户词典路径;
词典会按照提供的顺序附加到路径中(qinwf/jiebaR#69)。word tag entries from jiebaR are supported.worker() now accepts min_keyword_length to control the minimum Unicode length of terms returned by
TF-IDF and TextRank keyword extraction.worker() now accepts one or more user dictionary paths through user; dictionaries are appended in
the supplied order (qinwf/jiebaR#69).初始 CRAN 提交。
已实现以下 API:
workersegmentsegment_batchtaggingtagging_batchkeywordskeywords_dftextranktextrank_dffreqcount_ngramsget_tuplefilter_segmentnew_user_wordadd_wordget_idf添加了必要的测试、文档、基准测试和网站。
Initial CRAN submission.
Implemented these APIs:
workersegmentsegment_batchtaggingtagging_batchkeywordskeywords_dftextranktextrank_dffreqcount_ngramsget_tuplefilter_segmentnew_user_wordadd_wordget_idfAdded necessary tests, documents, a benchmark, and the website.