用于allennlp的corenlp分词器
allennlp-wordsplitter-corenlp的Python项目详细描述
所有分词器
将CoreNLPWordSplitter
添加到AllenNLP的标记器中。
配置
{"dataset_reader":{// ... ..."tokenizer":{"word_splitter":{"type":"corenlp_remote","url":"http://10.1.1.174:9000"}},// ... ...},// ... ...}
cli
allennlp train --include-package allennlp_wordsplitter_corenlp -s /your/output/dir /your/training/config/file