Does removing stop words from text affect stanford

2019-07-26 18:10发布

we are trying to implement name entity recognition on millions of comments/feedback and the process appears to be slow. We are thinking of removing stop words/frequent words from the texts and apply ner on them. Does removing stop words affect the accuracy of ner?

1条回答
老娘就宠你
2楼-- · 2019-07-26 18:40

I think it's plausible you will get respectable F1 scores if you run on a sentence with the stop words removed. Ultimately you will have to experiment with it and see if the quality is acceptable for your needs.

查看更多
登录 后发表回答