Why are multiple model files created in gensim wor

2019-02-22 11:32发布

When I try to create a word2vec model (skipgram with negative sampling) I received 3 files as output as follows.

word2vec (File)
word2vec.syn1nef.npy (NPY file)
word2vec.wv.syn0.npy (NPY file)

I am just worried why this happens as for my previous test examples in word2vec I only received one model(no npy files).

Please help me.

1条回答
劳资没心,怎么记你
2楼-- · 2019-02-22 12:31

Models with larger internal vector-arrays can't be saved via Python 'pickle' to a single file, so beyond a certain threshold, the gensim save() method will store subsidiary arrays in separate files, using the more-efficient raw format of numpy arrays (.npy format).

You still load() the model by just specifying the root model filename; when the subsidiary arrays are needed, the loading code will find the side files – as long as they're kept beside the root file. So when moving a model elsewhere, be sure to keep all files with the same root filename together.

查看更多
登录 后发表回答