Compressing LMDB files

2019-07-25 11:42发布

问题:

I am wondering if anyone has tried using compression techniques for their LMDB files? Typically, lmdb files typically do not use any compression. I am wondering if anyone has successfully stored data in an lmdb using jpeg compression on lmdb and then used it for caffe. I need this because I am working on a developer board with very limited storage space. If so, can you please provide steps/code to do this?

thanks

回答1:

Caffe also supports HDF5 which supports compression. If your dataset is smth like mnist - it may be a good choice.