Summary:
Demonstrate IndexLSH does not need training or codebook serialization
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/4009
Reviewed By: junjieqi
Differential Revision: D65274645
Pulled By: asadoughi
fbshipit-source-id: c9af463757edbd07cc07b1cf607b88373fa334c4
Summary:
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/3989
Moved add_sa_codes, sa_code_size to Index, IndexBinary base classes from IndexIVF to support adding coded vectors with ids using IDMap2,PQ
For an alternative approach, see previous attempt with merge_ids and merge_codes: D64941798
Reviewed By: mnorris11
Differential Revision: D64972587
fbshipit-source-id: 71622fc35a378d9892569a56442a872f0c9c9e83
Summary:
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/3987
Created a new notebook demonstrating how to separate serializing and deserializing the PQ codebook (via faiss.write_index for IndexPQ) independently of the vector codes. For example, in the case where you have a few vector embeddings per user and want to shard the flat index by user you can re-use the same PQ method for all users but store each user's codes independently.
Reviewed By: junjieqi
Differential Revision: D64844978
fbshipit-source-id: ad6434101fbb3ef84999527a577ecb9b503e556c
Amir Sadoughi
Amir Sadoughi