faiss/demos
Amir Sadoughi acaa01f32d Moved add_sa_codes, sa_code_size to Index, IndexBinary base classes (#3989)
Summary:
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/3989

Moved add_sa_codes, sa_code_size to Index, IndexBinary base classes from IndexIVF to support adding coded vectors with ids using IDMap2,PQ

For an alternative approach, see previous attempt with merge_ids and merge_codes: D64941798

Reviewed By: mnorris11

Differential Revision: D64972587

fbshipit-source-id: 71622fc35a378d9892569a56442a872f0c9c9e83
2024-10-28 19:56:00 -07:00
..
offline_ivf Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
rocksdb_ivf Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
CMakeLists.txt Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
README.md
demo_auto_tune.py Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_client_server_ivf.py Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_distributed_kmeans_torch.py Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_imi_flat.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_imi_pq.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_ivfpq_indexing.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_nndescent.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_ondisk_ivf.py Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_qinco.py Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_residual_quantizer.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_sift1M.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
demo_weighted_kmeans.cpp Enable linting: lint config changes plus arc lint command (#3966) 2024-10-22 09:46:48 -07:00
index_pq_flat_separate_codes_from_codebook.py Moved add_sa_codes, sa_code_size to Index, IndexBinary base classes (#3989) 2024-10-28 19:56:00 -07:00

README.md

Demos for a few Faiss functionalities

demo_auto_tune.py

Demonstrates the auto-tuning functionality of Faiss

demo_ondisk_ivf.py

Shows how to construct a Faiss index that stores the inverted file data on disk, eg. when it does not fit in RAM. The script works on a small dataset (sift1M) for demonstration and proceeds in stages:

0: train on the dataset

1-4: build 4 indexes, each containing 1/4 of the dataset. This can be done in parallel on several machines

5: merge the 4 indexes into one that is written directly to disk (needs not to fit in RAM)

6: load and test the index