mirror of
https://github.com/facebookresearch/faiss.git
synced 2025-06-03 21:54:02 +08:00
Reviewed By: mdouze Differential Revision: D26633983 fbshipit-source-id: 32b9f95ed9647716f65b93f2713a8d5bad6abe78
Benchmark of IVF variants
This is a benchmark of IVF index variants, looking at compression vs. speed vs. accuracy. The results are in this wiki chapter
The code is organized as:
-
datasets.py
: code to access the datafiles, compute the ground-truth and report accuracies -
bench_all_ivf.py
: evaluate one type of inverted file -
run_on_cluster_generic.bash
: callbench_all_ivf.py
for all tested types of indices. Since the number of experiments is quite large the script is structued so that the benchmark can be run on a cluster. -
parse_bench_all_ivf.py
: make nice tradeoff plots from all the results.
The code depends on Faiss and can use 1 to 8 GPUs to do the k-means clustering for large vocabularies.
It was run in October 2018 for the results in the wiki.