3 Commits

Author	SHA1	Message	Date
Matthijs Douze	441ccebbff	Make more Residual quantizer more memory efficient (#1865) ... Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1865 This diff chunks vectors to encode to make it more memory efficient. Reviewed By: sc268 Differential Revision: D28234424 fbshipit-source-id: c1afd2aaff953d4ecd339800d5951ae1cae4789a	2021-05-07 02:12:27 -07:00
Matthijs Douze	bb3c52a057	IndexResidual codec ... Summary: This diff adds the following to bring the residual quantizer support on-par with PQ: - IndexResidual can be built with index factory, serialized and used as a Faiss codec. - ResidualCoarseQuantizer can be used as a coarse quantizer for inverted files. The factory string looks like "RQ1x16_6x8" which means a first 16-bit quantizer then 6 8-bit ones. For IVF it's "IVF4096(RQ2x6),Flat". Reviewed By: sc268 Differential Revision: D27865612 fbshipit-source-id: f9f11d29e9f89d3b6d4cd22e9a4f9222422d5f26	2021-04-26 20:26:43 -07:00
Matthijs Douze	7559cf5c5b	add ResidualQuantizer ... Summary: This diff includes: - progressive dimension k-means. - the ResidualQuantizer object - GpuProgressiveDimIndexFactory so that it can be trained on GPU - corresponding tests - reference Python implementation of the same in scripts/matthijs/LCC_encoding Reviewed By: wickedfoo Differential Revision: D27608029 fbshipit-source-id: 9a8cf3310c8439a93641961ca8b042941f0f4249	2021-04-14 13:11:54 -07:00