faiss/c_api/IndexLSH_c.cpp
Matthijs Douze c0052c1533 IndexFlatCodes: a single parent for all flat codecs (#2132)
Summary:
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2132

This diff adds the class IndexFlatCodes that becomes the parent of all "flat" encodings.
IndexPQ
IndexFlat
IndexAdditiveQuantizer
IndexScalarQuantizer
IndexLSH
Index2Layer

The other changes are:
- for IndexFlat, there is no vector<float> with the data anymore. It is replaced with a `get_xb()` function. This broke quite a few external codes, that this diff also attempts to fix.
- I/O functions needed to be adapted. This is done without changing the I/O format for any index.
- added a small contrib function to get the data from the IndexFlat
- the functionality has been made uniform, for example remove_ids and add are now in the parent class.

Eventually, we may support generic storage for flat indexes, similar to `InvertedLists`, eg to memmap the data, but this will again require a big change.

Reviewed By: wickedfoo

Differential Revision: D32646769

fbshipit-source-id: 04a1659173fd51b130ae45d345176b72183cae40
2021-12-07 01:31:07 -08:00

48 lines
1.2 KiB
C++

/**
* Copyright (c) Facebook, Inc. and its affiliates.
*
* This source code is licensed under the MIT license found in the
* LICENSE file in the root directory of this source tree.
*/
// Copyright 2004-present Facebook. All Rights Reserved.
// -*- c++ -*-
#include "IndexLSH_c.h"
#include <faiss/IndexLSH.h>
#include "macros_impl.h"
using faiss::Index;
using faiss::IndexLSH;
DEFINE_DESTRUCTOR(IndexLSH)
DEFINE_INDEX_DOWNCAST(IndexLSH)
DEFINE_GETTER(IndexLSH, int, nbits)
DEFINE_GETTER(IndexLSH, int, code_size)
DEFINE_GETTER_PERMISSIVE(IndexLSH, int, rotate_data)
DEFINE_GETTER_PERMISSIVE(IndexLSH, int, train_thresholds)
int faiss_IndexLSH_new(FaissIndexLSH** p_index, idx_t d, int nbits) {
try {
*p_index = reinterpret_cast<FaissIndexLSH*>(new IndexLSH(d, nbits));
}
CATCH_AND_HANDLE
}
int faiss_IndexLSH_new_with_options(
FaissIndexLSH** p_index,
idx_t d,
int nbits,
int rotate_data,
int train_thresholds) {
try {
*p_index = reinterpret_cast<FaissIndexLSH*>(new IndexLSH(
d,
nbits,
static_cast<bool>(rotate_data),
static_cast<bool>(train_thresholds)));
}
CATCH_AND_HANDLE
}