Billion-scale similarity search with GPUs

J Johnson, M Douze, H Jégou - IEEE Transactions on Big Data, 2019 - ieeexplore.ieee.org
… [58] appears suitable for billion-scale datasets with quantization … on GPUs, which we compare
against in Section 6.4 on the largest (billion-scale) public benchmarks for similarity search. …

Robustiq: A robust ann search method for billion-scale similarity search on gpus

W Chen, J Chen, F Zou, YF Li, P Lu… - Proceedings of the 2019 on …, 2019 - dl.acm.org
… In this paper, we present RobustiQ, a novel billion-scale ANN similarity search framework.
RobustiQ includes a three-level hierarchical inverted indexing structure based on Vector and …

Vector and line quantization for billion-scale similarity search on GPUs

W Chen, J Chen, F Zou, YF Li, P Lu, Q Wang… - Future Generation …, 2019 - Elsevier
… In this subsection we introduce several billion-scale similarity retrieval systems that apply VQ…
-the-art systems for billion-scale high-dimensional ANN search. Their indexing structure and …

Hierarchical quantization for billion-scale similarity retrieval on gpus

W Chen, X Ma, J Zeng, Y Duan, G Zhong - Computers & Electrical …, 2021 - Elsevier
… for billion-scale dataset In this subsection we introduce several billion-scale similarity
PQT [21] is the first retrieval system that can handle billion-scale dataset on GPU. PQT uses …

[PDF][PDF] BANG: Billion-Scale Approximate Nearest Neighbor Search using a Single GPU

V Karthik, S Khan, S Singh, HV Simhadri… - arXiv e …, 2024 - ssomesh.github.io
GPU-based ANNS method which works efficiently on billion-scale datasets that cannot entirely
fit in the GPUBillion-scale similarity search with gpus. IEEE Transactions on Big Data 7, 3 …

BANG: Billion-Scale Approximate Nearest Neighbor Search using a Single GPU

S Khan, S Singh, HV Simhadri, J Vedurada - arXiv preprint arXiv …, 2024 - arxiv.org
GPU-based ANNS method which works efficiently on billion-scale datasets that cannot entirely
fit in the GPUBillion-scale similarity search with gpus. IEEE Transactions on Big Data 7, 3 …

Results of the NeurIPS'21 challenge on billion-scale approximate nearest neighbor search

HV Simhadri, G Williams, M Aumüller… - NeurIPS 2021 …, 2022 - proceedings.mlr.press
… This competition1 compares ANNS algorithms at billion-scale … , often the bottleneck in serving
billion-scale indices, where the … We compiled six diverse billion-scale datasets, four newly …

GTS: GPU-based Tree Index for Fast Similarity Search

Y Zhu, R Ma, B Zheng, X Ke, L Chen… - Proceedings of the ACM on …, 2024 - dl.acm.org
… Additionally, GGrid [39] leverages GPU-… GPU-based Batch search [30] optimizes brute-force,
approximate, and compressed-domain search to facilitate billion-scale similarity search. The …

Randomized algorithms accelerated over cpu-gpu for ultra-high dimensional similarity search

Y Wang, A Shrivastava, J Wang, J Ryu - Proceedings of the 2018 …, 2018 - dl.acm.org
… general purpose graphics processing units (GPU) to show impressive performance on billion
scale image datasets, with relatively small (128) dimensions. However, PQ, similar to other …

Recurrent binary embedding for gpu-enabled exhaustive retrieval from billion-scale semantic vectors

Y Shan, J Jiao, J Zhu, JC Mao - Proceedings of the 24th ACM SIGKDD …, 2018 - dl.acm.org
… Rapid advances in GPU hardware and multiple areas of Deep Learning open up a new
opportunity for billion-scale information retrieval with exhaustive search. Building on top of the …