tangger/Search-R1
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

add indexing for ANN and bm25

Browse Source
This commit is contained in:
PeterGriffinJin
2025-04-07 18:35:41 +00:00
parent a7fa1febff
commit 04d4152575
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
search_r1/search/build_index.sh
View File

@@ -4,6 +4,8 @@ save_dir=/the/path/to/save/index
retriever_name=e5 # this is for indexing naming retriever_name=e5 # this is for indexing naming
retriever_model=intfloat/e5-base-v2 retriever_model=intfloat/e5-base-v2
# change faiss_type to HNSW32/64/128 for ANN indexing
# change retriever_name to bm25 for BM25 indexing
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 python index_builder.py \ CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 python index_builder.py \
--retrieval_method $retriever_name \ --retrieval_method $retriever_name \
--model_path $retriever_model \ --model_path $retriever_model \