Questions tagged [milvus]
Milvus is a vector database. Use this tag for questions specific to Milvus. For questions about vector databases in general, use "vector-database" tag.
milvus
122
questions
0
votes
0
answers
5
views
Milvus Collection Error with Duplicate Data When Inserted Once
I am working on an image similarity search project. I performed embedding insertion and created a collection through Milvus, but the retrieved results contain duplicate images and I have only inserted ...
0
votes
0
answers
34
views
pymilvus: Failed to create new connection using 03f6034f5bdb454fbf42ffd5c13d5a33
I am trying to make a script which summarizes the text fed it to a model and saves it on milvus.
My project is extracting content from 3 digital textbooks which have at least 300 pages each. This ...
-1
votes
0
answers
24
views
Embedding and Vector Search with Milvus
I am trying to make a RAG-based chatbot application that lets the user prompt in natural language and receive relevant information that can be retrieved a collection of from multiple tables, all of ...
0
votes
0
answers
13
views
How to insert data in sizes of 100-200GB to a collection faster? (pymilvus 2.4.3)
I am currently using pymilvus 2.4.3 and my data contains sparse vector.
I am currently using client.insert() but it has a 64mb rpc limit. I split my ~115GB data table into 1750 files using pyspark to ...
- 86
0
votes
0
answers
8
views
Milvus throws OOM exception when trying to load collection
I am experiencing an issue when attempting to load a collection into memory. Here are the details:
The collection was created from a CSV file that is 175KB in size and contains 461 rows.
Inserting ...
0
votes
0
answers
4
views
Why can't Datanode connect to kafka?
I am running Milvus 2.3.11 and using bitnami kafka for my log broker.
Due to many critical vulnerabilities in bitnami/kafka:3.1.0-debian-10-r52, I upgraded kafka to 3.7.0-debian-12-r6
After the ...
- 86
0
votes
0
answers
24
views
Why can't I create partition in Milvus running on Docker Compose
I'm new to Milvus so I'm trying to get familiar with it (not Milvus Lite) and I'm running it on Docker Compose. I want to create a partition but I'm receiving an error. How can I fix this issue? Just ...
- 11
0
votes
1
answer
19
views
Inconsistent Query Results Based on Output Fields Selection in Milvus Dashboard
I'm experiencing an issue with the Milvus dashboard where the search results change based on the selected output fields.
I'm working on a RAG project using text data converted into embeddings, stored ...
0
votes
1
answer
20
views
Why is DISKANN index type not supported on DataType.FLOAT_VECTOR with IP metric?
I'm attempting to build an index using the DiskANN type, but I'm encountering an error stating that the index type is not supported. Here is my schema. I'm confused because it’s based on a float ...
0
votes
1
answer
9
views
I have trouble Installing python3-debmutate Package, which is dependency for installing brz-debian_2.8.42_all.deb
For using build-deb.sh I need to install brz-debian_2.8.42_all.deb (this specific version).
python3-debmutate is dependency for it.
I'm currently facing an issue while trying to install the python3-...
- 86
0
votes
0
answers
11
views
is there any C++ grpc server emebeded in the milvus system?
I recently found an error which should be throwed from C++ code (after searching the error text write index to fd error, errorCode is).
I know there is a HandleCStatus function that logs all the C ...
- 86
0
votes
1
answer
15
views
Running Milvus in cluster mode
I want to run Milvus on my local cluster.
I thought to use docker compose file and docker stack/docker swarm, but when I run my compose file something is not working. I can see all services started on ...
- 317
0
votes
1
answer
8
views
Fit token to dimension
I’m using Python with LangChain to transform .txt files into chunks, where each chunk contains 512 tokens.
Next, I generate embeddings for each chunk and insert them into Milvus. The embedding ...
- 86
0
votes
0
answers
24
views
starting Milvus after building milvus from source code
I built milvus from source on my database cluster.
For that I followed the simple instructions on the milvus repo readme:
# Clone github repository.
$ git clone https://github.com/milvus-io/milvus.git
...
- 454
0
votes
0
answers
23
views
DataNotMatchException: <DataNotMatchException: (code=1, message=The Input data type is inconsistent
image is existing schema from zilliz, message.txt is error log, sample_input.txt is sample input text.
sample input langchain document object
[Document(metadata={'id_pk': {'array': [288204]}, 'url': {'...
- 86