Migrating Vector Database to the Cloud

Timothy Spann. πŸ‡ΊπŸ‡¦ - Oct 22 - - Dev Community

MILVUS-LITE BACKUP / EXPORT
milvus-lite dump -d XavierEdgeAI.db -p /home/nvidia/nvme/AIM-XavierEdgeAI/backup/ -c XavierEdgeAI

Dump collection XavierEdgeAI’s data: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 33/33 [00:00<00:00, 188.54it/s]

Dump collection XavierEdgeAI success

Dump collection XavierEdgeAI’s data: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 33/33 [00:00<00:00, 127.16it/s]

Milvus-Lite to the Cloud
For many use cases we will want to distribute our local data to another computer, cluster or cloud. We could do that at the same time, in a batch, on a delay or at some other time.

Milvus-Lite Dump/Export to Cloud Import at some interval
Dual Ingest to local and other location concurrently
Switch to Cloud Only
Send JSON via Kafka / Pulsar / MQTT
Unstructured Data to MinIO, S3 or Cloud Object Storage

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Terabox Video Player