u/datadrivenguy86

Encrypted Vector Storage

Hello, everybody. I'm thinking about creating an encrypted vector storage in which both the embeddings and the chunk text are encrypted. The encryption key is known only to the user, who encrypts and decrypts the chunks locally. Data in the database would be stored in an encrypted format. I've come across a mathematical formulation of an encrypted embedding procedure that preserves cosine similarity by scrambling the vector components to prevent vector2text attacks. This way, cosine similarity still works even with encrypted embeddings.

The goal is to let companies that deal with personal and sensitive data use Rag as well, because all data would be totally encrypted in the database. I'm in Italy, so I work under eu gdpr regulation.

What do you think? Would it be useful?

reddit.com
u/datadrivenguy86 — 3 days ago
▲ 3 r/Rag

Encrypted vector storage

Hello, everybody. I'm thinking about creating an encrypted vector storage in which both embeddings and chunk text are encrypted. The encryption key is known only to the user, who encrypts and decrypts the chunks locally. Data in the database would be stored in encrypted format. I've come across a mathematical formulation of an encrypted embedding procedure that preserves cosine similarity by scrambling the vector components to prevent vector2text attacks. This way, cosine similarity still works even with encrypted embeddings.

The goal is to let companies that deal with personal and sensitive data use rag as well, because all data would be totally encrypted on the data base. I'm in Italy, so I work under eu gdpr regulation.

What do you think? Would it be useful?

reddit.com
u/datadrivenguy86 — 27 days ago