VoyageAI by MongoDB integration | LangChain 한국어

VoyageAI by MongoDB provides cutting-edge embedding/vectorizations models.

Let's load the VoyageAI by MongoDB Embedding class. (Install the LangChain partner package with pip install langchain-voyageai)

from langchain_voyageai import VoyageAIEmbeddings

VoyageAI by MongoDB utilizes API keys to monitor usage and manage permissions. To obtain your key, create an account on our homepage. Then, create a VoyageEmbeddings model with your API key. You can use any of the following models: (source):

voyage-4-large
voyage-4
voyage-4-lite
voyage-code-4
voyage-context-4
voyage-context-3
voyage-3.5
voyage-3.5-lite
voyage-3-large
voyage-3
voyage-3-lite
voyage-large-2
voyage-code-2
voyage-2
voyage-law-2
voyage-large-2-instruct
voyage-finance-2
voyage-multilingual-2

embeddings = VoyageAIEmbeddings(
    voyage_api_key="[ Your Voyage API key ]", model="voyage-law-2"
)

Prepare the documents and use embed_documents to get their embeddings.

documents = [
    "Caching embeddings enables the storage or temporary caching of embeddings, eliminating the necessity to recompute them each time.",
    "An LLMChain is a chain that composes basic LLM functionality. It consists of a PromptTemplate and a language model (either an LLM or chat model). It formats the prompt template using the input key values provided (and also memory key values, if available), passes the formatted string to LLM and returns the LLM output.",
    "A Runnable represents a generic unit of work that can be invoked, batched, streamed, and/or transformed.",
]

documents_embds = embeddings.embed_documents(documents)

documents_embds[0][:5]

[0.0562174916267395,
 0.018221192061901093,
 0.0025736060924828053,
 -0.009720131754875183,
 0.04108370840549469]

Similarly, use embed_query to embed the query.

query = "What's an LLMChain?"

query_embd = embeddings.embed_query(query)

query_embd[:5]

[-0.0052348352037370205,
 -0.040072452276945114,
 0.0033957737032324076,
 0.01763271726667881,
 -0.019235141575336456]

A minimalist retrieval system

The main feature of the embeddings is that the cosine similarity between two embeddings captures the semantic relatedness of the corresponding original passages. This allows us to use the embeddings to do semantic retrieval / search.

We can find a few closest embeddings in the documents embeddings based on the cosine similarity, and retrieve the corresponding document using the KNNRetriever class from LangChain.

Warning

The langchain-community package is no longer maintained. Examples that import from langchain_community may be outdated or broken. Use with caution.

from langchain_community.retrievers import KNNRetriever

retriever = KNNRetriever.from_texts(documents, embeddings)

# retrieve the most relevant documents
result = retriever.invoke(query)
top1_retrieved_doc = result[0].page_content  # return the top1 retrieved result

print(top1_retrieved_doc)

An LLMChain is a chain that composes basic LLM functionality. It consists of a PromptTemplate and a language model (either an LLM or chat model). It formats the prompt template using the input key values provided (and also memory key values, if available), passes the formatted string to LLM and returns the LLM output.

Contextualized chunk embeddings

The contextual models (voyage-context-4 and voyage-context-3) embed each chunk with the context of the surrounding chunks from the same document (source). VoyageAIEmbeddings supports them directly: for documents it calls the contextualized_embed endpoint with enable_auto_chunking=True, so you can pass whole documents as plain strings.

embeddings = VoyageAIEmbeddings(model="voyage-context-4")

documents_embds = embeddings.embed_documents(documents)
query_embd = embeddings.embed_query(query)