Sambanova integrations
Customers are turning to SambaNova to quickly deploy state-of-the-art AI capabilities to gain competitive advantage. Our purpose-built enterprise-scale AI platform is the technology backbone for the next generation of AI computing. We power the foundation models that unlock the valuable business insights trapped in data.
Designed for AI, the SambaNova RDU was built with a revolutionary dataflow architecture. This design makes the RDU significantly more efficient for these workloads than GPUs as it eliminates redundant calls to memory, which are an inherent limitation of how GPUs function. This built-in efficiency is one of the features that makes the RDU capable of much higher performance than GPUs in a fraction of the footprint.
On top of our architecture We have developed some platforms that allow companies and developers to get full advantage of the RDU processors and open source models.
Installation and setup
Install the integration package:
pip install langchain-sambanovauv add langchain-sambanovaAPI Key
Set your API key it as an environment variable:
If you are a SambaCloud user request an API key and set it as an environment variable:
export SAMBANOVA_API_KEY="your-sambacloud-api-key-here"Or if you are SambaStack user set your base URL and API key as environment variables:
export SAMBANOVA_API_BASE="your-sambastack-envirronment-base-url-here"
export SAMBANOVA_API_KEY="your-sambastack-api-key-here"Chat models
For a detailed walkthrough of the ChatSambaNova component, see the usage example
from langchain_sambanova import ChatSambaNovaEmbedding models
For a detailed walkthrough of the SambaNovaEmbeddings component, see the usage example
from langchain_sambanova import SambaNovaEmbeddings