Documentation

An outcome-focused guide to what you can do with Howlet Studio, and how easily.

RAG Retriever

Retrieves relevant documents from a knowledge base using vector similarity search to augment LLM context.

How It Works

1Receives a query string from the input
2Converts the query to an embedding vector
3Searches the vector store for the top-K most similar documents
4Returns the retrieved documents as context for the LLM

Configuration

ParameterDescriptionDefault
knowledge_baseSelect from your organization's knowledge bases-
top_kNumber of documents to retrieve4
similarity_thresholdMinimum similarity score (0.0-1.0)0.7
embedding_modelModel used for query embedding-
metadata_filtersFilter search by document metadata-

Supported Vector Stores

Chroma
Built-in, no external setup needed
PostgreSQL pgvector
Use existing PostgreSQL with pgvector extension
Pinecone
Managed vector database service
Weaviate
Open-source vector search engine