Two Main Sections
Cloud Storage
Connect external storage providers to automatically sync and index documents:- SharePoint
- OneDrive
- Google Drive

RAG Pipeline
Build the retrieval system in 4 steps:- Data Sources - Upload files or connect to storage
- Collections - Organize data into collections
- Knowledge Bases - Configure retrieval settings
- Retrieval Methods - Set up how agents search your data
Connecting Cloud Storage
1
Click Cloud Storage Tab
At the top of the Knowledge Base page
2
Click Connect Cloud Storage

3
Choose Your Provider
Select SharePoint, OneDrive, or Google Drive

4
Authenticate
Follow OAuth flow to grant access
5
Select Folders
Choose which folders to sync and index
Files are automatically synced and indexed. Updates to documents are reflected in your knowledge bases.
Building a RAG Pipeline
Step 1: Data Sources
Upload files or connect to storage:- Upload Files: PDF, DOCX, TXT, Markdown
- Cloud Storage: Auto-sync from connected providers

- DOC, DOCX
- TXT
- MD (Markdown)
Step 2: Collections
Group related data sources:- Create collections by topic or project
- Add multiple data sources to a collection
- Configure chunking and embedding settings
- Chunk size: How to split documents (default: 1000 tokens)
- Chunk overlap: Overlap between chunks (default: 200 tokens)
- Embedding model: Which model to use for embeddings
Step 3: Knowledge Bases
Configure retrieval for your collection:- Name your knowledge base
- Set the search method (vector, keyword, hybrid)
- Configure result limits
- Top K: Number of results to return (default: 5)
- Score threshold: Minimum relevance score (0.0 - 1.0)
- Reranking: Enable reranking for better results
Step 4: Retrieval Methods
Set up how agents query your data:- Similarity search: Vector-based semantic search
- Keyword search: Traditional keyword matching
- Hybrid search: Combine vector + keyword for best results
Using Knowledge Bases in Agents
Once created, add knowledge bases to your agents:Managing Your Data
Updating Documents
Cloud storage: Files auto-sync when changed Manual uploads:- Go to Data Sources
- Click the data source
- Upload new version or delete old files