base on Retrieval Augmented Generation (RAG) chatbot powered by Weaviate # Verba ## The Golden RAGtriever - Community Edition ✨ [](https://weaviate.io/) [](https://pypi.org/project/goldenverba/) [](https://docs.docker.com/get-started/) [](https://verba.weaviate.io/) Welcome to Verba: The Golden RAGtriever, an community-driven open-source application designed to offer an end-to-end, streamlined, and user-friendly interface for Retrieval-Augmented Generation (RAG) out of the box. In just a few easy steps, explore your datasets and extract insights with ease, either locally with Ollama and Huggingface or through LLM providers such as Anthrophic, Cohere, and OpenAI. This project is built with and for the community, please be aware that it might not be maintained with the same urgency as other Weaviate production applications. Feel free to contribute to the project and help us make Verba even better! <3 ``` pip install goldenverba ```  - [Verba](#verba) - [🎯 What Is Verba?](#what-is-verba) - [✨ Features](#feature-lists) - [✨ Getting Started with Verba](#getting-started-with-verba) - [🔑 API Keys](#api-keys) - [Weaviate](#weaviate) - [Ollama](#ollama) - [Unstructured](#unstructured) - [AssemblyAI](#assemblyai) - [OpenAI](#openai) - [HuggingFace](#huggingface) - [Groq](#groq) - [Quickstart: Deploy with pip](#how-to-deploy-with-pip) - [Quickstart: Build from Source](#how-to-build-from-source) - [Quickstart: Deploy with Docker](#how-to-install-verba-with-docker) - [💾 Verba Walkthrough](#️verba-walkthrough) - [💖 Open Source Contribution](#open-source-contribution) - [🚩 Known Issues](#known-issues) - [❔FAQ](#faq) ## What Is Verba? Verba is a fully-customizable personal assistant utilizing [Retrieval Augmented Generation (RAG)](https://weaviate.io/rag#:~:text=RAG%20with%20Weaviate,accuracy%20of%20AI%2Dgenerated%20content.) for querying and interacting with your data, **either locally or deployed via cloud**. Resolve questions around your documents, cross-reference multiple data points or gain insights from existing knowledge bases. Verba combines state-of-the-art RAG techniques with Weaviate's context-aware database. Choose between different RAG frameworks, data types, chunking & retrieving techniques, and LLM providers based on your individual use-case. ## Open Source Spirit **Weaviate** is proud to offer this open-source project for the community. While we strive to address issues as fast as we can, please understand that it may not be maintained with the same rigor as production software. We welcome and encourage community contributions to help keep it running smoothly. Your support in fixing open issues quickly is greatly appreciated. ### Watch our newest Verba video here: [](https://www.youtube.com/watch?v=2VCy-YjRRhA&t=40s&ab_channel=Weaviate%E2%80%A2VectorDatabase) ## Feature Lists | 🤖 Model Support | Implemented | Description | | --------------------------------- | ----------- | ------------------------------------------------------- | | Ollama (e.g. Llama3) | ✅ | Local Embedding and Generation Models powered by Ollama | | HuggingFace (e.g. MiniLMEmbedder) | ✅ | Local Embedding Models powered by HuggingFace | | Cohere (e.g. Command R+) | ✅ | Embedding and Generation Models by Cohere | | Anthrophic (e.g. Claude Sonnet) | ✅ | Embedding and Generation Models by Anthrophic | | OpenAI (e.g. GPT4) | ✅ | Embedding and Generation Models by OpenAI | | Groq (e.g. Llama3) | ✅ | Generation Models by Groq (LPU inference) | | Upstage (e.g. Solar) | ✅ | Embedding and Generation Models by Upstage | | 🤖 Embedding Support | Implemented | Description | | -------------------- | ----------- | ---------------------------------------- | | Weaviate | ✅ | Embedding Models powered by Weaviate | | Ollama | ✅ | Local Embedding Models powered by Ollama | | SentenceTransformers | ✅ | Embedding Models powered by HuggingFace | | Cohere | ✅ | Embedding Models by Cohere | | VoyageAI | ✅ | Embedding Models by VoyageAI | | OpenAI | ✅ | Embedding Models by OpenAI | | Upstage | ✅ | Embedding Models by Upstage | | 📁 Data Support | Implemented | Description | | -------------------------------------------------------- | ----------- | ---------------------------------------------- | | [UnstructuredIO](https://docs.unstructured.io/welcome) | ✅ | Import Data through Unstructured | | [Firecrawl](https://www.firecrawl.dev/) | ✅ | Scrape and Crawl URL through Firecrawl | | [UpstageDocumentParse](https://upstage.ai/) | ✅ | Parse Documents through Upstage Document AI | | PDF Ingestion | ✅ | Import PDF into Verba | | GitHub & GitLab | ✅ | Import Files from Github and GitLab | | CSV/XLSX Ingestion | ✅ | Import Table Data into Verba | | .DOCX | ✅ | Import .docx files | | Multi-Modal (using [AssemblyAI](https://assemblyai.com)) | ✅ | Import and Transcribe Audio through AssemblyAI | | ✨ RAG Features | Implemented | Description | | ----------------------- | --------------- | ------------------------------------------------------------------------- | | Hybrid Search | ✅ | Semantic Search combined with Keyword Search | | Autocomplete Suggestion | ✅ | Verba suggests autocompletion | | Filtering | ✅ | Apply Filters (e.g. documents, document types etc.) before performing RAG | | Customizable Metadata | ✅ | Free control over Metadata | | Async Ingestion | ✅ | Ingest data asynchronously to speed up the process | | Advanced Querying | planned ⏱️ | Task Delegation Based on LLM Evaluation | | Reranking | planned ⏱️ | Rerank results based on context for improved results | | RAG Evaluation | planned ⏱️ | Interface for Evaluating RAG pipelines | | Agentic RAG | out of scope ❌ | Agentic RAG pipelines | | Graph RAG | out of scope ❌ | Graph-based RAG pipelines | | 🗡️ Chunking Techniques | Implemented | Description | | ---------------------- | ----------- | ------------------------------------------------------- | | Token | ✅ | Chunk by Token powered by [spaCy](https://spacy.io/) | | Sentence | ✅ | Chunk by Sentence powered by [spaCy](https://spacy.io/) | | Semantic | ✅ | Chunk and group by semantic sentence similarity | | Recursive | ✅ | Recursively chunk data based on rules | | HTML | ✅ | Chunk HTML files | | Markdown | ✅ | Chunk Markdown files | | Code | ✅ | Chunk Code files | | JSON | ✅ | Chunk JSON files | | 🆒 Cool Bonus | Implemented | Description | | ------------------------ | --------------- | ------------------------------------------------------- | | Docker Support | ✅ | Verba is deployable via Docker | | Customizable Frontend | ✅ | Verba's frontend is fully-customizable via the frontend | | Vector Viewer | ✅ | Visualize your data in 3D | | Multi-User Collaboration | out of scope ❌ | Multi-User Collaboration in Verba | | 🤝 RAG Libraries | Implemented | Description | | ---------------- | ----------- | ---------------------------------- | | LangChain | ✅ | Implement LangChain RAG pipelines | | Haystack | planned ⏱️ | Implement Haystack RAG pipelines | | LlamaIndex | planned ⏱️ | Implement LlamaIndex RAG pipelines | > Something is missing? Feel free to create a new issue or discussion with your idea!  --- # Getting Started with Verba You have three deployment options for Verba: - Install via pip ``` pip install goldenverba ``` - Build from Source ``` git clone https://github.com/weaviate/Verba pip install -e . ``` - Use Docker for Deployment **Prerequisites**: If you're not using Docker, ensure that you have `Python >=3.10.0,<3.13.0` installed on your system. ``` git clone https://github.com/weaviate/Verba docker compose --env-file <your-env-file> up -d --build ``` If you're unfamiliar with Python and Virtual Environments, please read the [python tutorial guidelines](./PYTHON_TUTORIAL.md). # API Keys and Environment Variables You can set all API keys in the Verba frontend, but to make your life easier, we can also prepare a `.env` file in which Verba will automatically look for the keys. Create a `.env` in the same directory you want to start Verba in. You can find an `.env.example` file in the [goldenverba](./goldenverba/.env.example) directory. > Make sure to only set environment variables you intend to use, environment variables with missing or incorrect values may lead to errors. Below is a comprehensive list of the API keys and variables you may require: | Environment Variable | Value | Description | | ---------------------- | ---------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------- | | WEAVIATE_URL_VERBA | URL to your hosted Weaviate Cluster | Connect to your [WCS](https://console.weaviate.cloud/) Cluster | | WEAVIATE_API_KEY_VERBA | API Credentials to your hosted Weaviate Cluster | Connect to your [WCS](https://console.weaviate.cloud/) Cluster | | ANTHROPIC_API_KEY | Your Anthropic API Key | Get Access to [Anthropic](https://www.anthropic.com/) Models | | OPENAI_API_KEY | Your OpenAI Key | Get Access to [OpenAI](https://openai.com/) Models | | OPENAI_BASE_URL | URL to OpenAI instance | Models | | COHERE_API_KEY | Your API Key | Get Access to [Cohere](https://cohere.com/) Models | | GROQ_API_KEY | Your Groq API Key | Get Access to [Groq](https://groq.com/) Models | | OLLAMA_URL | URL to your Ollama instance (e.g. http://localhost:11434 ) | Get Access to [Ollama](https://ollama.com/) Models | | UNSTRUCTURED_API_KEY | Your API Key | Get Access to [Unstructured](https://docs.unstructured.io/welcome) Data Ingestion | | UNSTRUCTURED_API_URL | URL to Unstructured Instance | Get Access to [Unstructured](https://docs.unstructured.io/welcome) Data Ingestion | | ASSEMBLYAI_API_KEY | Your API Key | Get Access to [AssemblyAI](https://assemblyai.com) Data Ingestion | | GITHUB_TOKEN | Your GitHub Token | Get Access to Data Ingestion via GitHub | | GITLAB_TOKEN | Your GitLab Token | Get Access to Data Ingestion via GitLab | | FIRECRAWL_API_KEY | Your Firecrawl API Key | Get Access to Data Ingestion via Firecrawl | | VOYAGE_API_KEY | Your VoyageAI API Key | Get Access to Embedding Models via VoyageAI | | EMBEDDING_SERVICE_URL | URL to your Embedding Service Instance | Get Access to Embedding Models via [Weaviate Embedding Service](https://weaviate.io/developers/wcs/embeddings) | | EMBEDDING_SERVICE_KEY | Your Embedding Service Key | Get Access to Embedding Models via [Weaviate Embedding Service](https://weaviate.io/developers/wcs/embeddings) | | UPSTAGE_API_KEY | Your Upstage API Key | Get Access to [Upstage](https://upstage.ai/) Models | | UPSTAGE_BASE_URL | URL to Upstage instance | Models | | DEFAULT_DEPLOYMENT | Local, Weaviate, Custom, Docker | Set the default deployment mode |  ## Weaviate Verba provides flexibility in connecting to Weaviate instances based on your needs. You have three options: 1. **Local Deployment**: Use Weaviate Embedded which runs locally on your device (except Windows, choose the Docker/Cloud Deployment) 2. **Docker Deployment**: Choose this option when you're running Verba's Dockerfile. 3. **Cloud Deployment**: Use an existing Weaviate instance hosted on WCD to run Verba **💻 Weaviate Embedded** Embedded Weaviate is a deployment model that runs a Weaviate instance from your application code rather than from a stand-alone Weaviate server installation. When you run Verba in `Local Deployment`, it will setup and manage Embedded Weaviate in the background. Please note that Weaviate Embedded is not supported on Windows and is in Experimental Mode which can bring unexpected errors. We recommend using the Docker Deployment or Cloud Deployment instead. You can read more about Weaviate Embedded [here](https://weaviate.io/developers/weaviate/installation/embedded). **🌩️ Weaviate Cloud Deployment (WCD)** If you prefer a cloud-based solution, Weaviate Cloud (WCD) offers a scalable, managed environment. Learn how to set up a cloud cluster and get the API keys by following the [Weaviate Cluster Setup Guide](https://weaviate.io/developers/wcs/guides/create-instance). **🐳 Docker Deployment** Another local alternative is deploying Weaviate using Docker. For more details, follow the [How to install Verba with Docker](#how-to-install-verba-with-docker) section.  **⚙️ Custom Weaviate Deployment** If you're hosting Weaviate yourself, you can use the `Custom` deployment option in Verba. This will allow you to specify the URL, PORT, and API key of your Weaviate instance. ## Ollama Verba supports Ollama models. Download and Install Ollama on your device (https://ollama.com/download). Make sure to install your preferred LLM using `ollama run <model>`. Tested with `llama3`, `llama3:70b` and `mistral`. The bigger models generally perform better, but need more computational power. > Make sure Ollama Server runs in the background and that you don't ingest documents with different ollama models since their vector dimension can vary that will lead to errors You can verify that by running the following command ``` ollama run llama3 ``` ## Unstructured Verba supports importing documents through Unstructured IO (e.g plain text, .pdf, .csv, and more). To use them you need the `UNSTRUCTURED_API_KEY` and `UNSTRUCTURED_API_URL` environment variable. You can get it from [Unstructured](https://unstructured.io/) > UNSTRUCTURED_API_URL is set to `https://api.unstructuredapp.io/general/v0/general` by default ## AssemblyAI Verba supports importing documents through AssemblyAI (audio files or audio from video files). To use them you need the `ASSEMBLYAI_API_KEY` environment variable. You can get it from [AssemblyAI](https://assemblyai.com) ## OpenAI Verba supports OpenAI Models such as Ada, GPT3, and GPT4. To use them, you need to specify the `OPENAI_API_KEY` environment variable. You can get it from [OpenAI](https://openai.com/) You can also add a `OPENAI_BASE_URL` to use proxies such as LiteLLM (https://github.com/BerriAI/litellm) ``` OPENAI_BASE_URL=YOUR-OPENAI_BASE_URL ``` ## HuggingFace If you want to use the HuggingFace Features, make sure to install the correct Verba package. It will install required packages to use the local embedding models. Please note that on startup, Verba will automatically download and install embedding models when used. ```bash pip install goldenverba[huggingface] or pip install `.[huggingface]` ``` > If you're using Docker, modify the Dockerfile accordingly ## Groq To use Groq LPUs as generation engine, you need to get an API key from [Groq](https://console.groq.com/keys). > Although you can provide it in the graphical interface when Verba is up, it is recommended to specify it as `GROQ_API_KEY` environment variable before you launch the application. > It will allow you to choose the generation model in an up-to-date available models list. # How to deploy with pip `Python >=3.10.0` 1. (Very Important) **Initialize a new Python Environment** ``` python3 -m virtualenv venv source venv/bin/activate ``` 2. **Install Verba** ``` pip install goldenverba ``` 3. **Launch Verba** ``` verba start ``` > You can specify the --port and --host via flags 4. **Access Verba** ``` Visit localhost:8000 ``` 5. (Optional)**Create .env file and add environment variables** # How to build from Source 1. **Clone the Verba repos** ``` git clone https://github.com/weaviate/Verba.git ``` 2. **Initialize a new Python Environment** ``` python3 -m virtualenv venv source venv/bin/activate ``` 3. **Install Verba** ``` pip install -e . ``` 4. **Launch Verba** ``` verba start ``` > You can specify the --port and --host via flags 5. **Access Verba** ``` Visit localhost:8000 ``` 6. (Optional) **Create .env file and add environment variables** # How to install Verba with Docker Docker is a set of platform-as-a-service products that use OS-level virtualization to deliver software in packages called containers. To get started with deploying Verba using Docker, follow the steps below. If you need more detailed instructions on Docker usage, check out the [Docker Curriculum](https://docker-curriculum.com/). You can use `docker pull semitechnologies/verba` to pull the latest Verba Docker Image. If you want to build the image yourself, you can do so by cloning the Verba repository and running `docker build -t verba .` inside the Verba directory. 0. **Clone the Verba repos** Ensure you have Git installed on your system. Then, open a terminal or command prompt and run the following command to clone the Verba repository: ``` git clone https://github.com/weaviate/Verba.git ``` 1. **Set necessary environment variables** Make sure to set your required environment variables in the `.env` file. You can read more about how to set them up in the [API Keys Section](#api-keys) 2. **Adjust the docker-compose file** You can use the `docker-compose.yml` to add required environment variables under the `verba` service and can also adjust the Weaviate Docker settings to enable Authentification or change other settings of your database instance. You can read more about the Weaviate configuration in our [docker-compose documentation](https://weaviate.io/developers/weaviate/installation/docker-compose). You can also uncomment the `ollama` service to use Ollama within the same docker compose. > Please make sure to only add environment variables that you really need. 2. **Deploy using Docker** With Docker installed and the Verba repository cloned, navigate to the directory containing the Docker Compose file in your terminal or command prompt. Run the following command to start the Verba application in detached mode, which allows it to run in the background: ```bash docker compose up -d ``` ```bash docker compose --env-file goldenverba/.env up -d --build ``` This command will download the necessary Docker images, create containers, and start Verba. Remember, Docker must be installed on your system to use this method. For installation instructions and more details about Docker, visit the official Docker documentation. 4. **Access Verba** - You can access your local Weaviate instance at `localhost:8080` - You can access the Verba frontend at `localhost:8000` If you want your Docker Instance to install a specific version of Verba you can edit the `Dockerfile` and change the installation line. ``` RUN pip install -e '.' ``` ## Verba Walkthrough ### Select your Deployment The first screen you'll see is the deployment screen. Here you can select between `Local`, `Docker`, `Weaviate Cloud`, or `Custom` deployment. The `Local` deployment is using Weaviate Embedded under the hood, which initializes a Weaviate instance behind the scenes. The `Docker` deployment is using a separate Weaviate instance that is running inside the same Docker network. The `Weaviate Cloud` deployment is using a Weaviate instance that is hosted on Weaviate Cloud Services (WCS). The `Custom` deployment allows you to specify your own Weaviate instance URL, PORT, and API key. You can skip this part by setting the `DEFAULT_DEPLOYMENT` environment variable to `Local`, `Docker`, `Weaviate`, or `Custom`. ### Import Your Data First thing you need to do is to add your data. You can do this by clicking on `Import Data` and selecting either `Add Files`, `Add Directory`, or `Add URL` tab. Here you can add all your files that you want to ingest. You can then configure every file individually by selecting the file and clicking on `Overview` or `Configure` tab.  ### Query Your Data With Data imported, you can use the `Chat` page to ask any related questions. You will receive relevant chunks that are semantically relevant to your question and an answer generated by your choosen model. You can configure the RAG pipeline under the `Config` tab.  ## Open Source Contribution Your contributions are always welcome! Feel free to contribute ideas, feedback, or create issues and bug reports if you find any! Before contributing, please read the [Contribution Guide](./CONTRIBUTING.md). Visit our [Weaviate Community Forum](https://forum.weaviate.io/) if you need any help! ### Project Architecture You can learn more about Verba's architecture and implementation in its [technical documentation](./TECHNICAL.md) and [frontend documentation](./FRONTEND.md). It's recommended to have a look at them before making any contributions. ## Known Issues - **Weaviate Embeeded** currently not working on Windows yet - Will be fixed in future versions, until then please use the Docker or WCS Deployment ## FAQ - **Can I use pre-existing data from my Weaviate instance?** - No, unfortunatley not. Verba requires the data to be in a specific format to work. And as of now, this is only possible by importing data through the Verba UI. - **Is Verba Multi-Lingual?** - This depends on your choosen Embedding and Generation Model whether they support multi-lingual data. - **Can I use my Ollama Server with the Verba Docker?** - Yes, you can! Make sure the URL is set to: `OLLAMA_URL=http://host.docker.internal:11434` - If you're running on Linux, you might need to get the IP Gateway of the Ollama server: `OLLAMA_URL="http://YOUR-IP-OF-OLLAMA:11434"` - **How to clear Weaviate Embedded Storage?** - You'll find the stored data here: `~/.local/share/weaviate` - **How can I specify the port?** - You can use the port and host flag `verba start --port 9000 --host 0.0.0.0` - **Can multiple users use Verba at the same time? How about role based access?** - Verba is designed and optimized for single user usage only. There are no plans on supporting multiple users or role based access in the near future. - **Does Verba offer a API endpoint to use externally?** - No, right now Verba does not offer any useful API endpoints to interact with the application. The current FastAPI setup is optimized for the internal communication between the frontend and backend. It is not recommended to use it as a API endpoint. There are plans to add user-friendly ", Assign "at most 3 tags" to the expected json: {"id":"421","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"