base on Chat with your documents using local AI <div align="center"> <img src="./screenshots/logo.png" width="300"> </div> [See a video demo.](https://github.com/BruceMacD/chatd/assets/5853428/a7d8b77c-beae-41a4-bfd6-0fd5cf932b43) Chat with your documents using local AI. All your data stays on your computer and is never sent to the cloud. Chatd is a completely private and secure way to interact with your documents. Chatd is a desktop application that lets you use a local large language model (`Mistral-7B`) to chat with your documents. What makes chatd different from other "chat with local documents" apps is that it comes with the local LLM runner packaged in. This means that you don't need to install anything else to use chatd, just run the executable. Chatd uses Ollama to run the LLM. Ollama is an LLM server that provides a cross-platform LLM runner API. If you already have an Ollama instance running locally, chatd will automatically use it. Otherwise, chatd will start an Ollama server for you and manage its lifecycle. <div align="center"> <img src="./screenshots/chat_screen.png" width="30%"></img> <img src="./screenshots/welcome_screen.png" width="30%"></img> <img src="./screenshots/home_screen.png" width="30%"></img> </div> ## Quickstart 1. Download the latest release from [chatd.ai](https://chatd.ai) or the [releases page](https://github.com/BruceMacD/chatd/releases). 2. Unzip the downloaded file. 3. Run the `chatd` executable. ## Advanced Setup - [Enable GPU support.](docs/enable_gpu_support.md) - [Select a custom model.](docs/select_a_custom_model.md) ## Links - [chatd.ai](https://chatd.ai) - [ollama.ai](https://ollama.ai) ## Development Run the following commands in the root directory. ```bash npm install npm run start ``` ## Packaging and Distribution ### MacOS 1. Download the latest `ollama-darwin` release for MacOS from [here](https://github.com/ollama/ollama/releases). 2. Make the downloaded binary executable: `chmod +x path/to/ollama-darwin` 3. Copy the `ollama-darwin` executable to the `chatd/src/service/ollama/runners` directory. 4. Optional: The Electron app needs be signed to be able to run on MacOS systems other than the one it was compiled on, so you need a developer certificate. To sign the app, set the following environment variables: ```bash [email protected] APPLE_IDENTITY="Developer ID Application: Your Name (ABCDEF1234)" APPLE_ID_PASSWORD=your_apple_id_app_specific_password APPLE_TEAM_ID=ABCDEF1234 ``` You can find your Apple ID, Apple Team ID, and Apple ID Application in your Apple Developer account. You can create an app-specific password [here](https://appleid.apple.com/account/manage). 5. Run `npm run package` to package the app. ### Windows 1. Download the latest `ollama-windows-amd64.zip` release from [here](https://github.com/ollama/ollama/releases). 2. Copy the contents of the zip into `chatd/src/service/ollama/runners/`. 3. Run `npm run package` to package the app. Note: The Windows app is not signed, so you will get a warning when you run it. ### Linux 1. Download the latest `ollama-linux-amd64` release from [here](https://github.com/ollama/ollama/releases). 2. Copy the `ollama` executable to `chatd/src/service/ollama/runners/ollama-linux`. 3. Run `npm run package` to package the app. ", Assign "at most 3 tags" to the expected json: {"id":"5980","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"