base on A robust, all-in-one GPT interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more! <h1 align="center"> GPT Discord</h1> <p align="center">An all-in-one GPT-3 interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more!</p> [](https://github.com/Kav-K/GPTDiscord/actions/workflows/build-and-publish-docker.yml) [](https://github.com/Kav-K/GPTDiscord/actions/workflows/pypi_upload.yml) [](https://github.com/Kav-K/GPTDiscord/actions/workflows/build.yml) [](https://pypi.org/project/gpt3discord) [](https://github.com/Kav-K/GPTDiscord/releases) [](https://GitHub.com/Kav-K/GPTDiscord/graphs/commit-activity) [](https://github.com/Kav-K/GPTDiscord/blob/main/LICENSE) [](http://makeapullrequest.com) # Overview An all-in-one, robust OpenAI Integration for Discord. This bot is on feature parity with ChatGPT web and even does some things slightly better! We support everything from **multi-modality image understanding**, **code interpretation**, advanced data analysis, Q&A on **your own documents**, **internet-connected chat** with Wolfram Alpha and Google access, **AI-moderation**, **image generation** with DALL-E, and much more! **BOT SETUP SUPPORT AND DEMO SERVER:** [Join Here](https://discord.gg/WvAHXDMS7Q) Featuring code execution and environment manipulation by [E2B](https://e2b.dev) We are migrating towards using [QDRANT](https://qdrant.tech/) as our vector database backing, we are moving away from pinecone. Qdrant is an excellent vector database choice, and in fact the best one that we've tested and used so far. <p align="center"> <img src="https://i.imgur.com/4g1tQ91.png" width="64px" height="64px" /> </p> # Overview of Capabilities  # Table of Contents - [Screenshots](#Screenshots) - [Features](#Features) - [Commands](#Commands) - [Installation](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/INSTALLATION.md) -- [DigitalOcean Droplet Guide](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/DROPLET-GUIDE.md) -- [OpenAI Token Guide](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/OPENAI-GUIDE.md) - [Internet Connected Chat](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/INTERNET-CONNECTED-CHAT.md) - [Code Interpreter / Advanced Data Analysis](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/CODE-INTERPRETER.md) - [Permanent Memory](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/PERMANENT-MEMORY.md) - [Multi-Modality](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/MULTI-MODALITY.md) - [AI-Search](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/AI-SEARCH.md) - [Custom Indexes](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/CUSTOM-INDEXES.md) - [AI-Moderation](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/AI-MODERATION.md) - [Translations](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/TRANSLATIONS.md) - [User-Input API Keys](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/USER-INPUT-KEYS.md) - [Permissions](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/PERMISSIONS.md) - [Language Detection](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/LANGUAGE-DETECTION.md) - [Other Minor Features](https://github.com/Kav-K/GPTDiscord/blob/main/detailed_guides/OTHER-MINOR-FEATURES.md) # Screenshots <p align="center"> Multi-Modality<br> <img src="https://i.imgur.com/TsfgtU2.png"/><br> Internet-connected chat (Google + Wolfram + Link Crawling)<br> <img src="https://i.imgur.com/nHRNY2l.png"/><br> Code Interpreter / Advanced Data Analysis <br> <img src="https://i.imgur.com/Y2VvwHd.png"/><br> Custom indexing and Document Q&A<br> <img src="https://i.imgur.com/1uKF1ye.png"/><br> </p> # Recent Notable Updates - **Multi-modality + Drawing** - GPTDiscord now supports images sent to the bot during a conversation made with `/gpt converse`, and the bot can draw images for you and work with you on them! - **GPT-4-Vision support, GPT-4-Turbo, DALLE-3 Support** - Assistant support also coming soon! - **Code Interpreter / Advanced Data Analysis** - Just like ChatGPT, GPTDiscord now has a fully-fledged code execution environment. You can work with GPT to execute your code in an isolated environment, with the ability to even install Python and system packages, and access the internet from the execution environment. - **Drag And Drop Document Chat** - Chat with your documents by simply dragging and dropping files, or even links into discord chat! `/index chat` - **Internet-connected Chat!** - Chat with an instance of GPT3.5 or GPT-4 that's connected to Google and Wolfram Alpha and can browse and access links that you send it! # Features - **Multi-modal** with image understanding, you can generate images with DALL-E within multi-modal conversations! - **Code Interpreter / Advanced Data Analysis** - Long-term, **permanent conversations** with GPT models - **Use your own files**, PDFs, text files, websites, Discord channel content as context when asking GPT questions! - **Internet-connected** chatting with GPT, connected to Google, Wolfram Alpha, and a web crawler - Generate **DALL-E AI images** and even optimize them right in Discord - **Translate** text with DeepL. - Moderate your server automatically with AI! - **Auto-retry on API errors** - Automatically resend failed requests silently to ensure a seamless experience - Set context-based pre-instructions per user and per channel - Ability to redo, edit your conversation messages while chatting with GPT - ShareGPT integration to share your conversations - Tag your bot in chat, and it'll respond! - Async and fault-tolerant, **can handle hundreds of users at once**, if the upstream API permits! - Change and view model parameters such as temperature, top_p, and more directly within Discord. - Tracks token usage automatically - Automatic pagination and Discord support. The bot will automatically send very long messages as multiple messages and is able to send Discord code blocks and emoji, gifs, etc. - A low usage mode, use a command to automatically switch to a cheaper and faster model to conserve your tokens during times of peak usage. - Prints debug to a channel of your choice, so you can view the raw response JSON - Ability to specify a limit to how long a conversation can be with the bot, to conserve your tokens. # Commands These commands are grouped, so each group has a prefix, but you can easily tab complete the command without the prefix. For example, for `/gpt ask`, if you type `/ask` and press tab, it'll show up too. `/help` - Display help text for the bot ### (Chat)GPT Commands - `/gpt ask <prompt> <temp> <top_p> <frequency penalty> <presence penalty>` Ask the GPT Davinci 003 model a question. Optional overrides available. - `/gpt edit <instruction> <input> <temp> <top_p>` Use the bot to edit text using the given instructions for how to do it, currently an alpha OpenAI feature so results might vary. Editing is currently free. - `/gpt converse <opener> <opener_file> <private> <minimal>` - Start a conversation with the bot, like ChatGPT. Also use the option `use_threads:False` to start a conversation in a full Discord channel! - `/gpt end` - End a conversation with the bot. - `/gpt instruction mode:<set/get/clear> type:<user/channel> <instruction> <instruction_file>` - The commands let you set a system instruction for 3.5-turbo and gpt4 or just prepending text for Davinci and older models. ### Code Interpreter // Advanced Data Analysis Commands - `/code chat` - Start a code interpreter chat with GPT. You can type `end` to end the conversation. ### Search & Internet Commands - `/internet search:<prompt> scope:<number of sites to visit> nodes:<how deep GPT should think>` - Search the internet with GPT assistance! - `/internet chat search_scope:<number> model:<turbo or gpt4>` - Start an internet-connected chat with GPT, connected to Google and Wolfram. ### Custom Indexes Commands - `/index add file:<file> or link:<link>` - Use a document or use a link to create/add to your indexes. - `/index query query:<prompt> nodes:<number> response_mode:<mode>` - Query your current index for a given prompt. GPT will answer based on your current document/index. - `/index load user_index:<index> or server_index:<index>` - Load a previously created index you own yourself or an index for the whole server. - `/index compose` - Combine multiple saved indexes into one or upgrade existing indexes into Deep Compositions. - `/index reset` - Reset and delete all of your saved indexes. - `/index add_discord channel:<discord channel>` - Create an add an index based on a Discord channel. - `/index discord_backup` - Use the last 3000 messages of every channel on your Discord server as an index. Needs both an admin and an index role. - `/index chat user_index:<user_index> search_index:<search_index>` - Chat with your documents that you've indexed previously! ### DALL-E Commands - `/dalle draw <prompt>` - Have DALL-E 3 generate images based on a prompt. - `/dalle draw_old <prompt>` - Have DALL-E 2 generate images based on a prompt. - `/dalle optimize <image prompt text>` - Optimize a given prompt text for DALL-E image generation. ### System and Settings - `/system settings` - Display settings for the model (temperature, top_p, etc). - `/system settings <setting> <value>` - Change a model setting to a new value. Has autocomplete support, certain settings will have autocompleted values too. - `/system usage` - Estimate current usage details (based on Davinci). - `/system settings low_usage_mode True/False` - Turn low usage mode on and off. If on, it will use the curie-001 model, and if off, it will use the Davinci-003 model. - `/system delete-conversation-threads` - Delete all threads related to this bot across all servers. - `/system local-size` - Get the size of the local `/dalleimages` folder. - `/system clear-local` - Delete all the contents of `/dalleimages`. # Step-by-Step Guides for GPTDiscord [**GPTDiscord Guides**](https://github.com/Kav-K/GPTDiscord/tree/main/detailed_guides) If you follow the link above, you will find detailed step-by-step guides that will help you install and set up your GPTDiscord bot and its features quickly and easily. If you encounter any issues or have suggestions for improving the guides, you can join the [**Discord Server**](https://discord.gg/WvAHXDMS7Q), and we will try to help you. Please keep in mind that the maintainers are volunteers and will try to assist you on their schedule. *The number and content of the guides are constantly adapted to current requirements.* # Our Amazing Contributors ⭐ [](https://github.com/Kav-K/GPTDiscord) Improve this markdown, correct any spelling errors, and let me know what you change. ", Assign "at most 3 tags" to the expected json: {"id":"4507","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"