base on The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS <div align="center"> <a name="readme-top"></a>  [](https://twitter.com/intent/follow?screen_name=TenFramework) [](https://github.com/TEN-framework/ten-framework/discussions/) [](https://github.com/TEN-framework/ten-framework/graphs/commit-activity) [](https://github.com/TEN-framework/ten-framework/issues) [](https://github.com/TEN-framework/ten-framework/pulls) [](https://github.com/TEN-framework/tten_framework/blob/main/LICENSE) [](https://discord.gg/VnPftUzAMJ) [](https://GitHub.com/TEN-framework/ten_framework/watchers/?WT.mc_id=academic-105485-koreyst) [](https://GitHub.com/TEN-framework/ten_framework/network/?WT.mc_id=academic-105485-koreyst) [](https://GitHub.com/TEN-framework/ten_framework/stargazers/?WT.mc_id=academic-105485-koreyst) <a href="https://github.com/TEN-framework/ten-agent/blob/main/README.md"><img alt="README in English" src="https://img.shields.io/badge/English-lightgrey"></a> <a href="https://github.com/ten-framework/ten-agent/blob/main/docs/readmes/README-CN.md"><img alt="简体中文操作指南" src="https://img.shields.io/badge/简体中文-lightgrey"></a> <a href="https://github.com/ten-framework/ten-agent/blob/main/docs/readmes/README-JP.md"><img alt="日本語のREADME" src="https://img.shields.io/badge/日本語-lightgrey"></a> <a href="https://github.com/ten-framework/ten-agent/blob/main/docs/readmes/README-KR.md"><img alt="README in 한국어" src="https://img.shields.io/badge/한국어-lightgrey"></a> <a href="https://github.com/ten-framework/ten-agent/blob/main/docs/readmes/README-ES.md"><img alt="README en Español" src="https://img.shields.io/badge/Español-lightgrey"></a> <a href="https://github.com/ten-framework/ten-agent/blob/main/docs/readmes/README-FR.md"><img alt="README en Français" src="https://img.shields.io/badge/Français-lightgrey"></a> <a href="https://github.com/ten-framework/ten-agent/blob/main/docs/readmes/README-IT.md"><img alt="README in Italiano" src="https://img.shields.io/badge/Italiano-lightgrey"></a> [Documentation](https://theten.ai/docs/ten_agent/overview) <a href="https://trendshift.io/repositories/11978" target="_blank"><img src="https://trendshift.io/api/badge/repositories/11978" alt="TEN-framework%2Ften_framework | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a> </div> <br> <details open> <summary><kbd>Table of Contents</kbd></summary> #### Table of Contents - [👋 Getting Started \& Join TEN Community](#-getting-started--join-ten-community) - [✨ TEN Features](#-ten-features) - [💡 TEN Usecases](#-ten-usecases) - [🧩 Extensions](#-extensions) - [🤖 TEN Agent - a Showcase of TEN Framework](#-ten-agent---a-showcase-of-ten-framework) - [1️⃣ 🆕 TEN Agent + Llama 4](#1️⃣--ten-agent--llama-4) - [2️⃣ 🔥 TEN Agent + MCP](#2️⃣--ten-agent--mcp) - [3️⃣ TEN Agent + Trulience](#3️⃣-ten-agent--trulience) - [4️⃣ TEN Agent + DeepSeek](#4️⃣-ten-agent--deepseek) - [5️⃣ TEN Agent + ESP32](#5️⃣-ten-agent--esp32) - [6️⃣ TEN Agent + Gemini Multimodal Live API](#6️⃣-ten-agent--gemini-multimodal-live-api) - [7️⃣ TEN Agent + Storyteller + Image Generator](#7️⃣-ten-agent--storyteller--image-generator) - [8️⃣ TEN Agent + Dify](#8️⃣-ten-agent--dify) - [9️⃣ TEN Agent + Coze](#9️⃣-ten-agent--coze) - [🛝 TEN Agent Playground](#-ten-agent-playground) - [️🅰️ Run Playground in `localhost`](#🅰️-run-playground-in-localhost) - [️🅱️ Run Playground in Codespace(no docker)](#🅱️-run-playground-in-codespaceno-docker) - [👀 TEN Agent Demo](#-ten-agent-demo) - [🛳️ TEN Agent Self Hosting](#️-ten-agent-self-hosting) - [🅰️ 🐳 Deploying with Docker](#️--deploying-with-docker) - [🅱️ Deploying with other cloud services](#️-deploying-with-other-cloud-services) - [🏗️ TEN Agent Architecture](#️-ten-agent-architecture) - [🌍 TEN Framework Ecosystem](#-ten-framework-ecosystem) - [🥰 Contributing](#-contributing) - [Code Contributors](#code-contributors) - [Contribution Guidelines](#contribution-guidelines) - [License](#license) <br/> </details> ## 👋 Getting Started & Join TEN Community TEN, the world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS. <br> | Community Channel | Purpose | | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------- | | [](https://discord.gg/VnPftUzAMJ) | Join our Discord community to connect with developers | | [](https://twitter.com/intent/follow?screen_name=TenFramework) | Follow TEN Framework on X for updates and announcements | | [](https://github.com/TEN-framework/ten-agent/discussions/170) | Join our WeChat group for Chinese community discussions | <br> > \[!IMPORTANT] > > **Star Our Repository** ⭐️ > > Get instant notifications for new releases and updates. Your support helps us grow and improve TEN Framework! <br>  <details> <summary><kbd>Star History</kbd></summary> <picture> <img width="100%" src="https://api.star-history.com/svg?repos=ten-framework/ten-framework&type=Date"> </picture> </details> <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## ✨ TEN Features The TEN framework offers the following advantages: 1. **Native Support for High-Performance, Real-Time Multimodal Interactions** If your AI applications involve complex audio-visual scenarios, TEN is your go-to solution. It offers high performance and low latency, with extensive optimization of interactions between various extensions to ensure efficient development of AI applications. 2. **Supports Multiple Languages and Platforms** Developers can create modular and reusable extensions using various programming languages, such as C++, Go, and Python (with future support for JavaScript/TypeScript). Moreover, the TEN framework runs seamlessly across platforms, including Windows, Mac, Linux, and mobile devices. 3. **Edge-Cloud Integration** Through the TEN framework, extensions deployed across edge and cloud environments can be easily combined to create diverse applications and scenarios. For privacy-sensitive edge deployments, small models leverage local compute power for reduced costs and lower latency, while cloud-based large models can be integrated for an optimal balance of cost and performance. 4. **Flexibility Beyond Model Limitations** The TEN framework allows for the creation of complex AI applications that transcend the limitations of large models alone. Agents can be easily constructed to meet a wide range of needs using a simple drag-and-drop, responsive programming approach. TEN also facilitates the integration of AI with audio-visual tools, databases, monitoring systems, RAG, and more. 5. **Real-Time Agent State Management** TEN has the ability to manage real-time agent states, enabling dynamic responsiveness and adjustment of agent behavior in real time. 6. **And more...** For more information and detailed documentation on all the capabilities of the TEN framework, please refer to the [TEN framework documentation site](https://theten.ai/docs). <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 💡 TEN Usecases  <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🧩 Extensions  <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🤖 TEN Agent - a Showcase of TEN Framework ### 1️⃣ 🆕 TEN Agent + Llama 4 TEN Agent now integrates with Llama 4, Meta's latest large language model. With no setup or waiting required, you can simply start a real-time conversation with TEN Agent. <details> <summary><kbd>TEN Agent + Llama 4</kbd></summary> <br> <picture>  </picture> </details> <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 2️⃣ 🔥 TEN Agent + MCP TEN Agent now integrates seamlessly with MCP servers, expanding its LLM capabilities. To get started: 1. Open the Module Picker in Playground 2. Add the MCP server tool for LLM integration 3. Paste a URL from your MCP server in the extension 4. Start a realtime conversation with TEN Agent This integration allows you to leverage MCP's diverse servers offerings while maintaining TEN Agent's powerful conversational abilities. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 3️⃣ TEN Agent + Trulience Build engaging AI avatars with TEN Agent using [Trulience](https://trulience.com)'s diverse collection of free avatar options. To get it up and running, you only need 2 steps: 1. Follow the README to finish setting up and running the Playground 2. Enter the avatar ID and [token](https://trulience.com/docs#/authentication/jwt-tokens/jwt-tokens?id=use-your-custom-userid) you get from [Trulience](https://trulience.com) <details> <summary><kbd>TEN Agent + Trulience</kbd></summary> <br> <picture>  </picture> </details> <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 4️⃣ [TEN Agent + DeepSeek](https://ten-framework.medium.com/deepgram-deepseek-fish-audio-build-your-own-voice-assistant-with-ten-agent-d3ee65faabe8) TEN is a very versatile framework. That said, TEN Agent is compatible with DeepSeek R1, try experiencing realtime conversations with DeepSeek R1! <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 5️⃣ [TEN Agent + ESP32](https://github.com/TEN-framework/TEN-Agent/tree/main/esp32-client) TEN Agent is now running on the Espressif ESP32-S3 Korvo V3 development board, an excellent way to integrate realtime communication with LLM on hardware. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 6️⃣ TEN Agent + Gemini Multimodal Live API Try Google Gemini Multimodal Live API with realtime vision and realtime screenshare detection capabilities, it is a ready-to-use extension, along with powerful tools like Weather Check and Web Search integrated perfectly into TEN Agent. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 7️⃣ TEN Agent + Storyteller + Image Generator Describe a topic and ask TEN Agent to tell you a story while also generating images of the story to provide a more immersive experience for kids. <details> <summary><kbd>Storyteller + Image Generator</kbd></summary> <br> <picture>  </picture> </details> <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 8️⃣ TEN Agent + Dify [TEN Agent + Dify](https://doc.theten.ai/docs/ten_agent/playground/use-cases/voice-assistant/run_dify) TEN offers a great support to make the realtime interactive experience even better on other LLM platform as well, check out docs for more. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 9️⃣ TEN Agent + Coze [TEN Agent + Coze](https://doc.theten.ai/docs/ten_agent/quickstart-1/use-cases/run_va/run_coze) TEN seamlessly integrates with Coze platform to enhance real-time interactive experiences. Check out our documentation to learn how to leverage these powerful integrations. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🛝 TEN Agent Playground #### 🅰️ Run Playground in localhost #### Step ⓵ - Prerequisites | Category | Requirements | | --- | --- | | **Keys** | • Agora [App ID](https://docs.agora.io/en/video-calling/get-started/manage-agora-account?platform=web#create-an-agora-project) and [App Certificate](https://docs.agora.io/en/video-calling/get-started/manage-agora-account?platform=web#create-an-agora-project) (free minutes every month) <br>• [OpenAI](https://openai.com/index/openai-api/) API key (any LLM that is compatible with OpenAI)<br>• [Deepgram](https://deepgram.com/) ASR (free credits available with signup)<br>• [Elevenlabs](https://elevenlabs.io/) TTS (free credits available with signup) | | **Installation** | • [Docker](https://www.docker.com/) / [Docker Compose](https://docs.docker.com/compose/)<br>• [Node.js(LTS) v18](https://nodejs.org/en) | | **Minimum System Requirements** | • CPU >= 2 Core<br>• RAM >= 4 GB | <br> > \[!NOTE] > > **macOS: Docker setting on Apple Silicon** > > Uncheck "Use Rosetta for x86/amd64 emulation" in Docker settings, it may result in slower build times on ARM, but performance will be normal when deployed to x64 servers. <br> #### Step ⓶ - Build agent in VM ##### 1. Clone down the repo and create `.env` file from `.env.example` ```bash cp ./.env.example ./.env ``` ##### 2. Setup Agora App ID and App Certificate in `.env` ```bash AGORA_APP_ID= AGORA_APP_CERTIFICATE= ``` ##### 3. Start agent development containers ```bash docker compose up -d ``` ##### 4. Enter container ```bash docker exec -it ten_agent_dev bash ``` ##### 5. Build agent with the default `graph` ( ~5min - ~8min) check the `/examples` folder for more examples ```bash # use the default agent task use # or use the demo agent task use AGENT=agents/examples/demo ``` ##### 6. Start the web server ```bash task run ``` <br> #### Step ⓷ - Customize your agent 1. Open Up [localhost:3000](http://localhost:3000) and select a graph example 2. Choose a corresponding module 3. Select an extension and configure its API key and settings <details> <summary><kbd>Module Picker Example - Gemini</kbd></summary> <br> <picture>  </picture> </details> Now, we have successfully set up the playground. This is just the beginning of TEN Agent. There are many different ways to explore and utilize TEN Agent. To learn more, please refer to the [documentation](https://theten.ai/docs/ten_agent/overview). <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ### 🅱️ Run Playground in Codespace(no docker) GitHub offers free Codespace for each repository, you can run the playground in Codespace without using Docker.Also, the speed of Codespace is much faster than localhost. [codespaces-shield]: <https://github.com/codespaces/badge.svg> [![][codespaces-shield]](https://codespaces.new/ten-framework/ten-agent) Check out [this guide](https://theten.ai/docs/ten_agent/setup_development_env/setting_up_development_inside_codespace) for more details. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 👀 TEN Agent Demo Playground and Demo server different purposes, in a nut shell, think it as Playground is for you to customize you agent, and Demo is for you to deploy your agent. Check out [this guide](https://theten.ai/docs/ten_agent/demo) for more details. <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🛳️ TEN Agent Self Hosting #### 🅰️ 🐳 Deploying with Docker Once you have customized your agent (either by using the playground or editing `property.json` directly), you can deploy it by creating a release Docker image for your service. Read the [Deployment Guide](https://theten.ai/docs/ten_agent/deploy_ten_agent/deploy_agent_service) for detailed information about deployment. <br> #### 🅱️ Deploying with other cloud services *coming soon...* <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🏗️ TEN Agent Architecture 1️⃣ **TEN Agent App**: Core application that manages extensions and data flow based on graph configuration 2️⃣ **Dev Server**: `port:49480`- local server for development purposes. 3️⃣ **Web Server**: `port:8080`- Golang server handling HTTP requests and agent process management 4️⃣ **Front-end UI**: - `port:3000` Playground - To customize and test your agent configurations. - `port:3002` Demo - To deploy your agent without module picker.  <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🌍 TEN Framework Ecosystem | Project | Preview | | ------- | ------- | | [**🏚️ TEN Framework**][ten-framework-link]<br>TEN, a AI agent framework to create various AI agents which supports real-time conversation.<br><br>![][ten-framework-shield] | ![][ten-framework-banner] | | [**🎙️ TEN Agent**][ten-agent-link]<br>TEN Agent is a conversational voice AI agent powered by TEN, integrating Deepseek, Gemini, OpenAI, RTC, and hardware like ESP32. It enables realtime AI capabilities like seeing, hearing, and speaking, and is fully compatible with platforms like Dify and Coze.<br><br>![][ten-agent-shield] | ![][ten-agent-banner] | | **🎨 TMAN Designer** `alpha`<br>TMAN Designer is low/no code option to make a cool voice agent. With it's easy-to-use workflow UI, you can build things easily. It comes with runtime, dark/light themes, integrated editors and integrated terminals.<br><br>![][tman-designer-shield] | ![][tman-designer-banner] | | **📒 TEN Portal**<br>The official site of TEN framework, it has documentation, blog and showcases.<br><br>![][ten-docs-shield] | ![][ten-docs-banner] | <div align="right"> [![][back-to-top]](#readme-top) </div> <br> ## 🥰 Contributing We welcome all forms of open-source collaboration! Whether you're fixing bugs, adding features, improving documentation, or sharing ideas - your contributions help advance personalized AI tools. Check out our GitHub Issues and Projects to find ways to contribute and show your skills. Together, we can build something amazing! <br> > \[!TIP] > > **Welcome all kinds of contributions** 🙏 > > Join us in building TEN better! Every contribution makes a difference, from code to documentation. Share your TEN Agent projects on social media with to inspire others! > > Connect with TEN maintainer [@elliotchen100](https://x.com/elliotchen100) on 𝕏 or [@cyfyifanchen](https://github.com/cyfyifanchen) on GitHub for project updates, discussions and collaboration opportunities. <br> ### Code Contributors [](https://github.com/TEN-framework/ten-agent/graphs/contributors) ### Contribution Guidelines Contributions are welcome! Please read the [contribution guidelines](./docs/code-of-conduct/contributing.md) first. ### License 1. The entire TEN framework (except for the folders explicitly listed below) is released under the Apache License, Version 2.0, with additional restrictions. For details, please refer to the [LICENSE](./LICENSE) file located in the root directory of the TEN framework. 2. The components within the `packages` directory are released under the Apache License, Version 2.0. For details, please refer to the `LICENSE` file located in each package's root directory. 3. The third-party libraries used by the TEN framework are listed and described in detail. For more information, please refer to the [third_party](./third_party/) folder. <div align="right"> [![][back-to-top]](#readme-top) </div> [back-to-top]: https://img.shields.io/badge/-Back_to_top-gray?style=flat-square [ten-framework-shield]: https://img.shields.io/github/stars/ten-framework/ten_framework?color=ffcb47&labelColor=gray&style=flat-square&logo=github [ten-agent-shield]: https://img.shields.io/github/stars/ten-framework/ten-agent?color=ffcb47&labelColor=gray&style=flat-square&logo=github [tman-designer-shield]: https://img.shields.io/github/stars/ten-framework/ten_ai_base?color=ffcb47&labelColor=gray&style=flat-square&logo=github [ten-docs-shield]: https://img.shields.io/github/stars/ten-framework/portal?color=ffcb47&labelColor=gray&style=flat-square&logo=github [ten-framework-link]: https://github.com/ten-framework/ten_framework [ten-agent-link]: https://github.com/ten-framework/ten-agent [ten-framework-banner]: https://ten-framework-assets.s3.us-east-1.amazonaws.com/ten-portal.jpeg [ten-agent-banner]: https://ten-framework-assets.s3.us-east-1.amazonaws.com/ten-agent.jpeg [tman-designer-banner]: https://ten-framework-assets.s3.us-east-1.amazonaws.com/tman-manager.jpeg [ten-docs-banner]: https://ten-framework-assets.s3.us-east-1.amazonaws.com/ten-doc.jpeg ", Assign "at most 3 tags" to the expected json: {"id":"11978","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"