base on Open-Source Web UI for managing Apache Kafka clusters <div align="center"> <img src="documentation/images/logo_new.png" alt="logo"/> <h3>Kafbat UI</h3> Versatile, fast and lightweight web UI for managing Apache Kafka® clusters. </div> <div align="center"> <a href="https://github.com/kafbat/kafka-ui/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" alt="License"/></a> <img src="documentation/images/free-open-source.svg" alt="price free"/> <a href="https://github.com/kafbat/kafka-ui/releases"><img src="https://img.shields.io/github/v/release/kafbat/kafka-ui" alt="latest release version"/></a> <a href="https://discord.gg/4DWzD7pGE5"><img src="https://img.shields.io/discord/897805035122077716" alt="discord online number count"/></a> <a href="https://github.com/sponsors/kafbat"><img src="https://img.shields.io/github/sponsors/kafbat?style=flat&logo=githubsponsors&logoColor=%23EA4AAA&label=Support%20us" alt="" /></a> </div> <p align="center"> <a href="https://ui.docs.kafbat.io/">Documentation</a> • <a href="https://ui.docs.kafbat.io/quick-start/demo-run">Quick Start</a> • <a href="https://discord.gg/4DWzD7pGE5">Community</a> <br/> <a href="https://aws.amazon.com/marketplace/pp/prodview-6tdqqzzjwmejq">AWS Marketplace</a> • <a href="https://www.producthunt.com/products/ui-for-apache-kafka/reviews/new">ProductHunt</a> </p> <p align="center"> <img src="https://repobeats.axiom.co/api/embed/88d2bd9887380c7d86e2f986725d9af52ebad7f4.svg" alt="stats"/> </p> #### Kafbat UI is a free, open-source web UI to monitor and manage Apache Kafka clusters. [Kafbat UI](https://kafbat.io/) is a simple tool that makes your data flows observable, helps find and troubleshoot issues faster and deliver optimal performance. Its lightweight dashboard makes it easy to track key metrics of your Kafka clusters - Brokers, Topics, Partitions, Production, and Consumption. <i> Kafbat UI, developed by <b>Kafbat</b>*, proudly carries forward the legacy of the UI Apache Kafka project. Our dedication is reflected in the continuous evolution of the project, ensuring adherence to its foundational vision while adapting to meet modern demands. We extend our gratitude to Provectus for their past support in groundbreaking work, which serves as a cornerstone for our ongoing innovation and dedication. <b>*</b> - The <b>Kafbat</b> team comprises key contributors from the project's inception, bringing a wealth of experience and insight to this renewed endeavor. </i> # Interface  # Features * **Topic Insights** – View essential topic details including partition count, replication status, and custom configurations. * **Configuration Wizard** – Set up and configure your Kafka clusters directly through the UI. * **Multi-Cluster Management** – Monitor and manage all your Kafka clusters in one unified interface. * **Metrics Dashboard** – Track key Kafka metrics in real time with a streamlined, lightweight dashboard. * **Kafka Brokers Overview** – Inspect brokers, including partition assignments and controller status. * **Consumer Group Details** – Analyze parked offsets per partition, and monitor both combined and partition-specific lag. * **Message Browser** – Explore messages in JSON, plain text, or Avro encoding formats. Live view is supported, enriched with user-defined CEL message filters. * **Dynamic Topic Management** – Create and configure new topics with flexible, real-time settings. * **Pluggable Authentication** – Secure your UI using OAuth 2.0 (GitHub, GitLab, Google), LDAP, or basic authentication. * **Cloud IAM Support** – Integrate with **GCP IAM**, **Azure IAM**, and **AWS IAM** for cloud-native identity and access management. * **Managed Kafka Service Support** – Full support for **Azure EventHub**, **Google Cloud Managed Service for Apache Kafka**, and **AWS Managed Streaming for Apache Kafka (MSK)**—both server-based and serverless. * **Custom SerDe Plugin Support** – Use built-in serializers/deserializers like AWS Glue and Smile, or create your own custom plugins. * **Role-Based Access Control** – [Manage granular UI permissions](https://ui.docs.kafbat.io/configuration/rbac-role-based-access-control) with RBAC. * **Data Masking** – [Obfuscate sensitive data](https://ui.docs.kafbat.io/configuration/data-masking) in topic messages to enhance privacy and compliance. * **MCP Server** - [Model Context Protocol](https://ui.docs.kafbat.io/faq/mcp) Server ## Feature overview <details> <summary>Click here for the feature overview</summary> # The Interface Kafbat UI wraps major functions of Apache Kafka with an intuitive user interface.  ## Topics Kafbat UI makes it easy for you to create topics in your browser by several clicks, pasting your own parameters, and viewing topics in the list.  It's possible to jump from connectors view to corresponding topics and from a topic to consumers (back and forth) for more convenient navigation. connectors, overview topic settings.  ### Messages Let's say we want to produce messages for our topic. With the Kafbat UI we can send or write data/messages to the Kafka topics without effort by specifying parameters, and viewing messages in the list.  ## Schema registry There are 3 supported types of schemas: Avro®, JSON Schema, and Protobuf schemas.  Before producing avro/protobuf encoded messages, you have to add a schema for the topic in Schema Registry. Now all these steps are easy to do with a few clicks in a user-friendly interface.  </details> # Getting Started To run Kafbat UI, you can use either a pre-built Docker image or build it (or a jar file) yourself. ## Quick start (Demo run) ```bash docker run -it -p 8080:8080 -e DYNAMIC_CONFIG_ENABLED=true ghcr.io/kafbat/kafka-ui ``` Then access the web UI at [http://localhost:8080](http://localhost:8080) The command is sufficient to try things out. When you're done trying things out, you can proceed with a [persistent installation](https://ui.docs.kafbat.io/quick-start/persistent-start) ## Persistent installation ```yml services: kafbat-ui: container_name: kafbat-ui image: ghcr.io/kafbat/kafka-ui:latest ports: - 8080:8080 environment: DYNAMIC_CONFIG_ENABLED: 'true' volumes: - ~/kui/config.yml:/etc/kafkaui/dynamic_config.yaml ``` Please refer to our [configuration](https://ui.docs.kafbat.io/configuration/configuration-file) page to proceed with further app configuration. ## Some useful configuration related links [Web UI Cluster Configuration Wizard](https://ui.docs.kafbat.io/configuration/configuration-wizard) [Configuration file explanation](https://ui.docs.kafbat.io/configuration/configuration-file) [Docker Compose examples](https://ui.docs.kafbat.io/configuration/compose-examples) [Misc configuration properties](https://ui.docs.kafbat.io/configuration/misc-configuration-properties) ## Helm charts [Quick start](https://ui.docs.kafbat.io/configuration/helm-charts/quick-start) ## Building from sources [Quick start](https://ui.docs.kafbat.io/development/building/prerequisites) with building ## Liveliness and readiness probes Liveliness and readiness endpoint is at `/actuator/health`.<br/> Info endpoint (build info) is located at `/actuator/info`. # Configuration options All the environment variables/config properties could be found [here](https://ui.docs.kafbat.io/configuration/misc-configuration-properties). # Contributing Please refer to [contributing guide](https://ui.docs.kafbat.io/development/contributing), we'll guide you from there. # Support As we're fully independent, team members contribute in their free time. Your support is crucial for us, if you wish to sponsor us, take a look [here](https://github.com/sponsors/kafbat) # Powered by [](https://jb.gg/OpenSourceSupport) ", Assign "at most 3 tags" to the expected json: {"id":"11869","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"